Identifying market structure to monitor product competition using a consumer-behavior-based intelligence model

Abstract Purpose The objective of this paper is to propose a consumer-behavior-based intelligence (CBBI) model to identify market structure so as to monitor product competition. Competitive intelligence extracted from Chinese e-business clickstream data is exploited to examine the relevance of consumers' heterogeneous behavioral feedback, namely, click, tag-into-favorite, time-of-browsing, add-into-cart, and remove-from-cart, to visualize the competitive product market structure and to predict product-level sales. Design/methodology/approach Our proposed CBBI model consists of visualization and prediction, which explore e-business clickstream data. We conduct the visualization and segmentation of market structure in the form of a perceptual map by employing K-means clustering algorithm and multidimensional scaling technique. Concurrently, we developed an updated Bayesian linear regression (BLR) to predict product-level sales by considering consumers' heterogeneous feedback. Our updated BLR specifically integrated the estimated knowledge of the previous periods to verify whether product sales are period-dependent due to the consumer memory effect in e-commerce, improving the conventional BLR of diffuse prior distribution setup in terms of mean absolute error (MAE) and root mean squared error (RMSE). Findings Considering the performance of consumers' heterogeneous actions, the present research visualized three different segments of the competitive market structure in a perceptual map, and its horizontal axis is shown as a signal of the ascending trend of product sales. The previous five-day period was ascertained to be the best size of a time window for the consumer memory effect on product sales prediction. This hypothesis is supported by the concept that product sales are period-dependent. The results of the proposed updated BLR indicate that consumer tag-into-favorite, add-into-cart, and remove-from-cart feedback have positive impacts on product-level sales while click and time-of-browsing have the opposite effect. Originality/value While the identified competitive product market structure elaborates consumer heterogeneous feedback toward alternative product choices, this paper contributes by extending those homogeneous consumer preferences-related marketing studies. The perceptual map's configuration in respect to period-dependent product sales facilitates the effective inclusion of consumer behavior application in product sales prediction research in e-commerce. This paper helps sellers and retailers better comprehend the impacts of heterogeneous feedback and the consumer memory effect on the degree of competition in the form of product sales. The research results also offer a managerial implication about shaping the competitive edge by conducting different product management strategies in e-commerce platforms.