THE REPLICATION CRISIS IN MARKETING: A FIELD-SPECIFIC DIAGNOSIS AND PRESCRIPTIONS FOR IMPROVING METHODOLOGICAL RIGOR
Main Article Content
Indra Hidayat
Lukmanul Hakim
Dahrul Aman Harahap
This study examines the replication crisis in marketing by providing a field-specific diagnosis and proposing methodological improvements to enhance research rigor. The replication crisis, characterized by the inability to reproduce empirical findings, has raised concerns about the credibility and reliability of marketing research. This article identifies key contributing factors, including questionable research practices such as p-hacking and selective reporting, lack of transparency in data and methods, publication bias favoring statistically significant results, and institutional pressures driven by the “publish or perish” culture. Using a qualitative literature review approach, this study synthesizes insights from prior research to explore the structural and methodological roots of the problem. The findings reveal that the replication crisis in marketing is not caused by a single factor but by an interconnected system of methodological weaknesses and institutional incentives. These issues undermine both the theoretical development of marketing and its practical applications in business decision-making. To address these challenges, the study proposes several key recommendations, including the adoption of open science practices, increased support for replication studies, improvements in research design and statistical analysis, and enhanced education on research ethics and methodology. By implementing these strategies, the marketing discipline can strengthen its scientific foundation, improve the reproducibility of findings, and restore trust in academic research.
Block, J. H., Fisch, C., Kanwal, N., Lorenzen, S., & Schulze, A. (2022). Replication studies in top management journals: An empirical investigation of prevalence, types, outcomes, and impact. Management Review Quarterly, 73(3), 1109–1134. https://doi.org/10.1007/s11301-022-00269-6
Bryan, C. J., Tipton, E., & Yeager, D. (2021a). Behavioural science is unlikely to change the world without a heterogeneity revolution. Nature Human Behaviour. https://doi.org/10.1038/s41562-021-01143-3
Bryan, C. J., Tipton, E., & Yeager, D. (2021b). Behavioural science is unlikely to change the world without a heterogeneity revolution. Nature Human Behaviour. https://doi.org/10.1038/s41562-021-01143-3
Filazzola, A., & Cahill, J. (2021a). Replication in field ecology: Identifying challenges and proposing solutions. Methods in Ecology and Evolution. https://doi.org/10.1111/2041-210X.13657
Filazzola, A., & Cahill, J. (2021b). Replication in field ecology: Identifying challenges and proposing solutions. Methods in Ecology and Evolution. https://doi.org/10.1111/2041-210X.13657
Goldfarb, A., Tucker, C., & Wang, Y. (2022). Conducting Research in Marketing with Quasi-Experiments. Journal of Marketing, 86(3), 1–20. https://doi.org/10.1177/00222429221082977
Hair, J. F., & Sarstedt, M. (2021). Data, measurement, and causal inferences in machine learning: opportunities and challenges for marketing. https://doi.org/10.1080/10696679.2020.1860683
Hensel, P. G. (2021). Reproducibility and replicability crisis: How management compares to psychology and economics – A systematic review of literature. European Management Journal, 39(5), 577–594. https://doi.org/10.1016/j.emj.2021.01.002
Hope, D., Dewar, A., & Hay, C. (2021). Is There a Replication Crisis in Medical Education Research? Academic Medicine, 96(7), 958–963. https://doi.org/10.1097/acm.0000000000004063
Keener, S. K., Kepes, S., & Torka, A.-K. (2023). The trustworthiness of the cumulative knowledge in industrial/organizational psychology: The current state of affairs and a path forward. Acta Psychologica. https://doi.org/10.1016/j.actpsy.2023.104005
Klein, R. A., Ratliff, K. A., Vianello, M., Adams Jr., R. B., Bahník, Š., Bernstein, M. J., Bocian, K., Brandt, M. J., Brooks, B., Brumbaugh, C. C., Cemalcilar, Z., Chandler, J., Cheong, W., Davis, W. E., Devos, T., Eisner, M., Frankowska, N., Furrow, D., Galliani, E. M., … Nosek, B. A. (2014). Investigating Variation in Replicability. Social Psychology, 45(3), 142–152. https://doi.org/10.1027/1864-9335/a000178
Lakens, D. (2025). Concerns About Theorizing, Relevance, Generalizability, and Methodology Across Two Crises in Social Psychology. International Review of Social Psychology. https://doi.org/10.5334/irsp.1038
Leichtmann, B., Nitsch, V., & Mara, M. (2022a). Crisis Ahead? Why Human-Robot Interaction User Studies May Have Replicability Problems and Directions for Improvement. Frontiers in Robotics and AI. https://doi.org/10.3389/frobt.2022.838116
Leichtmann, B., Nitsch, V., & Mara, M. (2022b). Crisis Ahead? Why Human-Robot Interaction User Studies May Have Replicability Problems and Directions for Improvement. Frontiers in Robotics and AI. https://doi.org/10.3389/frobt.2022.838116
Mesquida, C., Murphy, J., Lakens, D., & Warne, J. (2022). Replication concerns in sports and exercise science: a narrative review of selected methodological issues in the field. Royal Society Open Science. https://doi.org/10.1098/rsos.220946
Nelson, N. C., Chung, J., Ichikawa, K., & Malik, M. M. (2021). Psychology Exceptionalism and the Multiple Discovery of the Replication Crisis. Review of General Psychology, 26(2), 184–198. https://doi.org/10.1177/10892680211046508
Ryan, J. C., & Tipu, S. A. A. (2022). Business and management research: Low instances of replication studies and a lack of author independence in replications. Research Policy. https://doi.org/10.1016/j.respol.2021.104408
Serra-Garcia, M., & Gneezy, U. (2021). Nonreplicable publications are cited more than replicable ones. Science Advances. https://doi.org/10.1126/sciadv.abd1705
Shaw, S. D., & Nave, G. (2023). Don’t hate the player, hate the game: Realigning incentive structures to promote robust science and better scientific practices in marketing. Journal of Business Research, 167, 114129. https://doi.org/10.1016/j.jbusres.2023.114129
Stremersch, S., González, J., Valenti, A., & Villanueva, J. (2022). The value of context-specific studies for marketing. Journal of the Academy of Marketing Science. https://doi.org/10.1007/s11747-022-00872-9
Urminsky, O., & Dietvorst, B. J. (2024). Taking the Full Measure: Integrating Replication into Research Practice to Assess Generalizability. Journal of Consumer Research, 51(1), 157–168. https://doi.org/10.1093/jcr/ucae007
