With the development of consumer neuroscience, multimodal neuromarketing has increasingly been applied to advertising effectiveness evaluation. This review examines electroencephalography (EEG), functional magnetic resonance imaging (fMRI), eye tracking (ET), galvanic skin response (GSR), and facial electromyography (fEMG), focusing on what each measure contributes to the assessment of advertising responses and how their combination can extend conventional evaluation. Rather than treating multimodality as a simple aggregation of devices, the review considers its value in terms of measurement complementarity, cross-modal evidence convergence, and multimodal data fusion. Evidence from advertising and related consumer-response research suggests that these approaches can connect visual attention, neural processing, physiological arousal, affective responses, memory, and consumer choice. Applications and related evidence span audiovisual advertising, influencer marketing, online advertising, and consumer choice prediction. However, the evidence remains heterogeneous, and the interpretive limits of individual measures continue to matter. Ecological validity, small samples, high-dimensional data, model generalizability, and neurodata governance are therefore important concerns. Future research should emphasize theoretically guided multimodal designs, naturalistic stimuli, independent validation, artificial intelligence, and responsible data use. Overall, multimodal neuromarketing is best understood as a complementary framework that can enrich advertising research when different measures are selected and interpreted in relation to a common theoretical question.
Cite this paper
Yang, Y. and Xu, Z. (2026). Multimodal Neuromarketing for Advertising Effectiveness Evaluation: Research Progress and Future Directions. Open Access Library Journal, 13, e15965. doi: http://dx.doi.org/10.4236/oalib.1115965.
Plassmann, H., Venkatraman, V., Huettel, S. and Yoon, C. (2015) Consumer Neuroscience: Applications, Challenges, and Possible Solutions. <i>Journal of Marketing Research</i>, 52, 427-435. <br>https://doi.org/10.1509/jmr.14.0048
Bazzani, A., Ravaioli, S., Trieste, L., Faraguna, U. and Turchetti, G. (2020) Is EEG Suitable for Marketing Research? A Systematic Review. <i>Frontiers in Neuroscience</i>, 14, Article ID: 594566. <br>https://doi.org/10.3389/fnins.2020.594566
Zhang, Y., Thaichon, P. and Shao, W. (2023) Neuroscientific Research Methods and Techniques in Consumer Research. <i>Australasian Marketing Journal</i>, 31, 211-227. <br>https://doi.org/10.1177/14413582221085321
Cao, C.C. and Reimann, M. (2020) Data Triangulation in Consumer Neuroscience: Integrating Functional Neuroimaging with Meta-Analyses, Psychometrics, and Behavioral Data. <i>Frontiers in Psychology</i>, 11, Article ID: 550204. <br>https://doi.org/10.3389/fpsyg.2020.550204
Motoki, K., Saito, T. and Onuma, T. (2021) Eye-Tracking Research on Sensory and Consumer Science: A Review, Pitfalls and Future Directions. <i>Food Research International</i>, 145, Article 110389. <br>https://doi.org/10.1016/j.foodres.2021.110389
Lajante, M., Droulers, O., Derbaix, C. and Poncin, I. (2020) Looking at Aesthetic Emotions in Advertising Research through a Psychophysiological Perspective. <i>Frontiers in Psychology</i>, 11, Article ID: 553100. <br>https://doi.org/10.3389/fpsyg.2020.553100
Zito, M., Fici, A., Bilucaglia, M., Ambrogetti, F.S. and Russo, V. (2021) Assessing the Emotional Response in Social Communication: The Role of Neuromarketing. <i>Frontiers in Psychology</i>, 12, Article ID: 625570. <br>https://doi.org/10.3389/fpsyg.2021.625570
Haidinger, K. and Koller, M. (2023) The Value of Consumer Neuroscience Research for Contemporary Marketing Knowledge. <i>Frontiers in Human Neuroscience</i>, 17, Article ID: 1214848. <br>https://doi.org/10.3389/fnhum.2023.1214848
Costa-Feito, A., González-Fernández, A.M., Rodríguez-Santos, C. and Cervantes-Blanco, M. (2023) Electroencephalography in Consumer Behaviour and Marketing: A Science Mapping Approach. <i>Humanities and Social Sciences Communications</i>, 10, Article No. 474. <br>https://doi.org/10.1057/s41599-023-01991-6
Venkatraman, V., Dimoka, A., Pavlou, P.A., Vo, K., Hampton, W., Bollinger, B., <i>et al</i>. (2015) Predicting Advertising Success Beyond Traditional Measures: New Insights from Neurophysiological Methods and Market Response Modeling. <i>Journal of Marketing Research</i>, 52, 436-452. <br>https://doi.org/10.1509/jmr.13.0593
Otamendi, F.J. and Sutil Martín, D.L. (2020) The Emotional Effectiveness of Advertisement. <i>Frontiers in Psychology</i>, 11, Article ID: 2088. <br>https://doi.org/10.3389/fpsyg.2020.02088
Byrne, A., Bonfiglio, E., Rigby, C. and Edelstyn, N. (2022) A Systematic Review of the Prediction of Consumer Preference Using EEG Measures and Machine-Learning in Neuromarketing Research. <i>Brain Informatics</i>, 9, Article No. 27. <br>https://doi.org/10.1186/s40708-022-00175-3
Yao, X. and Wang, Y. (2024) Using Neural Data to Forecast Aggregate Consumer Behavior in Neuromarketing: Theory, Metrics, Progress, and Outlook. <i>Journal of Consumer </i><i>Behaviour</i>, 23, 2142-2159. <br>https://doi.org/10.1002/cb.2324
Pozharliev, R., Rossi, D. and De Angelis, M. (2022) A Picture Says More than a Thousand Words: Using Consumer Neuroscience to Study Instagram Users’ Responses to Influencer Advertising. <i>Psychology & Marketing</i>, 39, 1336-1349. <br>https://doi.org/10.1002/mar.21659
Van Reijmersdal, E.A., Rozendaal, E., Hudders, L., Vanwesenbeeck, I., Cauberghe, V. and Van Berlo, Z.M.C. (2020) Effects of Disclosing Influencer Marketing in Videos: An Eye Tracking Study among Children in Early Adolescence. <i>Journal of Interactive Marketing</i>, 49, 94-106. <br>https://doi.org/10.1016/j.intmar.2019.09.001
Yen, C. and Chiang, M. (2021) Examining the Effect of Online Advertisement Cues on Human Responses Using Eye-Tracking, EEG, and MRI. <i>Behavioural</i><i> Brain Research</i>, 402, Article 113128. <br>https://doi.org/10.1016/j.bbr.2021.113128
Eijlers, E., Boksem, M.A.S. and Smidts, A. (2020) Measuring Neural Arousal for Advertisements and Its Relationship with Advertising Success. <i>Frontiers in Neuroscience</i>, 14, Article ID: 736. <br>https://doi.org/10.3389/fnins.2020.00736
Peng-Li, D., Byrne, D.V., Chan, R.C.K. and Wang, Q.J. (2020) The Influence of Taste-Congruent Soundtracks on Visual Attention and Food Choice: A Cross-Cultural Eye-Tracking Study in Chinese and Danish Consumers. <i>Food Quality and Preference</i>, 85, Article 103962. <br>https://doi.org/10.1016/j.foodqual.2020.103962
Casado-Aranda, L., Sánchez-Fernández, J. and García, N. (2022) Evaluating the Neural Mechanisms of Exposure and Retrieval of Hedonic and Utilitarian Banners: A fMRI Study. <i>Computers in Human Behavior</i>, 134, Article 107317. <br>https://doi.org/10.1016/j.chb.2022.107317
Adalarasu, K., Ghousiya Begum, K., Vishnu Priyan, M., Devendranath, C. and Sriram, G.V. (2025) Neuro-Signaling Techniques in Advertisement Endorsements: Unveiling Consumer Responses and Behavioral Trends. <i>Journal of Retailing and Consumer Services</i>, 84, Article 104175. <br>https://doi.org/10.1016/j.jretconser.2024.104175
Chen, Y., Wang, H., Rao Hill, S. and Li, B. (2024) Consumer Attitudes toward Ai-Generated Ads: Appeal Types, Self-Efficacy and Ai’s Social Role. <i>Journal of Business Research</i>, 185, Article 114867. <br>https://doi.org/10.1016/j.jbusres.2024.114867
Ferrell, M.L., Beatty, A. and Dubljevic, V. (2025) The Ethics of Neuromarketing: A Rapid Review. <i>Neuroethics</i>, 18, Article No. 19. <br>https://doi.org/10.1007/s12152-025-09591-8