全部 标题 作者
关键词 摘要

OALib Journal期刊
ISSN: 2333-9721
费用:99美元

查看量下载量

相关文章

更多...

Computational Processing of Political Bias Using AI Agents

DOI: 10.4236/jis.2026.174024, PP. 540-568

Keywords: Bias Mitigation, Iterative Refinement, Large Language Models, LLM as a Judge, Multi-Agent Systems, Political Bias, Political Compass, Social Media

Full-Text   Cite this paper   Add to My Lib

Abstract:

Given the widespread presence of media bias favoring political groups on social media, discerning inherent bias is challenging. Existing methodologies often rely on an oversimplified, unidimensional (left/right) political spectrum. Furthermore, most research has focused on bias detection rather than mitigation. This paper introduces and evaluates POLQUAD, a novel multi-agent AI framework designed to mitigate political bias in social networks. Our approach utilizes the two-dimensional political compass (Authoritarian/Libertarian and Left/Right) to achieve nuanced classification. The POLQUAD framework employs specialized Opinion Agents, each prompted to represent one quadrant, to analyze text. A central Judge Agent synthesizes these perspectives and iteratively refines content toward neutrality. We conducted a study comparing our Full POLQUAD against two simpler iterative models (Unified and Naive) using samples from a dataset of 79,745 tweets from US Senators. All frameworks performed reasonably on text with low bias; however, the Full POLQUAD framework outperformed the others on a curated high bias dataset (bias magnitude > 7.0). On this dataset, the Full POLQUAD framework maintained high effectiveness while the Naive and Unified models’ performance collapsed. Importantly, the Full POLQUAD framework was the most efficient, converging on a neutral solution in fewer iterations. A subsequent ablation study confirmed that removing any of the four political agents degrades performance. The results validate that its synthesis-then-refine architecture provides a more stable, efficient, and robust solution for mitigating bias in highly polarized content.

References

[1]  The Political Compass.
https://www.politicalcompass.org/
[2]  Baly, R., Da San Martino, G., Glass, J. and Nakov, P. (2020) We Can Detect Your Bias: Predicting the Political Ideology of News Articles. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), 16-20 November 2020, 4982-4991.
https://doi.org/10.18653/v1/2020.emnlp-main.404
[3]  AlDahoul, N., Rahwan, T. and Zaki, Y. (2024) PoLYTC: A Novel BERT-Based Classifier to Detect Political Leaning of Youtube Videos Based on Their Titles. Journal of Big Data, 11, Article No. 58.
https://doi.org/10.1186/s40537-024-00946-1
[4]  Hernandes, R. and Corsi, G. (2024) LLMs Left, Right, and Center: Assessing GPT’s Capabilities to Label Political Bias from Web Domains. arXiv preprint arXiv:2407.14344.
https://doi.org/10.48550/arXiv.2407.14344
[5]  Oketunji, A.F., Anas, M. and Saina, D. (2024) Large Language Model (LLM) Bias Index-LLMBI. Data & Policy, 6, e12.
[6]  Ye, J., Wang, Y., Huang, Y., et al. (2025) Justice or Prejudice? Quantifying Biases in LLM-as-a-Judge. Proceedings of the International Conference on Learning Representations (ICLR 2025), Singapore, 24-28 April 2025, 1-32.
[7]  Zheng, L., Chiang, W., Sheng, Y., Zhuang, S., Wu, Z., Zhuang, Y., et al. (2023) Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena. Advances in Neural Information Processing Systems, Vol. 36, 46595-46623.
https://doi.org/10.52202/075280-2020
[8]  R?ttger, P., Hofmann, V., Pyatkin, V., Hinck, M., Kirk, H., Schuetze, H., et al. (2024) Political Compass or Spinning Arrow? Towards More Meaningful Evaluations for Values and Opinions in Large Language Models. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics, Volume 1, 15295-15311.
https://doi.org/10.18653/v1/2024.acl-long.816
[9]  Liu, M. and Shi, G. (2024) PoliPrompt: A High-Performance Cost-Effective LLM-Based Text Classification Framework for Political Science.
https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4940136
[10]  Podolak, J., ?ukasik, S., Balawender, P., Ossowski, J., Piotrowski, J., Bakowicz, K., et al. (2024) LLM Generated Responses to Mitigate the Impact of Hate Speech. Findings of the Association for Computational Linguistics: EMNLP 2024, Miami, 12-16 November 2024, 15860-15876.
https://doi.org/10.18653/v1/2024.findings-emnlp.931
[11]  Park, J., Jeong, S., Song, S., Lee, Y. and Oh, A. (2025) LLM-C3MOD: A Human-LLM Collaborative System for Cross-Cultural Hate Speech Moderation. Proceedings of the 3rd Workshop on Cross-Cultural Considerations in NLP (C3NLP 2025), Albuquerque, 3-4 May 2025, 71-88.
https://doi.org/10.18653/v1/2025.c3nlp-1.7
[12]  Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., et al. (2022) Chain-of-Thought Prompting Elicits Reasoning in Large Language Models. Advances in Neural Information Processing Systems, Vol. 35, 24824-24837.
https://doi.org/10.52202/068431-1800

Full-Text

Contact Us

service@oalib.com

QQ:3279437679

WhatsApp +8615387084133