全部 标题 作者
关键词 摘要

OALib Journal期刊
ISSN: 2333-9721
费用:99美元

查看量下载量

相关文章

更多...

AI Selection in Organizations: A Decision Framework for Large Language Model and Generative AI Deployments

DOI: 10.4236/jsea.2026.196010, PP. 205-240

Keywords: Artificial Intelligence Selection, Large Language Models, Enterprise AI Governance, Responsible AI, AI Proliferation, Transformer Architecture, NIST AI RMF, ISO 42001, Build, Configure, or Buy, Retrieval-Augmented Generation, MLOps, AI Model Lifecycle, Agentic AI, Shadow AI

Full-Text   Cite this paper   Add to My Lib

Abstract:

Artificial intelligence selection has emerged as one of the most impactful decision areas facing modern organizations. As AI adoption has accelerated from experimental use to broad enterprise deployment, the central challenge is no longer whether organizations should adopt AI, but how leaders and technology professionals can make informed, defensible decisions about which AI systems to select, how to govern them, and where they can create sustainable organizational value. The urgency of this challenge is heightened by rapid vendor proliferation, uneven executive technical literacy, growing regulatory expectations, and the increasing operational risks associated with poorly matched AI solutions, including wasted investment, vendor lock-in, unreliable outputs, and uncontrolled shadow AI adoption. This paper addresses that problem by providing a practical and conceptually grounded framework for AI selection in organizations. It first explains how current large language models (LLMs) work, including transformer architecture, training, alignment, fine-tuning, and key limitations, while translating these concepts into plain language for executive audiences. It then examines why technical literacy has become essential for organizational decision-makers responsible for AI strategy, procurement, and governance. Building on that foundation, the paper presents a structured selection framework that evaluates AI systems across eight dimensions: capability assessment, alignment and safety, integration fit, data governance, total cost of ownership, vendor risk and lock-in, governance and compliance, and lifecycle management, aligned with the NIST AI Risk Management Framework (AI RMF 1.0) and ISO/IEC 42001:2023. The paper further introduces an executive decision model for the build, configure, or buy choice, and concludes with strategies for preventing extreme AI proliferation through governance controls, technical safeguards, and workforce education. The contribution of this paper is both strategic and practical. For organizational leaders, it offers a clearer basis for aligning AI decisions with business goals, risk tolerance, compliance obligations, and long-term operating models. For technology professionals, it provides a structured approach to evaluating AI capabilities, deployment options, and lifecycle implications in a way that supports sound architecture and governance decisions. By integrating academic literature with current industry evidence, this paper equips decision-makers with a more informed foundation for selecting AI systems that are not only

References

[1]  Chui, M., Hall, B., Mayhew, H., Singla, A. and Sukharevsky, A. (2022) The State of AI in 2022, and a Half Decade in Review. McKinsey & Company.
https://www.mckinsey.com/capabilities/quantumblack/our-insights/the-state-of-ai-in-2022-and-a-half-decade-in-review
[2]  Singla, A., Sukharevsky, A., Hall, B., Yee, L. and Chui, M. (2025) The State of AI in 2025: Agents, Innovation, and Transformation. McKinsey & Company.
https://www.mckinsey.com/capabilities/quantumblack/our-insights/the-state-of-ai
[3]  Brynjolfsson, E. (2022) The Turing Trap: The Promise & Peril of Human-Like Artificial Intelligence. Daedalus, 151, 272-287.
https://doi.org/10.1162/daed_a_01915
[4]  Soulami, M., Benchekroun, S. and Galiulina, A. (2024) Exploring How AI Adoption in the Workplace Affects Employees: A Bibliometric and Systematic Review. Frontiers in Artificial Intelligence, 7, Article 1473872.
https://doi.org/10.3389/frai.2024.1473872
[5]  Watermann, L., Kubowitsch, S. and Lermer, E. (2025) AI and Work Design: A Positive Psychology Approach to Employee Well-Being. Gruppe. Interaktion. Organisation. Zeitschrift für Angewandte Organisationspsychologie, 56, 311-320.
https://doi.org/10.1007/s11612-025-00806-3
[6]  Mienye, I.D., Jere, N., Obaido, G., Ogunruku, O.O., Esenogho, E. and Modisane, C. (2025) Large Language Models: An Overview of Foundational Architectures, Recent Trends, and a New Taxonomy. Discover Applied Sciences, 7, Article No. 1027.
https://doi.org/10.1007/s42452-025-07668-w
[7]  IBM (2024) What Are Large Language Models (LLMs)? IBM Think.
https://www.ibm.com/think/topics/large-language-models
[8]  Zaza, Z. and Souissi, O. (2025) Architectural and Methodological Advancements in Large Language Models. Engineering Proceedings, 97, Article 8.
https://doi.org/10.3390/engproc2025097008
[9]  Lu, W., Luu, R.K. and Buehler, M.J. (2025) Fine-Tuning Large Language Models for Domain Adaptation: Exploration of Training Strategies, Scaling, Model Merging and Synergistic Capabilities. npj Computational Materials, 11, Article No. 84.
https://doi.org/10.1038/s41524-025-01564-y
[10]  Jeong, C. (2024) Fine-Tuning and Utilization Methods of Domain-Specific LLMs.
https://arxiv.org/abs/2401.02981
[11]  National Institute of Standards and Technology (2023) AI Risk Management Framework (AI RMF 1.0). U.S. Department of Commerce.
https://www.nist.gov/itl/ai-risk-management-framework
[12]  Maslej, N., Fattorini, L., Perrault, R., Gil, Y., et al. (2025) Artificial Intelligence Index Report 2025. Stanford Institute for Human-Centered Artificial Intelligence (HAI).
https://hai.stanford.edu/ai-index/2025-ai-index-report
[13]  Wharton AI Program (2025) Gen AI Fast-Tracks into the Enterprise: Year Three Full Report. The Wharton School, University of Pennsylvania.
https://ai.wharton.upenn.edu/wp-content/uploads/2025/10/2025-Wharton-GBK-AI-Adoption-Report_Full-Report.pdf
[14]  International Association of Privacy Professionals (IAPP) (2024) AI Governance in Practice Report 2024. IAPP & FTI Technology.
https://iapp.org/resources/article/ai-governance-in-practice-report
[15]  Knostic (2025) The 20 Biggest AI Governance Statistics and Trends of 2025. Knostic AI.
https://www.knostic.ai/blog/ai-governance-statistics
[16]  Bisht, A., Yee, L. and Roberts, R. (2025) Open Source Technology in the Age of AI. McKinsey & Company.
https://www.mckinsey.com/capabilities/quantumblack/our-insights/open-source-technology-in-the-age-of-ai
[17]  Gartner (2025) Hype Cycle for Artificial Intelligence, 2025. Gartner Inc.
https://www.gartner.com/en/articles/hype-cycle-for-artificial-intelligence
[18]  Gartner (2024) Gartner Predicts 30% of Generative AI Projects Will Be Abandoned after Proof of Concept by End of 2025. Gartner Newsroom.
https://www.gartner.com/en/newsroom/press-releases/2024-07-29-gartner-predicts-30-percent-of-generative-ai-projects-will-be-abandoned-after-proof-of-concept-by-end-of-2025
[19]  European Parliament (2024) Regulation (EU) 2024/1689 of the European Parliament and of the Council, Artificial Intelligence Act.
https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=OJ:L_202401689
[20]  International Organization for Standardization (2023) ISO/IEC 42001:2023, Artificial intelligence, Management System.
https://www.iso.org/standard/81230.html
[21]  IBM (2024) Guide for Implementing an AI Governance Framework. IBM Institute for Business Value.
https://www.ibm.com/think/insights/ai-governance-implementation
[22]  World Economic Forum (2025) Advancing Responsible AI Innovation: A Playbook. WEF Insight Report.
https://www.weforum.org/publications/advancing-responsible-ai-innovation-a-playbook/
[23]  Cyberhaven (2024) Q2 2024 AI Adoption and Risk Report. Cyberhaven Labs.
https://info.cyberhaven.com/hubfs/Content%20PDF/Cyberhaven%20Q2%202024%20AI%20Adoption%20and%20Risk%20Report%20052024.pdf
[24]  Reco.ai (2025) 2025 State of Shadow AI Report. Reco.
https://www.reco.ai/state-of-shadow-ai-report
[25]  Hevner, A.R., March, S.T., Park, J. and Ram, S. (2004) Design Science in Information Systems Research. MIS Quarterly, 28, 75-106.
https://doi.org/10.2307/25148625
[26]  Peffers, K., Tuunanen, T., Rothenberger, M.A. and Chatterjee, S. (2007) A Design Science Research Methodology for Information Systems Research. Journal of Management Information Systems, 24, 45-77.
https://doi.org/10.2753/mis0742-1222240302
[27]  Moffatt, V. (2024) Air Canada, 2024 BCCRT 149 (CanLII). (2024). British Columbia Civil Resolution Tribunal.
[28]  Restaurant Dive (2024) McDonald’s Ends IBM Drive-Thru Voice Order Test.
https://www.restaurantdive.com/news/mcdonalds-ibm-drive-thru-automation-voice-ordering-ai/719085/
[29]  OpenAI (2025) Morgan Stanley Uses AI Evals to Shape the Future of Financial Services. OpenAI.
https://openai.com/index/morgan-stanley/
[30]  The University of Texas System Audit Office (2016) Special Review of Procurement Procedures Related to the M.D. Anderson Cancer Center Oncology Expert Advisor project. The University of Texas System.
[31]  Lecher, C. (2024) NYC’s AI Chatbot Tells Businesses to Break the Law. The Markup.
https://themarkup.org/artificial-intelligence/2024/03/29/nycs-ai-chatbot-tells-businesses-to-break-the-law
[32]  Klarna (2024) Klarna AI Assistant Handles Two-Thirds of Customer Service Chats in Its First Month. Klarna.
https://www.klarna.com/international/press/klarna-ai-assistant-handles-two-thirds-of-customer-service-chats-in-its-first-month/
[33]  Shibu, S. (2025) Klarna Is Hiring Customer Service Agents after AI Couldn’t Cut It on Calls, According to the Company’s CEO. Entrepreneur.
https://www.entrepreneur.com/business-news/klarna-ceo-reverses-course-by-hiring-more-humans-not-ai/491396

Full-Text

Contact Us

service@oalib.com

QQ:3279437679

WhatsApp +8615387084133