Keywords
AI
hallucinations
ChatGPT
Crystal Bowl Conundrum
total intelligence society
knowledge worker
information worker
intelligence analyst
competitive intelligence
business intelligence
market intelligence
How to Cite
Abstract
What is the literature on AI missing for prompting engineering so far, and how good are these services at Societal Analysis and Future Predictions? A literature review and laboratory tests were conducted using different AI services. This study provides an extensive list of research gaps based on an analysis of existing literature. Furthermore, it demonstrates that AI with well-crafted prompts performs as well as or better than senior intelligence analysts in Societal Analysis and Future Predictions. The literature and analysis make it clear that the role of the prompter, to ensure reliability, must be divided into two parts: Prompt Engineering and Information Quality Control (IQC), which in this context is distinct from Prompt Answer Engineering. This study also proposes a working process in the form of a model for using AI in information or intelligence gathering. Additionally, it outlines the rationale for why top managers’ salaries are likely to decrease as a result of these developments.
References
Alkaissi H., McFarlane S.I. (2023) Artificial hallucinations in ChatGPT: Implications in scientific writing. Cureus, 15(2), 35179. https://doi.org/10.7759%2Fcureus.35179.
Bahrami M., Mansoorizadeh M., Khotanlou H. (2023) Few-shot Learning with Prompting Methods. Paper presented at the 2023 6th International Conference on Pattern Recognition and Image Analysis (IPRIA),14-16 February 2023, Qom, Iran,. DOI: https://doi.org/10.1109/IPRIA59240.2023.10147172
Beganovic A., Jaber M.A., Abd Almisreb A. (2023) Methods and Applications of ChatGPT in Software Development: A Literature Review. Southeast Europe Journal of Soft Computing, 12(1), 8-12. DOI: https://doi.org/10.21533/scjournal.v12i1.251
Bondielli A., Dell'Oglio P., Lenci A., Marcelloni F., Passaro L.C., Sabbatini M. (2023) Multi-fake-detective at EVALITA 2023: Overview of the multimodal fake news detection and verification task. Paper presented at the 8th Evaluation Campaign of Natural Language Processing and Speech Tools for Italian (EVALITA 2023), September 7-8, Parma, Italy.
Budhwar P., Chowdhury C., Wood G., Aguinis H., Bamber G.J., Beltran J.R., Boselie P., Cooke F.L., Decker S., DeNisi A., Dey P.K., Guest D., Knoblich A.J., Malik A., Paauwe J., Papagiannidis S., Patel C., Pereira V., Ren S., Rogelberg S., Saunders M.N.K., Tung R.L., Varma A. (2023) Human resource management in the age of generative artificial intelligence: Perspectives and research directions on ChatGPT. Human Resource Management Journal, 33(3), 606-659. DOI: https://doi.org/10.1111/1748-8583.12524
Chang Y., Wang X., Wang J., Wu Y., Zhu K., Chen H., Yi X., Wang C., Wang Y., Ye W., Zhang Y., Chang Y., Yu P.S., Yang Q., Xie, X. (2023) A survey on evaluation of large language models (arXiv preprint 2307.03109). DOI: https://doi.org/10.48550/arXiv.2307.03109
Conroy G. (2023) How ChatGPT and other AI tools could disrupt scientific publishing - A world of AI-assisted writing and reviewing might transform the nature of the scientific paper. Nature, 622, 234-236. DOI: https://doi.org/10.1038/d41586-023-03144-w
Davenport T.H., Ronanki R. (2018) Artificial intelligence for the real world. Harvard Business Review, 96(1), 108-116.
Fiannaca A.J., Kulkarni C., Cai C.J., Terry M. (2023) Programming without a Programming Language: Challenges and Opportunities for Designing Developer Tools for Prompt Programming. Paper presented at the 2023 CHI Conference on Human Factors in Computing Systems, April. DOI: https://doi.org/10.1145/3544549.3585737
Henderson P., Hashimoto T., Lemley M. (2023) Where's the Liability in Harmful AI Speech? (arXiv preprint 2308.04635). DOI: https://doi.org/10.48550/arXiv.2308.04635
Heston T.F., Khun C. (2023) Prompt engineering in medical education. International Medical Education, 2(3), 198-205. DOI: https://doi.org/10.3390/ime2030019
Kumar M., Mani U.A., Tripathi P., Saalim M., Roy S., Roy Sr. S. (2023) Artificial Hallucinations by Google Bard: Think Before You Leap. Cureus, 15(8). DOI: https://doi.org/10.7759/cureus.43313
Kumar R. (2017) Machine learning and cognition in enterprises: Business intelligence transformed. Heidelberg, Dordrecht, London, New York: Springer.
Kumar D., Taylor G.W., Wong A. (2017) Opening the black box of financial AI with clear-trade: A class-enhanced attentive response approach for explaining and visualizing deep learning-driven stock market prediction (arXiv preprint 1709.01574). DOI: https://doi.org/10.48550/arXiv.1709.01574
Liu P., Yuan W., Fu J., Jiang Z., Hayashi H., Neubig G. (2023) Pre-train, prompt, and predict: A systematic survey of prompting methods in natural language processing. ACM Computing Surveys, 55(9), 195. DOI: https://doi.org/10.1145/3560815
Lou R., Zhang K., Yin W. (2023) Is prompt all you need? No. A comprehensive and broader view of instruction learning (arXiv preprint 2303.10475). DOI: https://doi.org/10.48550/arXiv.2303.10475
Mahmood A., Wang J., Yao B., Wang D., Huang C.M. (2023) LLM-Powered Conversational Voice Assistants: Interaction Patterns, Opportunities, Challenges, and Design Guidelines (arXiv preprint arXiv:2309.13879). DOI: https://doi.org/10.48550/arXiv.2309.13879
Meyer J.G., Urbanowicz R.J., Martin P.C., O'Connor K., Li R., Peng P.C., Gonzalez-Hernandez G., Bright T.J., Tatonetti N., Won K.J., Moore J.H. (2023) ChatGPT and large language models in academia: Opportunities and challenges. BioData Mining, 16(1), 20. DOI: https://doi.org/10.1186/s13040-023-00339-9
Seidenglanz R., Baier M. (2023) The Impact of Artificial Intelligence on the Professional Field of Public Relations/Communications Management: Recent developments and opportunities. In: Artificial Intelligence in Public Relations and Communications: Cases, Reflections, and Predictions (ed. A. Adi), Berlin: Quadriga University of Applied Sciences, pp. 14-25.
Solberg Søilen K. (2016) Economic and industrial espionage at the start of the 21st century - Status quaestionis. Journal of Intelligence Studies in Business, 6(3), 51-64.
Srivastava B., Lakkaraju K., Koppel T., Narayanan V., Kundu A., Joshi S. (2023) Evaluating Chatbots to Promote Users' Trust - Practices and Open Problems (arXiv preprint 2309.05680). DOI: https://doi.org/10.48550/arXiv.2309.05680
Tetlock P.E., Gardner D. (2016) Superforecasting: The art and science of prediction, New York: Random House.
Thoring K., Huettemann S., Mueller R.M. (2023) The Augmented Designer: A Research Agenda for Generative AI-enabled Design. Paper presented at the International Conference on Engineering Design (ICED23) 24-28 July 2023, Bordeaux, France. DOI: https://doi.org/10.1017/pds.2023.335
Wang J., Liu Z., Zhao L., Wu Z., Ma C., Yu S., Dai H., Yang Q., Liu Y., Zhang S., Shi E., Pan Y., Zhang T., Zhu D., Li X., Jiang X., Ge B., Yuan Y., Shen D., Liu T., Zhang S. (2023a) Review of large vision models and visual prompt engineering (arXiv preprint 2307.00855). DOI: https://doi.org/10.48550/arXiv.2307.00855
Wang S., Scells H., Koopman B., Zuccon G. (2023b) Can ChatGPT write a good boolean query for systematic review literature search? (arXiv preprint 2302.03495). DOI: https://doi.org/10.48550/arXiv.2302.03495
Watson E., Viana T., Zhang S. (2023) Augmented Behavioral Annotation Tools, with Application to Multimodal Datasets and Models: A Systematic Review. AI, 4(1), 128-171. DOI: https://doi.org/10.3390/ai4010007
Yeadon W., Hardy T. (2023) The Impact of AI in Physics Education: A Comprehensive Review from GCSE to University Levels (arXiv preprint 2309.05163). DOI: https://doi.org/10.1088/1361-6552/ad1fa2
Zhang C., Wang W., Pangaro P., Martelaro N., Byrne D. (2023) Generative Image AI Using Design Sketches as Input: Opportunities and Challenges. In: Proceedings of the 15th Conference on Creativity and Cognition, New York: Association for Computing Machinery, pp. 254-261. DOI: https://doi.org/10.1145/3591196.3596820
This work is licensed under a Creative Commons Attribution 4.0 International License.