[论文解读] ChatGPT in the Age of Generative AI and Large Language Models: A Concise Survey

Salman Mohamadi, Ghulam Mujtaba+3 more|arXiv (Cornell University)|Jul 9, 2023

Artificial Intelligence in Healthcare and Education被引用 19

一句话总结

本文对ChatGPT及其演进的当前研究方向进行了简明综述，考察玻璃箱与黑箱视角、基础文献、应用及跨领域的广泛影响。

ABSTRACT

ChatGPT is a large language model (LLM) created by OpenAI that has been carefully trained on a large amount of data. It has revolutionized the field of natural language processing (NLP) and has pushed the boundaries of LLM capabilities. ChatGPT has played a pivotal role in enabling widespread public interaction with generative artificial intelligence (GAI) on a large scale. It has also sparked research interest in developing similar technologies and investigating their applications and implications. In this paper, our primary goal is to provide a concise survey on the current lines of research on ChatGPT and its evolution. We considered both the glass box and black box views of ChatGPT, encompassing the components and foundational elements of the technology, as well as its applications, impacts, and implications. The glass box approach focuses on understanding the inner workings of the technology, and the black box approach embraces it as a complex system, and thus examines its inputs, outputs, and effects. This paves the way for a comprehensive exploration of the technology and provides a road map for further research and experimentation. We also lay out essential foundational literature on LLMs and GAI in general and their connection with ChatGPT. This overview sheds light on existing and missing research lines in the emerging field of LLMs, benefiting both public users and developers. Furthermore, the paper delves into the broad spectrum of applications and significant concerns in fields such as education, research, healthcare, finance, etc.

研究动机与目标

• 绘制围绕 ChatGPT 及其演进的当前研究格局。
• 比较玻璃箱（内部机制）和黑箱（输入/输出/影响）视角。
• 综合LLMs与生成式AI的基础文献及其与ChatGPT的联系。
• 识别教育、研究、医疗、金融等领域及其他领域的应用与关注点。
• 为LLMs与GAIs的未来研究与实验提出路线图。

提出的方法

• 进行基于文献的ChatGPT与GAI研究调查。
• 用玻璃箱与黑箱视角框定分析。
• 综合基础的LLM/GAI文献并与ChatGPT建立联系。
• 评审应用及社会/学科层面的影响。
• 勾画尚缺失的研究线索及未来工作的建议方向。

实验结果

研究问题

• RQ1 围绕ChatGPT及其演进的当前研究方向有哪些？
• RQ2 玻璃箱与黑箱视角如何对这项技术及其影响提供不同的阐释？
• RQ3 ChatGPT在各领域的关键应用与影响是什么？
• RQ4 现有文献存在哪些空白，未来研究应朝哪些方向发展？

主要发现

• 本综述识别了LLMs和ChatGPT领域现有的与缺失的研究线索。
• 它为该领域的进一步研究与实验提供了路线图。
• 论文讨论了在教育、研究、医疗、金融等领域的应用及重大关切。
• 它将基础的LLM/GAI文献与ChatGPT连接起来并概述了技术的发展演变。