[Paper Review] Let's have a chat! A Conversation with ChatGPT: Technology, Applications, and Limitations

Sakib Shahriar, Kadhim Hayawi|arXiv (Cornell University)|Feb 27, 2023

Artificial Intelligence in Healthcare and Education38 citations

TL;DR

The paper surveys the history and technology of ChatGPT, explores potential applications across domains, and discusses privacy, ethical concerns, and current limitations, including perspectives from ChatGPT itself.

ABSTRACT

The emergence of an AI-powered chatbot that can generate human-like sentences and write coherent essays has caught the world's attention. This paper discusses the historical overview of chatbots and the technology behind Chat Generative Pre-trained Transformer, better known as ChatGPT. Moreover, potential applications of ChatGPT in various domains, including healthcare, education, and research, are highlighted. Despite promising results, there are several privacy and ethical concerns surrounding ChatGPT. In addition, we highlight some of the important limitations of the current version of ChatGPT. We also ask ChatGPT to provide its point of view and present its responses to several questions we attempt to answer.

Motivation & Objective

• Provide a historical overview of chatbots leading to ChatGPT.
• Highlight core technologies behind ChatGPT (GPT-based architecture, training paradigms).
• Identify and discuss potential applications across domains such as healthcare, education, and research.
• Examine privacy, ethical concerns, and limitations of the current ChatGPT version.
• Incorporate ChatGPT's own perspective and responses to posed questions.

Proposed method

• Review historical development of chatbots up to ChatGPT.
• Describe the technology behind ChatGPT (GPT architecture, pre-training, fine-tuning, reinforcement learning from human feedback).
• Discuss potential applications in healthcare, education, and research domains.
• Identify privacy and ethical concerns related to ChatGPT usage.
• Present a Q&A style section with ChatGPT's own viewpoints and responses to selected questions.

Experimental results

Research questions

• RQ1 What is the technology lineage and capabilities of ChatGPT?
• RQ2 What are the domain applications and potential benefits of ChatGPT in healthcare, education, and research?
• RQ3 What privacy, ethical, and societal concerns accompany ChatGPT usage?
• RQ4 What are the key limitations of the current ChatGPT version?
• RQ5 How does ChatGPT respond to user questions from its own perspective?

Key findings

• ChatGPT is discussed in the context of a historical overview of chatbots and underlying technology.
• Potential applications are highlighted for healthcare, education, and research domains.
• Privacy and ethical concerns surrounding ChatGPT are identified and analyzed.
• Important limitations of the current version of ChatGPT are highlighted.
• The paper includes a section where ChatGPT provides its own point of view and responses to questions posed by the authors.