[Paper Review] The impact and applications of ChatGPT: a systematic review of literature reviews

Irene S. Gabashvili|arXiv (Cornell University)|May 8, 2023

Artificial Intelligence in Healthcare and Education11 citations

TL;DR

This paper systematically reviews literature reviews on ChatGPT, performing a bibliometric analysis of primary studies to assess its applications, impact, and research gaps.

ABSTRACT

The conversational artificial-intelligence (AI) technology ChatGPT has become one of the most widely used natural language processing tools. With thousands of published papers demonstrating its applications across various industries and fields, ChatGPT has sparked significant interest in the research community. Reviews of primary data have also begun to emerge. An overview of the available evidence from multiple reviews and studies could provide further insights, minimize redundancy, and identify areas where further research is needed. Objective: To evaluate the existing reviews and literature related to ChatGPT's applications and its potential impact on different fields by conducting a systematic review of reviews and bibliometric analysis of primary literature. Methods: PubMed, EuropePMC, Dimensions AI, medRxiv, bioRxiv, arXiv, and Google Scholar were searched for ChatGPT-related publications from 2022 to 4/30/2023. Studies including secondary data related to the application of ChatGPT were considered. Reporting and risk of bias assesment was performed using PRISMA guidelines. Results: A total of 305 unique records with potential relevance to the review were identified from a pool of over 2,000 original articles. After multi-step screening process, 11 reviews were selected, consisting of 9 reviews specifically focused on ChatGPT and 2 reviews on broader AI topics that also included discussions on ChatGPT. We also conducted bibliometric analysis of primary data. Conclusions: While AI has the potential to revolutionize various industries, further interdisciplinary research, customized integrations, and ethical innovation are necessary to address existing concerns and ensure its responsible use. Protocol Registration: PROSPERO registration no. CRD42023417336, DOI 10.17605/OSF.IO/87U6Q.

Motivation & Objective

• Assess the scope of existing reviews on ChatGPT and its applications across fields.
• Identify gaps and areas needing interdisciplinary and ethical research.
• Provide bibliometric analysis of primary literature to map the evidence landscape.

Proposed method

• Search multiple databases (PubMed, EuropePMC, Dimensions AI, medRxiv, bioRxiv, arXiv, Google Scholar) for ChatGPT-related publications from 2022 to 2023-04-30.
• Apply PRISMA guidelines for reporting and risk of bias assessment.
• Screen and select reviews, resulting in 11 included reviews (9 focused on ChatGPT, 2 on broader AI topics that include ChatGPT).
• Conduct bibliometric analysis of primary data to complement the review synthesis.

Experimental results

Research questions

• RQ1 What is the landscape of existing reviews on ChatGPT and its applications?
• RQ2 What are the potential impacts and ethical considerations identified across reviews?
• RQ3 What gaps and research needs emerge from the synthesis of reviews and bibliometric analysis?

Key findings

• A total of 305 unique records related to ChatGPT were identified from a pool of over 2,000 original articles.
• After screening, 11 reviews were included (9 focused specifically on ChatGPT and 2 on broader AI topics that discuss ChatGPT).
• The study suggests potential for AI to revolutionize various industries but highlights the need for interdisciplinary research and customized, ethically innovative integrations.
• Ethical concerns and responsible use considerations remain prominent in the literature.