Unveiling the Thematic Landscape of Generative Pre-trained Transformer (GPT) Through Bibliometric Analysis
DOI:
https://doi.org/10.56294/mr202333Abstract
Introduction: the Generative Pre-trained Transformer (GPT) is a deep learning language model architecture developed by OpenAI.
Aim: to describe the knowledge networks (both at the theoretical and country levels) of the Generative Pre-trained Transformer (GPT) as an emerging technology.
Results: 222 Documents were identified, of which 69 were articles, 50 were conference papers, 36 were editorials, 29 were notes, 19 were letters, 14 were reviews, 3 were conference reviews, and 2 were short surveys. In terms of the number of documents per year, 2 were found in 2019, 10 in 2020, 22 in 2021, 44 in 2022, and 144 in 2023. The year-on-year growth rate was over 100 % in all years. The subject area with the highest number of documents was Computer Science with 90 documents. The most productive countries in relation to GPT were the United States with 60 documents, followed by China with 19, the United Kingdom with 18, India with 15, and Australia with 12. Co-occurrence illustrated the centrality of Artificial Intelligence, Natural Language Processing, Deep Learning, and the term Human around ChatGPT and GPT.
Conclusions: this bibliometric study aimed to describe the knowledge networks of the Generative Pre-trained Transformer (GPT) as an emerging technology. Although only 222 documents were found, this study revealed a high level of international scientific collaboration in the field. The results suggest that GPT is a highly relevant technology with a wide range of potential applications in natural language processing, artificial intelligence, and deep learning.
Moreover, the study was able to qualitatively characterize the main thematic areas surrounding GPT, including its applications in chatbots, text generation, machine translation, sentiment analysis, and more.
References
1. OpenAI. GPT-4. OpenAI 2023. https://openai.com/product/gpt-4.
2. Castillo-Gonzalez W. ChatGPT and the future of scientific communication. Metaverse Basic Appl Res 2022;1:8. https://doi.org/10.56294/mr20228.
3. Castillo-González W. The importance of human supervision in the use of ChatGPT as a support tool in scientific writing. Metaverse Basic Appl Res 2023;2:29. https://doi.org/10.56294/mr202329.
4. Lund BD, Wang T. Chatting about ChatGPT: how may AI and GPT impact academia and libraries? Libr Hi Tech News 2023;ahead-of-print. https://doi.org/10.1108/LHTN-01-2023-0009.
5. McGee RW. Is Chat Gpt Biased Against Conservatives? An Empirical Study 2023. https://doi.org/10.2139/ssrn.4359405.
6. Biswas SS. Role of Chat GPT in Public Health. Ann Biomed Eng 2023. https://doi.org/10.1007/s10439-023-03172-7.
7. Cowen T, Tabarrok AT. How to Learn and Teach Economics with Large Language Models, Including GPT 2023. https://doi.org/10.2139/ssrn.4391863.
8. Biswas S. ChatGPT and the Future of Medical Writing. Radiology 2023:223312. https://doi.org/10.1148/radiol.223312.
9. Biswas SS. Potential Use of Chat GPT in Global Warming. Ann Biomed Eng 2023. https://doi.org/10.1007/s10439-023-03171-8.
10. Baclic O, Tunis M, Young K, Doan C, Swerdfeger H, Schonfeld J. Challenges and opportunities for public health made possible by advances in natural language processing. Can Commun Dis Rep 2020;46:161–8. https://doi.org/10.14745/ccdr.v46i06a02.
11. Reshamwala A, Mishra D, Pawar P. REVIEW ON NATURAL LANGUAGE PROCESSING. IRACST – Eng Sci Technol Int J ESTIJ 2013;3:113–6.
12. Wu L, Dodoo NA, Wen TJ, Ke L. Understanding Twitter conversations about artificial intelligence in advertising based on natural language processing. Int J Advert 2022;41:685–702. https://doi.org/10.1080/02650487.2021.1920218.
13. Juhn Y, Liu H. Artificial intelligence approaches using natural language processing to advance EHR-based clinical research. J Allergy Clin Immunol 2020;145:463–9. https://doi.org/10.1016/j.jaci.2019.12.897.
14. Cano CAG, Castillo VS, Gallego TAC. Mapping the Landscape of Netnographic Research: A Bibliometric Study of Social Interactions and Digital Culture. Data Metadata 2023;2:25. https://doi.org/10.56294/dm202325.
Published
Issue
Section
License
Copyright (c) 2023 Carlos Alberto Gómez Cano, Verenice Sánchez Castillo, Tulio Andrés Clavijo Gallego (Author)
This work is licensed under a Creative Commons Attribution 4.0 International License.
The article is distributed under the Creative Commons Attribution 4.0 License. Unless otherwise stated, associated published material is distributed under the same licence.
