Manuscript Number : CSEIT2390533

Decoding the Threat Landscape : ChatGPT, FraudGPT, and WormGPT in Social Engineering Attacks

Authors(1) :-Polra Victor Falade

In the ever-evolving realm of cybersecurity, the rise of generative AI models like ChatGPT, FraudGPT, and WormGPT has introduced both innovative solutions and unprecedented challenges. This research delves into the multifaceted applications of generative AI in social engineering attacks, offering insights into the evolving threat landscape using blog mining technique. Generative AI models have revolutionized the field of cyberattacks, empowering malicious actors to craft convincing and personalized phishing lures, manipulate public opinion through deepfakes, and exploit human cognitive biases. These models, ChatGPT, FraudGPT, and WormGPT, have augmented existing threats and ushered in new dimensions of risk. From phishing campaigns that mimic trusted organizations to deepfake technology impersonating authoritative figures, we explore how generative AI amplifies the arsenal of cybercriminals. Furthermore, we shed light on the vulnerabilities that AI-driven social engineering exploits, including psychological manipulation, targeted phishing, and the crisis of authenticity. To counter these threats, we outline a range of strategies, including traditional security measures, AI-powered security solutions, and collaborative approaches in cybersecurity. We emphasize the importance of staying vigilant, fostering awareness, and strengthening regulations in the battle against AI-enhanced social engineering attacks. In an environment characterized by the rapid evolution of AI models and a lack of training data, defending against generative AI threats requires constant adaptation and the collective efforts of individuals, organizations, and governments. This research seeks to provide a comprehensive understanding of the dynamic interplay between generative AI and social engineering attacks, equipping stakeholders with the knowledge to navigate this intricate cybersecurity landscape.

Authors and Affiliations

Polra Victor Falade
Cyber Security Department, Nigerian Defence Academy, Afaka, Kaduna, Nigeria

Generative AI, ChatGPT, WormGPT, FraudGPT, social engineering, Blog mining

  1. M. A. Siddiqi and W. Pak, “applied sciences A Study on the Psychology of Social Engineering-Based Cyberattacks and Existing Countermeasures,” 2022.
  2. R. Kaur, “Artificial intelligence for cybersecurity : Literature review and future research directions,” vol. 97, no. January, 2023, doi: 10.1016/j.inffus.2023.101804.
  3. G. Lawton, “What is generative AI? Everything you need to know,” 2023. https://www.techtarget.com/searchenterpriseai/definition/generative-AI (accessed Sep. 29, 2023).
  4. Z. Wang, L. Sun, and H. Zhu, “Defining Social Engineering in Cybersecurity,” no. January 2021, 2020, doi: 10.1109/ACCESS.2020.2992807.
  5. A. A. Alsufyani, L. A. Alhathally, B. O. Al-amri, and S. M. Alzahrani, “Social Engineering , New Era Of Stealth And Fraud Common Attack Techniques And How To Prevent Against,” vol. 9, no. 10, 2020.
  6. B. Violino, “Phishing attacks are increasing and getting more sophisticated. Here’s how to avoid them,” 2023. https://www.cnbc.com/2023/01/07/phishing-attacks-are-increasing-and-getting-more-sophisticated.html (accessed Sep. 29, 2023).
  7. P. Mwiinga, “Investigating the Far-Reaching Consequences of Cybercrime A Case Study on the Impact in Lusaka,” no. July, 2023.
  8. A. Haleem, M. Javaid, and R. Pratap, “BenchCouncil Transactions on Benchmarks , Standards and Evaluations An era of ChatGPT as a significant futuristic support tool : A study on features , abilities , and challenges,” BenchCouncil Trans. Benchmarks, Stand. Eval., vol. 2, no. 4, p. 100089, 2023, doi: 10.1016/j.tbench.2023.100089.
  9. S. Sjouwerman, “How AI Is Changing Social Engineering Forever,” 2023. https://www.forbes.com/sites/forbestechcouncil/2023/05/26/how-ai-is-changing-social-engineering-forever/?sh=123037f5321b (accessed Sep. 26, 2023).
  10. W. He, X. Tian, and J. Shen, “Examining security risks of mobile banking applications through blog mining,” CEUR Workshop Proc., vol. 1353, pp. 103–108, 2015.
  11. A. Rudra, “Cybersecurity Risks of Generative AI,” 2023. https://securityboulevard.com/2023/07/cybersecurity-risks-of-generative-ai/ (accessed Sep. 26, 2023).
  12. D. Gupta, “The Road Ahead: Adapting to the Generative AI Cybersecurity Landscape,” 2023. https://securityboulevard.com/2023/08/the-road-ahead-adapting-to-the-generative-ai-cybersecurity-landscape/ (accessed Sep. 24, 2023).
  13. D. RILEY, “Cybercriminals are using custom ‘WormGPT’ for business email compromise attacks,” 2023. https://siliconangle.com/2023/07/13/slashnext-warns-cybercriminals-using-custom-wormgpt-business-email-compromise-attacks/ (accessed Sep. 26, 2023).
  14. S. Rushin, “The Dark Side of Generative AI: Unveiling the Cybersecurity Risk,” 2023. https://www.digit.fyi/comment-the-dark-side-of-generative-ai-unveiling-the-cybersecurity-risk/ (accessed Sep. 24, 2023).
  15. Darktrace, “Major Upgrade to Darktrace/EmailTM Product Defends Organizations Against Evolving Cyber Threat Landscape, Including Generative AI Business Email Compromises and Novel Social Engineering Attacks,” 2023. https://darktrace.com/news/darktrace-email-defends-organizations-against-evolving-cyber-threat-landscape (accessed Sep. 26, 2023).
  16. S. Ortiz, “What is ChatGPT and why does it matter? Here’s what you need to know,” 2023. https://www.zdnet.com/article/what-is-chatgpt-and-why-does-it-matter-heres-everything-you-need-to-know/ (accessed Sep. 29, 2023).
  17. M. Vizard, “SlashNext Report Shows How Cybercriminals Use Generative AI,” 2023. https://securityboulevard.com/2023/07/slashnext-report-shows-how-cybercriminals-use-generative-ai/ (accessed Sep. 26, 2023).
  18. E. K. Sing, “With generative AI, businesses need to rewrite the phishing rulebook,” 2023. https://identityweek.net/with-generative-ai-businesses-need-to-rewrite-the-phishing-rulebook/ (accessed Sep. 22, 2023).
  19. L. Columbus, “How FraudGPT presages the future of weaponized AI,” 2023. https://venturebeat.com/security/how-fraudgpt-presages-the-future-of-weaponized-ai/ (accessed Sep. 24, 2023).
  20. R. Bathgate, “Mandiant says generative AI will empower new breed of information operations, social engineering,” 2023. https://www.itpro.com/technology/artificial-intelligence/mandiant-says-generative-ai-will-empower-new-breed-of-information-operations-social-engineering (accessed Sep. 26, 2023).
  21. S. Das, “Back ‘Voice scams hit 47% web users,’” 2023. https://www.livemint.com/companies/start-ups/indias-internet-users-vulnerable-to-ai-powered-voice-scams-mcafee-reports-47-of-indian-users-encounter-or-know-victims-11683032655430.html (accessed Sep. 26, 2023).
  22. P. GJ, “Is Generative AI a New Threat to Cybersecurity?,” 2023. https://www.cxotoday.com/corner-office/is-generative-ai-a-new-threat-to-cybersecurity/ (accessed Sep. 26, 2023).
  23. C. Novak, “The Role Of AI In Social Engineering,” 2023. https://www.forbes.com/sites/forbestechcouncil/2023/07/05/the-role-of-ai-in-social-engineering/?sh=4f88cf0342a9 (accessed Sep. 23, 2023).
  24. U. J. van Rensburg, “Balancing the convenience of generative AI with the new fraud threats that come with it,” 2023. https://www.news24.com/news24/tech-and-trends/balancing-the-convenience-of-generative-ai-with-the-new-fraud-threats-that-come-with-it-20230911 (accessed Sep. 23, 2023).
  25. N. Raju, “Securing IT Infrastructure Against Generative AI Cybersecurity Threats,” 2023. https://www.cxotoday.com/cxo-bytes/securing-it-infrastructure-against-generative-ai-cybersecurity-threats/ (accessed Sep. 26, 2023).
  26. G. Lawton, “How to prevent deepfakes in the era of generative AI,” 2023. https://www.techtarget.com/searchsecurity/tip/How-to-prevent-deepfakes-in-the-era-of-generative-AI (accessed Sep. 26, 2023).
  27. F. Domizio, “3 Significant Cybersecurity Risks Presented by Generative AI,” 2023. https://accelerationeconomy.com/cybersecurity/3-significant-cybersecurity-risks-presented-by-generative-ai/ (accessed Sep. 23, 2023).
  28. C. Business, “How to protect your business from generative AI cybersecurity threats,” 2023. https://www.bizjournals.com/albuquerque/news/2023/07/17/protect-from-generative-ai-cybersecurity-threats.html (accessed Sep. 24, 2023).
  29. S. Paul, “Authentication in the time of Generative AI,” 2023. https://www.cxotoday.com/cxo-bytes/authentication-in-time-of-generative-ai-attacks/ (accessed Sep. 25, 2023).
  30. B. Strauss, “Listen to These Recordings: Deepfake Social Engineering Scams Are Scaring Victims,” 2023. https://securityboulevard.com/2023/05/listen-to-these-recordings-deepfake-social-engineering-scams-are-scaring-victims/
  31. A. Hasnain, “New Study Reveals Cybercriminals’ Growing Use of Generative AI to Amplify and Enhance Email Attacks,” 2023. https://www.digitalinformationworld.com/2023/06/new-study-reveals-cybercriminals.html (accessed Sep. 19, 2023).
  32. D. FLEET, “AI could hurt businesses. Here’s how to protect yours,” 2023. https://www.fastcompany.com/90926893/pov-ai-will-hurt-businesses-heres-how-to-protect-yours (accessed Sep. 24, 2023).
  33. Forbes, “17 Surprising (And Sometimes Alarming) Uses For And Results Of AI,” 2023. https://www.forbes.com/sites/forbestechcouncil/2023/08/03/17-surprising-and-sometimes-alarming-uses-for-and-results-of-ai/?sh=2eab1ca65df8 (accessed Sep. 26, 2023).
  34. M. Nkosi, “3 security risks of generative AI you should watch out for!,” 2023. https://www.itnewsafrica.com/2023/07/3-security-risks-of-generative-ai-you-should-watch-out-for/ (accessed Sep. 26, 2023).
  35. Y. LEIBLER, “The Rising Threat of Generative AI in Social Engineering Cyber Attacks — What You Need to Know,” 2023. https://www.entrepreneur.com/science-technology/how-cyber-criminals-are-weaponizing-generative-ai/455896 (accessed Sep. 18, 2023).
  36. M. Elgan, “Now social engineering attackers have AI. Do you?,” 2023. https://securityintelligence.com/articles/now-social-engineering-attackers-have-ai-b/ (accessed Sep. 22, 2023).
  37. VentureBeat, “The growing impact of generative AI on cybersecurity and identity theft,” 2023. https://venturebeat.com/security/the-growing-impact-of-generative-ai-on-cybersecurity-and-identity-theft/ (accessed Sep. 26, 2023).
  38. M. Elgan, “Synthetic media creates new social engineering threats,” 2023. https://securityintelligence.com/articles/synthetic-media-new-social-engineering-threats/ (accessed Sep. 26, 2023).
  39. “Bad actors are using generative AI to perfect social engineering schemes. Here’s what you need to know,” 2023. https://uk.pcmag.com/migrated-38485-security/145538/bad-actors-are-using-generative-ai-to-perfect-social-engineering-schemes-heres-what-you-need-to-know (accessed Sep. 25, 2023).
  40. T. Bradley, “Defending Against Generative AI Cyber Threats,” 2023. https://www.forbes.com/sites/tonybradley/2023/02/27/defending-against-generative-ai-cyber-threats/?sh=cd0be1f10884 (accessed Sep. 25, 2023).
  41. J. Zhang, “Is Rogue AI Destined to Become an Unstoppable Security Threat?,” 2023. https://solutionsreview.com/security-information-event-management/is-rogue-ai-destined-to-become-an-unstoppable-security-threat/ (accessed Sep. 23, 2023).
  42. C. Lehman, “Generative AI in Cybersecurity: The Battlefield, The Threat, & Now The Defense,” 2023. https://www.unite.ai/generative-ai-in-cybersecurity-the-battlefield-the-threat-now-the-defense/ (accessed Sep. 24, 2023).
  43. P. Harr, “Defending Against AI-Based Phishing Attacks,” 2023. https://www.forbes.com/sites/forbestechcouncil/2023/08/04/defending-against-ai-based-phishing-attacks/?sh=1d4d61b83da6 (accessed Sep. 24, 2023).
  44. S. Farnfield, “Avoiding cyber attacks in a world with generative AI,” 2023. https://www.dpaonthenet.net/article/200011/Avoiding-cyber-attacks-in-a-world-with-generative-AI.aspx (accessed Sep. 25, 2023).

Publication Details

Published in : Volume 9 | Issue 5 | September-October 2023
Date of Publication : 2023-10-30
License:  This work is licensed under a Creative Commons Attribution 4.0 International License.
Page(s) : 185-198
Manuscript Number : CSEIT2390533
Publisher : Technoscience Academy

ISSN : 2456-3307

Cite This Article :

Polra Victor Falade, "Decoding the Threat Landscape : ChatGPT, FraudGPT, and WormGPT in Social Engineering Attacks", International Journal of Scientific Research in Computer Science, Engineering and Information Technology (IJSRCSEIT), ISSN : 2456-3307, Volume 9, Issue 5, pp.185-198, September-October-2023. Available at doi : https://doi.org/10.32628/CSEIT2390533
Journal URL : https://res.ijsrcseit.com/CSEIT2390533 Citation Detection and Elimination     |      |          | BibTeX | RIS | CSV

Article Preview