References for Health-ISAC Spring Americas Summit Presentation

Elements of Emerging Technology Hype

• The Digital Sublime: Myth, Power, and Cyberspace by Vincent Mosco

Past AI Boom/Bust Cycles

• Question: What is the AI Winter? Response by Borislav Agapiev

• AI Winter by Ben Lutkevich

What is ChatGPT?: Artificial Neural Networks

• You Look Like a Thing and I Love You: How Artificial Intelligence Works and Why It’s Making the World a Weirder Place by Janelle Shane

What is ChatGPT?: Deep Learning

• You Look Like a Thing and I Love You: How Artificial Intelligence Works and Why It’s Making the World a Weirder Place by Janelle Shane

What is ChatGPT?: Large Language Models

• GPT-4 System Card

• MLSecOps Podcast

• Whitepaper – Practical Attacks on Machine Learning Systems by Chris Ansley/NCC Group

• What Is ChatGPT Doing … and Why Does It Work? By Stephen Wolfram

• Twitter thread by Dan Hollick

Unpredictable Outputs

• GPT-4 System Card

• The Next Big Thing?: The Legal Implications of ChatGPT

• Membership Inference Attack Susceptibility of Clinical Language Models

• TROJANPUZZLE: Covertly Poisoning Code-Suggestion Models

Prompt Injection

• Ignore Previous Prompt: Attack Techniques For Language Models

• Bad Characters: Imperceptible NLP Attacks

• Compromising LLMs using Indirect Prompt Injection by Kai Greshake

• Prompt injection: What’s the worst that can happen? by Simon Willison

• Practical Attacks on Machine Learning Systems by Chris Anley

Assessing the impact of ChatGPT/LLMs on the Threat Landscape I

• OPWNAI : CYBERCRIMINALS STARTING TO USE CHATGPT by Checkpoint

Assessing the impact of ChatGPT/LLMs on the Threat Landscape II

• Study shows attackers can use ChatGPT to significantly enhance phishing and BEC scams by Lucian Constantin

• ChatGPT vs. human phishing and social engineering study: Who's better? by Pyry Åvist

What about Blue Teams and other internal uses? I

• Developers are turning to GitHub Copilot, a ChatGPT-like tool that helps them write code. One startup VP says it helped him save 10% of the time he'd spend coding by Thomas Maxwell

• Employees Are Feeding Sensitive Biz Data to ChatGPT, Raising Security Fears

What about Blue Teams and other internal uses? II

• GPT-4 System Card

A telling research finding…

• Do Users Write More Insecure Code with AI Assistants? by Neil Perry, Megha Srivastava, Deepak Kumar, Dan Boneh