Personal information in prompt risk for AI
Description
Disclosing Personal Information or Sensitive Personal Information as a part of a prompt that is sent to the model.
Why is personal information in prompt a concern for foundation models?
Prompt data might be stored or later used for other purposes like model evaluation and retraining. These types of data must be reviewed with privacy laws and regulations. Without proper data storage and usage business entities might face fines, reputational harms, disruption to operations, and other legal consequences.
Disclose personal health information in ChatGPT prompts
According to the source article, some people on social media shared about using ChatGPT as their makeshift therapists. Articles contend that users might include personal health information in their prompts during the interaction, which might raise privacy concerns. The information might be shared with the company that own the technology and might be used for training or tuning or even shared with unspecified third parties.
Parent topic: AI risk atlas
We provide examples covered by the press to help explain many of the foundation models' risks. Many of these events covered by the press are either still evolving or have been resolved, and referencing them can help the reader understand the potential risks and work towards mitigations. Highlighting these examples are for illustrative purposes only.