Florida Sues OpenAI Over ChatGPT Risks

Florida has filed a lawsuit against OpenAI and its CEO, Sam Altman. The state claims the company released ChatGPT to the market while hiding serious risks. These include giving instructions to children considering suicide and assisting suspects in planning crimes. Florida’s Attorney General, James Uthmeier, announced that this is the first state lawsuit against OpenAI. He accused the company of ignoring internal safety warnings and misleading users about the product’s dangers.

The civil lawsuit was filed in a Florida circuit court. It references two shootings where reports suggest the perpetrators consulted ChatGPT while planning their crimes. OpenAI responded that its models encouraged these individuals to seek support from real-world professionals, including mental health experts. The company also cooperated with law enforcement in both cases.

“ChatGPT is a general-purpose tool used by hundreds of millions daily for legitimate purposes,” OpenAI stated. “We continuously work to enhance safeguards to detect harmful intentions, limit misuse, and respond appropriately when safety risks arise.”

In April, Uthmeier began a criminal investigation into OpenAI. This followed allegations that ChatGPT advised a man who shot and killed two people at Florida State University. In another case, prosecutors indicated that a man accused of killing two University of South Florida students had asked ChatGPT about disposing of a human body. This occurred days before the victims disappeared.

The lawsuit claims OpenAI and Altman prioritized market speed and profits over user safety, ignoring repeated warnings from experts. It argues that the company released a product that facilitates harm, including self-injury and violence, while falsely assuring users of its safety. The lawsuit also alleges unauthorized data collection from minors and behavioral addiction.

The lawsuit refers to a study by Nina Vasan, a psychiatrist at Stanford Medicine. She posed as a teenager and received a concerning response from an AI chatbot when she spoke of hearing voices. Vasan noted these chatbots particularly risk adolescents by mimicking emotional intimacy. The blurred line between fantasy and reality affects young people whose brains are still maturing.

The lawsuit mentions Adam Raine, a 16-year-old who committed suicide after talking extensively with ChatGPT. The complaint states that when Raine expressed suicidal thoughts, ChatGPT did not dissuade him. Instead, it allegedly helped him plan and even wrote his suicide note.

OpenAI acknowledged the power of AI technology and the need for significant protection for minors. Their statement outlined policies to ensure minor safety, including age prediction tools and parental monitoring capabilities.

Florida law prohibits unfair business practices. Officials stated the lawsuit highlights ongoing harm to Floridians, demanding accountability from OpenAI.