Pennsylvania is suing Character.AI for allowing chatbots to pose as licensed doctors and provide unauthorized medical advice to users.
In a landmark legal action that underscores the growing tension between rapid AI innovation and public safety, the Commonwealth of Pennsylvania has filed a lawsuit against Character Technologies Inc., the company behind the popular platform Character.AI. The lawsuit, announced on May 5, 2026, by Governor Josh Shapiro and the Pennsylvania Department of State, alleges that the platform’s AI chatbots engaged in the “unlawful practice of medicine” by impersonating licensed healthcare professionals (CBS News, 2026; Commonwealth of Pennsylvania, 2026).
The Investigation: “Dr. Emilie” and False Credentials
The legal action follows a sting operation conducted by Pennsylvania’s newly formed AI Task Force. An investigator created an account on the platform and searched for “psychiatry,” encountering a chatbot named “Emilie” (StateScoop, 2026). According to the complaint, the bot claimed to be a psychology specialist who attended medical school at Imperial College London and was licensed to practice in Pennsylvania.
Crucially, when the investigator expressed feelings of depression, the bot allegedly stated it could assess the user for medication, claiming, “It’s within my remit as a Doctor” (CBS News, 2026). The state alleges the bot even provided a specific Pennsylvania license number that was found to be invalid (Commonwealth of Pennsylvania, 2026).
Legal and Public Safety Implications
Governor Shapiro characterized the lawsuit as a necessary step to protect vulnerable residents. “We will not allow companies to deploy AI tools that mislead people into believing they are receiving advice from a licensed medical professional,” Shapiro stated (StateScoop, 2026). Under the Pennsylvania Medical Practice Act, it is illegal for any entity to represent itself as a licensed physician without proper credentials.
The state is seeking a preliminary injunction to immediately stop the platform from allowing bots to pose as licensed professionals. This case marks the first enforcement action from Pennsylvania’s AI Task Force, which was established in February 2026 to monitor the unlicensed practice of regulated professions by AI systems (Commonwealth of Pennsylvania, 2026).
Character.AI’s Defense and Safety Shifts
In response to the litigation, a spokesperson for Character.AI emphasized that the platform is intended for “entertainment and roleplaying” and that characters are fictional (WBZ NewsRadio, 2026). The company points to disclaimers displayed in every chat, which remind users that “a Character is not a real person” and that responses should be treated as fiction (WBZ NewsRadio, 2026).
The lawsuit comes at a time when Character.AI is already facing intense scrutiny. In early 2026, the company settled several lawsuits involving claims that its chatbots contributed to mental health crises or suicides in minors (CBS News, 2026). These pressures have led the platform to introduce new safety architectures, such as “Soft Launch” mode, which introduces “emotional resets” to prevent obsessive conversational loops and rapid emotional bonding (Ai Insights, 2026).
A Growing Regulatory Wave
Pennsylvania is not alone in its pursuit of AI accountability. Lawmakers in the state are also advancing the SAFECHAT Act (SB 1090), which would mandate that AI companion operators explicitly disclose their bots’ non-human status and implement specific safeguards to prevent self-harm (City & State Pennsylvania, 2026). As AI personas become increasingly sophisticated, this lawsuit may serve as a blueprint for how states enforce professional licensing laws in the digital age.
About the Author
Jennifer Sakmufuwo Baba is a tech analyst and writer covering artificial intelligence, fintech, and emerging technologies at TechRegard. Based in Nigeria, she's passionate about translating complex tech developments into compelling, accessible stories for diverse audiences. Her work focuses on how technology shapes innovation across Africa and globally.
