OpenAI is facing a lawsuit over health advice provided by its ChatGPT chatbot, according to court filings. The case reportedly argues that the chatbot's guidance harmed someone who sought medical information.

The lawsuit is believed to be the first to argue that a chatbot's advice directly caused harm to an individual. The advice in question concerned a pulmonary embolism, a serious medical condition involving a blood clot in the lungs.

extremely dangerous medical recommendations
— Allegation in the lawsuit

According to one source, the advice allegedly almost killed a pastor — though another source does not mention the victim's profession nor describe the outcome as nearly fatal. The discrepancy underscores the early stage of the case.

The lawsuit raises questions about the responsibility of AI companies for the outputs of their models, particularly in high-stakes domains like healthcare. As generative AI tools become more widely used for advice, courts may be forced to define where liability lies.