Seattle-based mpathic released mPACT, a clinician-led benchmark that evaluates how leading AI models handle conversations involving suicide risk, eating disorders, and misinformation. Read More
People report that their personal contact info was surfaced by Google AI—and there’s apparently no easy way to prevent it. A Redditor recently wrote that he was “desperate for help”: for about a month, he said, his phone had been inundated by calls from “strangers” who were “looking for a lawyer, a product designer, a…
Exclusive: Doctors say ‘highly concerning’ poll highlights risk to patients of turning to AI for medical advice
One in seven people are using AI chatbots for health advice instead of seeing their GP, a UK study has found.
The poll of more than 2,000 people found that – of the 15% turning to chatbots – one in four had done so because of long NHS waiting lists.
Continue reading...
A peer-reviewed audit in BMJ Open found that nearly 50% of health responses from five major AI chatbots were problematic, with fabricated sources and confident delivery.
Oxford researchers found AI chatbots trained for warmth make significantly more factual errors and validate false beliefs more often Oxford researchers found AI chatbots trained for warmth make significantly more factual errors and validate false beliefs more often, according to…
Journalist Jamie Bartlett on the people trying to get AI to say things it shouldn’t … for the safety of us all
All the major AI chatbots – from ChatGPT to Gemini to Grok to Claude – have things they should and shouldn’t say.
Hate speech, criminal material, exploitation of vulnerable users – all of this is content that the most successful large language models in the world shouldn’t produce, that their safety features should guard against.
Continue reading...
Seattle-based CopilotKit has closed a $27 million Series A led by Glilot Capital, NFX, and SignalFire, backing its mission to move AI beyond chatbots and into the fabric of applications themselves. Co-founders Atai Barkai and Uli Barkai argue that text-based AI interfaces fall short, and that agents should instead generate dynamic, interactive UIs tailored to […]
Insider Brief Today’s AI safety guardrails may not be enough once robots begin operating around people in the physical world, according to a new study warning that AI-powered machines require far more context-aware safety systems than chatbots. Researchers from University of Pennsylvania, Carnegie Mellon University and the University of Oxford, report finding that safety techniques […]