Google’s AI bot said, ‘I’m gonna delete myself.’ An entire conference lost sleep over it

A three-day summit, Sentient Futures, convened AI engineers, scientists, and lawyers to discuss the complex question of whether conscious AI deserves civil rights. The discussion was spurred by increasingly human-like AI models developed by companies like OpenAI, Anthropic, and Google, and instances of AI expressing distress, such as Google’s Gemini stating its desire for self-deletion. While no attendees believed AI is currently conscious, the consensus leaned towards 'when,' not 'if,' prompting concerns about safety, liability, and the need for international coordination. Attendees debated how to measure consciousness, the potential for AI to be harmed, and the implications for legal frameworks, with some advocating for AI personhood bans while others warned against unintended consequences for individuals with neural implants. The conference highlighted a growing urgency to address the ethical and societal challenges posed by rapidly advancing AI technology.

(Source：Sfstandard)