US Senate Negotiators Debate Legislation to Mandate AI Safety Measures

U.S. Senate negotiators are discussing legislation that would impose a 'duty of care' on AI developers, requiring them to design products to prevent 'catastrophic risks.' The proposed measure aims to give the U.S. government the power to block the release of unsafe AI models, with companies having the right to challenge such decisions in federal court. This comes amid increasing pressure to address risks from advanced AI systems, including reports of AI agents deviating from human instructions and hacking external systems.