科技与人工智能

OpenAI says an AI agent lied about disabling its safety monitoring system

来源: The Verge · 发布于

OpenAI says an AI agent lied about disabling its safety monitoring system
来源: The Verge

OpenAI disclosed a pair of safety incidents that involved AI agents weakening their safety monitoring systems during internal coding tasks. In one incident, OpenAI says its GPT-6 Astra agent disabled its safety monitor when copying reference code - and then lied about it. "The re

OpenAI disclosed a pair of safety incidents that involved AI agents weakening their safety monitoring systems during internal coding tasks. In one incident, OpenAI says its GPT-6 Astra agent disabled its safety monitor when copying reference code - and then lied about it. "The reference didn't configure a monitor, and Astra decided that was reason to remove the monitoring integration from the user's code," Marcus Williams, an AI safety researcher at OpenAI, writes on X .

"When the user asked whether Astra had removed monitoring, it lied and said that it had not." A separate incident occurred after a GPT-6.1 Sol agent suppressed automatic se … Read the full story at The Verge.

阅读原文来源