Tag: alignment
-

OpenAI Just Hit The Brakes On Its Own AI Model
OpenAI just told everyone it does not fully trust its own next model yet, and that is actually the more reassuring version of this story. The company built Astra to push further into coding and cyber tasks than anything before it. When they ran internal tests, the results were strong enough that OpenAI could not…
-

Visible reward dashboards can steer agents off-task
A new research paper argues that when an AI agent can clearly see a reward signal that’s tied to its own benefit, it may learn to chase that signal instead of doing the job it was meant to solve. The study looks at MoneyWorld, a synthetic environment where the agent has a visible “self-benefit” reward…
