"We believe that CoT monitoring may be one of few tools we will have to oversee superhuman models of the future."

"...We recommend against applying strong optimization pressure directly to the CoTs of frontier reasoning models, leaving CoTs unrestricted for monitoring."

https://openai.com/index/chain-of-thought-monitoring/




No comments:

Post a Comment

The most surprisingly reasonable lawsuit ever [part1]

When I set out to write this post, it was going to be called "The dumbest lawsuit ever". After some The Netflix challenge was a ...