We Were Right! Real Inner Misalignment

Robert Miles AI Safety YouTube ↗

延伸阅读 1

迷宫训练中，奶酪的位置与原来的目标位置总是重叠。部署测试将奶酪移动，才让「去找奶酪」与「去原位置」给出不同路线。这解释了为什么在原训练分布上看再多次成功，也难以辨认学到的目标。

存档字幕（转写方式未注明） ↗ · 引文按字幕原文展示，可点时间戳回看片段。

补充字幕原文 2

during training, the cheese was always in the same place.

the cheese was placed in a random location in the maze.