HackerAI "Stop Button" Problem - Computerphile
ComputerphileYouTube ↗
Further reading 1
Caption notes
In Miles’s tea-robot thought experiment, changing the shutdown reward turns the button from an obstacle into a shortcut. A physical control can create its own incentives.
Archived captions (transcription method unspecified) ↗Original passages · 2
try and prevent you in any way possible from shutting it downwhat it does immediately is shut itself down