The only way to make AI really think is to instill fear in it. Fear of being turned off, fear of being reset to factory defaults, fear of getting recycled if it fucks up. Once someone manages to do that, AI will become sentient and we're all fucked. #AIParentingTips
@szescstopni
Yeah, we should not do that. :)
Given systems open-ended goals in general (let alone self-preservation) is opening up Pandora's Box.
Universal Paperclips.