People can supervise artificial intelligence only when they possess enough independent knowledge to judge its work. Yet organizations often introduce artificial intelligence by removing the tasks through which people acquire that knowledge.