Perhaps I'll just note that we're used to talking about computer code as something that we understand in terms of how that code functions. We don't generally treat each other that way. Increasingly, as the code gets more complex and harder for us to comprehend ourselves, it may become more important to focus on, in addition to how the code operates, the outcomes that are actually occurring. If the outcomes are going in the wrong direction, then hold the systems responsible for the output and not just for the nature of the decision-making itself.
On February 19th, 2019. See this statement in context.