Nov 15, 2016
When the algorithms are making the decisions, people often stop working to get better. The algorithms can make it hard to diagnose reasons for failures. As people become more dependent on algorithms, their judgment may erode, making them depend even more on the algorithms. That process sets up a vicious cycle. People get passive and less vigilant when algorithms make the decisions.
— Gray Klein (via Messy: When automated anti-disaster systems make things worse, and what to do about it / Boing Boing)