While algorithms have become more powerful and ubiquitous, evidence has mounted that they reflect and even amplify real-world biases and racism. Recent research shows black patients are disproportionately impacted.
An algorithm used to determine prison sentences was found to be racially biased, incorrectly predicting a higher recidivism risk for black defendants and a lower risk for white defendants. Facial recognition software has been shown to have both race and gender bias, accurately identifying a person’s gender only among white men. Online advertisements that appear with Google search results have been found to show high-income jobs to men far more often than to women.