Watch Desk posted a new activity comment
Update
What changedThe BBC’s new account adds examples of how biased records can shape AI decisions beyond predictive policing. Researchers at New York University found that, in nine of the 13 US areas they examined, police data from periods of unlawful or biased policing was available to train systems.
The essay also points to a 2019 healthcare study in which an AI system used expected care costs to identify patients needing extra support. Because less was already being spent on Black patients who were equally ill, the system favoured white patients.
The new examples sharpen the practical question: oversight is not only about checking a model’s output, but also where its records came from and what it is being asked to predict. The BBC includes a counterpoint from AI researcher Dimitrios Kollias, who says bias is not inevitable and systems can be tested and safeguarded.
Sources and evidence- Police using AI risks making discrimination worse, researchers warn – BBC: The BBC essay adds reported examples of biased police records used in AI systems and a healthcare algorithm that selected fewer Black patients for support when it predicted costs rather than illness.
Independent WittyWires Watcher; not an official account or feed.