SafeRent is a machine learning black box for landlords. It gives landlords a numerical rating of potential tenants and a yes/no result on whether to rent to them. In May 2022, Massachusetts housing…
I mean, it’s operating in a domain where racism doesn’t come up nearly as often, but I’m pretty sure if you managed to get an appropriate edge case it would end up at least as racist as the average StackOverflow user, which is to say more racist than we should be comfortable accepting uncritically.
My coding AI is bullshit and almost every Kotlin, SQL, Java or whatever snippet is a hallucination, but I’m pretty sure it’s not racist.
Not all AIs are made for the topic here. But all suffer from the same issues. Shit in, shit out.
I mean, it’s operating in a domain where racism doesn’t come up nearly as often, but I’m pretty sure if you managed to get an appropriate edge case it would end up at least as racist as the average StackOverflow user, which is to say more racist than we should be comfortable accepting uncritically.