And then what? We're left with two other credit bureaus that aren't much better? Another company takes its place that isn't any better, or maybe is even worse?
That itself has issues. If you're in a minority/ostracized group inequality is made worse by the fact you can't secure a loan for a house/car. Also people who are generally more outgoing/social (ie. more likely to be chummy with the local loan officer) get better loans, which is also unfair.