It's possible to have millions of tests and NOT have the problems described in that story. SQLite has a famously thorough test suite and I've seen the SQLite developers turn around a suggested improvement to their codebase - including authoring the fix, testing it and landing it, in just a few hours.