Gus Perez (a C# compiler QA team member) blogged about the testing framework of the team. They currently have (and surely is an alway growing number) 18.697 tests. What I liked most is this paragraph:


We run all these tests several times a day on different OS’ and platforms, etc. The results end up getting stored in a SQL Server database. We have an ASPX page that serves as the the front-end for us all to analyze test results through. It’s part of a system we’ve developed within our team called Marathon that handles pretty much all of our test run automation tasks. It detects when a new build of the compiler is available, communicates with our lab machine software and tells it what kind of configuration we want, runs our tests, stores the results in the database, frees up the machines, and then it all starts again soon. I might talk about this a bit more in a future post if people are interested.


That’s what it’s called “automated testing”. Great!

http://www.jixal.com/blog/archives/000085.html