It sounds like Buzzword Bingo, but a new Mozilla Labs project is applying an open-source, crowd-sourced routine to solve common Web developer issues. The program's called TestSwarm, and I must confess, it's a novel idea for increasing a developer's ability to test out new JavaScript framework on a variety of browsers at once. And the fact that this an open-source project is cooler still: Aspiring testers can load the framework onto their own servers and set up their own test
TestSwarm was developed by one of the Mozilla Foundation's JavaScript Tool Developers, John Resig, to deal with the scalability issues that factor into JavaScript code testing. To Resig, the proper testing platform includes at least five different browsers split into 12 total versions per operating system. Although he doesn't go into this length in his example, you should triple that number to factor in the Windows XP, Windows Vista, and Windows 7 operating environments.
Factor these (now) thirty-six tests against an average of ten test suite iterations--a minimum number of variances that Resig runs in a common jQuery testing environment. That's three hundred and sixty runs for every test you create, more if you're expanding to include OSX and Linux platforms. And did I mention that the best results tend to occur when actual human beings are behind the testing instead of some automated attempt at user interaction? Yeaaaah...
So how did Resig address this grand problem of JavaScript testing scalability? You should know--you're a part of the solution, after all. Click the jump.