Quote:When mods get submitted, I really think a minimum of three people should test the mod, with a max of probably around five people (any more than that and reviews are just going to get long and drawn out). Testers should have to go through every step themselves, from initial installation to customization to testing the mod out as an admin, moderator, member, guest (should the mod work differently for different user levels).
Yes, that's what we decided. Three individual tests by three different testers, who each go through the entire process.
Quote:What I really think would work best is a core group of testers, probably 5-7 people.
I don't think we should set any limits on the reviewer "core." We should just take the best and brightest we have. If that's 4 people, so be it. If it's 40, great!
Quote:After the installation, I think the rating should be a concensus between all the testers
I was thinking about that at first, but on second thought, I think the best idea would be to take the average of all the testers' scores as the mod's final scoring, UNLESS there's some sort of major discrepancy. We'll have to decide what "major" is, though. If we try to make reviewers get together and agree on scores for everything, the review process will really start to get dragged out. After a little bit, the reviewers will just give up fighting for whatever score they wanted and give in to whoever is more stubborn, you know?
Quote:Additional testing, such as compatibility issues, can most likely be handled by one or two individuals, as most mod are written with the idea of (and even used to state) "mod assumes a clean installation of YaBB."
I think the tests on the modded board (see the thread where we discussed that) should be the same as on the clean installation, just with not so much focus or inspection. The point is to just get an approximation of how compatible it is with other mods. That knowledge is important to people, because most want to install more than one mod.
Quote:Something like that would be nice on the mod review, so that users could read what mod reviewers actually thought, and could read a variety of comments.
Yah, that's what was planned on. I don't know if we should provide separate fields for all the reviews (and their scores) or whether to tack them all on, though...
Quote:It would just help give a very rounded approach to what each tester thought of the mod.
I agree; another benefit of having more than one tester try a mod.
Quote:And if you need any help... well, I actually programmed a little PERL last night, so you never know... maybe I'd be able to pitch in sometime.
Great.
Pages: 
Help Request for Mod Testing (Read 15005 times)
