I guess my question would be, are the tools currently available to analyze raid performance really inadequate? I would think that just through WWS and general observation it'd be pretty apparent who's doing their job and who isn't. Also barriers to change aren't nearly as large in WoW raiding as in your example, the NBA.
I'm sure it'd be nice to have more precise tools, but I don't think the additional information you'd glean would be nearly worth the amount of effort it would take to model something like this.
There *is* information missing though, I miss proper time slicing, modeling of specific traits over time (how did the raids dps look over the course of the fight, how did the different bloodlust groups do during bloodlust and so on) and of course, yes, I'd like to compare this data to previous data to see how people are progressing. I'd also like to know exactly how much that feral druids aura contributed to the group he was in. I'd also like to see what selected sets of people were doing when the tank hit 42 health but lived through it. When did the last heal from each of his designated healers land? And then I'd want the possibility to move to their timeline and see where their time was spent, maybe I'll find that a stupid warlock did something that made him scream out for healing and drew the healers attention.
Finding this information isn't hard given the proper tools. The tools aren't even *that* hard to write. They just require an interface that doesn't think of itself as a glorified damage meter.
Yes, I've been working on something down this path, but no, I don't really have anything to show people unless you wish to see perl stubs. I could use a few proper combat logs though, and, well, I'd also like to see chat logs for the same raids at some point.