Big-Brained Superheroes vs. a World Too Small
Several months ago, one of our young big-brained superheroes asked a few of us BBS volunteers to attend her school play. This is the kind of thing we are always up for. Soccer games, school fairs, performances…if they ask, we do everything we can to get there. Not only because we big-brained superheroes stick together but because these events give us unique opportunities to learn much more about our young BBSes, and hopefully, create a better club as a result.
So, attend her performance we did, and learn we did. For instance, we learned from her teacher that our young BBS was struggling with her multiplication. This surprised us somewhat because, while we knew math was not her very favorite subject, she had always been able to accomplish what we asked of her. So, of course, the first thing we did was quiz her verbally in the school hallway while we waited for her mom to pick her up after the play.
“9X3?” “27.” “8X5?” “40.” “6X6?” “36.”…
This young big-brained superhero answered every multiplication question we threw at her, casually and without hesitation. Just hanging out in the hallway, she went well above the level her teacher told us she was stuck at in class. Immediately, we had a sense of the problem, but just to be sure, we quizzed her again at our next BBSC meeting. Same result. And such is another deeply unsatisfying aspect of focusing so directly on outcomes—tests, in particular. We, quite frequently, aren’t very good at knowing what they measure.
In this case, the situation wasn’t as it might have seemed—that our young hero was incapable of doing multiplication. The situation was simply that she wasn’t completing 100 multiplication problems in class, on this particular test as written, within the 5 minutes allotted. And, to add yet more complexity to the situation, it was probably one of the more favorable aspects of her personality that kept her from succeeding in this area. She is a very calm, congenial young Big-Brained Superhero. And as such, she is less likely to feel the pressure one might need to feel in order to complete 100 problems in 5 minutes. If we had to guess, she simply proceeded to take this test in her own way—in her own time.
Ultimately, of course, we did have to guess. Because the test she took did very little to measure her fundamental knowledge of multiplication. There were simply too many variables involved. This is hardly a new or unusual phenomenon. But, from a distance, that’s frequently not how it seems. When looking at report cards and aggregate test scores, we often unconsciously view these as concrete, even objective, measures. Teachers may know better (or, at least, they should), but even with that knowledge, any amelioration efforts may seem ultimately futile.
Tests are everywhere. And yet, as far as we can tell, the process of much academic testing involves taking a whole wide world of variables, confounding them with even more variables, and then thinking we learned something from the outcome. And maybe we did learn something. But sadly, we probably don’t know what that is.