Recently, Chalkbeat asked readers to pose questions about TNReady given the latest round of trouble for the state’s standardized test. One particular question asked about the validity of the scoring given that “scorers are hired off Craigslist.”
Here’s what the Tennessee Department of Education had to say:
“Questar does not use Craigslist. Several years ago, another assessment company supposedly posted advertisements on Craigslist, but Questar does not. We provide opportunities for our educators to be involved in developing our test, and we also encourage Tennessee teachers to apply to hand-score TNReady.
So, good news: scorers for the new vendor are not hired off of Craigslist. But, disturbing that the TDOE used the hedge “supposedly.” Back in 2015, I wrote about Measurement, Inc.’s ads on Craigslist:
Certainly, quality scorers for TNReady can be found for $10.70-$11.20 an hour via ads posted on Craigslist. I’m sure parents in the state are happy to know this may be the pool of scorers determining their child’s test score. And teachers, whose evaluations are based on growth estimates from these tests, are also sure to be encouraged by the validity of results obtained in this fashion.
My post even included a copy of the ad being used by Measurement, Inc. Then, in 2016, WSMV ran a story on scorers being hired via Craigslist ads.
Another response from the TDOE also caught my attention. This one dealt with the validity of comparisons between the old TCAP test and the new TNReady. The TDOE suggests this is like a group of runners changing from running 5Ks to running a 10K.
Runner and blogger TC Weber has a good response.
Then, when the issue of students not taking the tests seriously due to the perennial problems with returning data, the TDOE engages in more blame shifting:
“We believe that if districts and schools set the tone that performing your best on TNReady is important, then students will take the test seriously, regardless of whether TNReady factors into their grade. We should be able to expect our students will try and do their best at any academic exercise, whether or not it is graded. This is a value that is established through local communication from educators and leaders, and it will always be key to our test administration.
So, the fact that testing data has been returned late or that the quick score calculation method has changed has nothing to do with how students understand the test. If only those pesky school districts and their troublesome teachers would get on board and reinforce the right “values,” everything would be fine.
Here’s a hint, TDOE: Take some damn responsibility. TNReady has been a dumpster fire. Before that, you couldn’t get TCAP scores back in a reliable fashion. When districts told the TDOE that TNReady’s online administration wasn’t going to go well in 2016, the TDOE ignored them. Now, some students are wary of the test and whether or not it has any impact on their grades or any relevance to their learning. The TDOE simply responds by telling districts that if they just stopped asking so many questions and started drilling in the right messages, all would be well.
The disconnect is real.
As I noted in an earlier piece, accountability is a one way street when it comes to TDOE. This message is worth repeating:
How many warning signs will be ignored? How important is the test that it must be administered at all costs and the mistakes must be excused away because “accountability” demands it?
How can you hold students and teachers and schools accountable when no one is holding the Department of Education accountable? How long will legislators tolerate a testing regime that creates nightmares for our students and headaches for our teachers while yielding little in terms of educational value?
Apparently, according to Governor Haslam, everything is fine.
Still, the legislature meets again starting in January. And, there’s a Governor’s race on next year as well. Perhaps the combination of those events will lead to an environment that produces real answers.
For more on education politics and policy in Tennessee, follow @TNEdReport