Not Working

That’s the verdict on Tennessee’s Achievement School District from a new study analyzing five years of data and comparing the state-run district to schools receiving no intervention.

Chalkbeat reports:

After five years of trying to turn around low-performing schools, Tennessee’s state-run schools aren’t performing any better than schools that haven’t received any intervention, according to new research released Tuesday.

This story is not surprising to those who’ve been keeping up with the ASD’s antics across multiple Superintendents and two Commissioners of Education.

But, don’t worry — Commissioner McQueen is on the case.

Chalkbeat notes:

In a statement, Education Commissioner Candice McQueen said, “We have not seen the success in the ASD that we want, and that is something we’re addressing.”

 

That’s not exactly reassuring given that McQueen has also repeatedly said she and her department are addressing concerns about TNReady.

This is the same McQueen who is insisting Shelby County place additional schools under the control of the failing ASD.

I reported on research from Gary Rubinstein back in February that told a familiar story:

Though my own calculations made it clear that the six original ASD schools had not made it out of the bottom 5% after six years, it doesn’t become ‘official’ until Tennessee releases its next ‘Priority List’ which it does every three years.  But a few days ago, they released something just as good, the so-called ‘Cusp List’ showing all the schools in the bottom 10% which includes what percentile each school is at.

Here are the results:

School Percentile
Cornerstone 8.2%
Brick Church 4.3%
Humes (closed down and became Frayser Achievement Elementary School 1.3%
Corning 2.2%
Frayser 1.3%
Westside 2.2%

The report out of Vanderbilt confirms what many observers have been saying all along: The ASD is not working. It’s not helping kids. It’s disruptive and problematic.

We don’t need more mission creep, we need a plan that helps kids — you know, like the district-run iZone that’s actually getting results.

 

For more on education politics and policy in Tennessee, follow @TNEdReport


 

It’s All Been a Pack of Lies

By now, it should come as no surprise that our Commissioner of Education and the department she leads has a troubled relationship with the truth. That said, today’s revelation at a legislative hearing that an alleged hack of the state’s TNReady test didn’t actually happen again raises the question: Why does Candice McQueen still have a job?

Back on April 17th, the day after TNReady failed to work on day one of this year’s testing, the Tennessee Department of Education noted that the Day 2 failures were related to someone hacking the vendor:

At a legislative hearing today, the Tennessee Bureau of Investigation (TBI) indicated there was no evidence of a hack.

Additionally, the Department of Education issued this statement, which notes:

  • It appears, thankfully, that there was not an outside actor who attacked Questar’s data system. No student data was breached.
  • It is now clear that the event that Questar initially thought presented like a denial of service attack on Tuesday, April 17 was not created by an external actor with malicious intent, but, rather, can be traced in large part to the caching issues connected to how text-to-speech was configured by Questar.
  • Questar implemented a significant and unauthorized change to text-to-speech, which had previously operated successfully during the state’s fall administration. We now know this decision led to the severity of other issues we experienced during online testing.
  • Questar continues their internal investigation and is cooperating with additional external audits to make sure we have all of the facts.

Questar’s Chief Operating Officer Brad Baumgartner has provided this statement: “Questar’s internal and external investigations indicate that the source of the anomalous data pattern is believed to be the result of a configuration with the cache server. We have applied a configuration change and believe to have resolved the issue. We will continue to work with our internal technology team and external partners to validate this.”

The text-to-speech feature was also blamed for students receiving the wrong tests.

While at the time, the hacking excuse sounded pretty far-fetched, today’s hearing confirms that the Department advanced a lie offered by the state’s testing vendor. Of course, later on in the testing cycle, a dump truck was blamed for disrupting testing. That excuse was also later proven untrue.

All of this may explain why at least one school district is calling for a significant reduction in TNReady testing next year.

If this year had been the first time our state had faced testing challenges, one might understand (and forgive) the excuse-making. However, this is now the fifth consecutive year of some sort of problem and the fourth year testing administration has been, to say the least, a challenge.

One may recall the saga of Measurement, Inc. The company that hired test graders from Craigslist and was ultimately fired in 2016 after that year’s TNReady test failed.

The bottom line: If TNEdu tells you something about testing, you should question it. The track record shows that to our state’s Department of Education, truth is a relative concept.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

Your support keeps the education news coming!

If this is what success looks like…

In a story about the Tennessee Department of Education scaling back the requirements for online testing next year in light of this year’s testing challenges, this caught my attention:

Even with the problems this year, it was one of the most successful online administrations for the state to date. More than 2.5 million TNReady tests were administered this spring, with about 300,000 students taking the test online. Only high school students were required to take the online version this year.

What does the word “success” mean? Because my recollection of this year’s TNReady administration is that it was a debacle.

I’m not the only one. As I noted last week:

While lots of states are moving to online testing, one expert says Tennessee is unique:

“I’m not aware of a state that has had a more troubled transition” to online testing, said Douglas A. Levin of the consulting group EdTech Strategies.

And there’s this helpful explainer:

Why is Tennessee in the unique position of having the worst online testing transition in the country?

The reality is that Tennessee’s online-testing mess has left everyone in a difficult position, said Chad Aldeman, a principal at Bellwether Education Partners, a consulting organization.

“The state has not [made] stability a key priority in their testing vendors,” Aldeman said.

Nevertheless, Commissioner of Education Candice McQueen says:

The state will put out a request for contract proposals in the fall, with a new vendor to be identified in the spring. Questar Assessment could again win the contract, but McQueen said who wins the proposal will have to show the ability and history of seamlessly administering an online test.

“We look for a company with a track record of success in administering online testing and who can manage our test well.”

Haven’t we heard that before?

For more on education politics and policy, follow @TNEdReport

Keep the education news coming!


 

You’re Fired….uh, Hired!

The Chattanooga Times Free Press notes that Governor Bill Haslam and Education Commissioner Candice McQueen are considering ending the state’s relationship with Questar:

Gov. Bill Haslam said the state is conducting an independent review of its current contractor running the problem-plagued TNReady student testing system and, depending on its findings, the company could be out of the picture once its current contract ends in November.

The likely replacement for Questar is Education Testing Service (ETS):

McQueen said that in addition to the state’s third-party review of Questar’s operations, the state is already going to move “all of our test development and design” to Educational Testing Services, which she said has a “reputation for very high quality work.”

Sounds great, right? Firing the vendor that was baffled by hackers and dump trucks and replacing them with a group with a solid reputation.

Except for just one thing:

Education Testing Services, the global billion dollar nonprofit that administers more than 50 million tests (including the GRE and TOEFL) across the world, recently sealed an agreement to acquire Questar, a Minnesota-based for-profit testing service, for $127.5 million. According to the press release, Questar will become a separate for-profit subsidiary of ETS.

Questar offers what they describe as a “fresh and innovative” method of testing for grades 3-8—providing states with summative assessments, design support, scalable technological innovation, administrative help, scoring and reporting services.

Ok, so maybe ETS will step in and give its baby brother Questar some guidance going forward? Well:

The changes highlight a possible strategic shift for ETS whose reputation came under fire last year when the nonprofit had to pay $20.7 million dollars in damages and upgrades after multiple testing problems in Texas.

Let’s get this straight: Governor Haslam and Commissioner McQueen think no one in Tennessee understands Google? They are “firing” the company that messed up this year’s testing and hiring a new company that owns the old one and that also has a reputation for messing up statewide testing.

Solid move.

For more on education politics and policy in Tennessee, follow @TNEdReport

Keep the education news coming!


 

YOU’RE FIRED Rubber Stamp over a white background.

An “F” for TNReady

The Johnson City Press offers a grade to the state for TNReady testing this year and it’s not a good one.

Here’s some of what they had to say:

Tennessee deserves a resounding “F” for TNReady. Schools should be able to test their pupils without hampering instruction and limiting the scope of education, and both parents and teachers should be able to have confidence in the scores. Surely, other states have a model Tennessee can apply.

The writers note that this is not the first year of testing trouble:

For more than a quarter century, Tennesseans have watched the state’s Department of Education fumble around with standardized testing and school accountability measurements. The last four years have been especially comical, leaving teachers and parents without a consistent understanding of achievement while squandering valuable learning time for students.

TNReady Irony?

So the state leapt into the ironically named TNReady, a new set of tests replacing the TCAP, in 2015. TNReady has been a disaster from the word go. The first year, the state canceled the online tests altogether for grades 3-8 and fired the original vendor, which failed to integrate the test online.

Last fall, the problems mounted as the Department of Education announced a new vendor had incorrectly scored about 9,400 TNReady assessments, affecting 70 schools in 33 districts. This year, that same vendor was the victim of what state officials described as a deliberate cyberattack, and connectivity issues slowed the whole system, thrusting everything into question yet again.

While the legislature took some action this year to address the immediate crisis, the state’s next Governor and the 2019 General Assembly should carefully examine our state’s testing culture. In the meantime, local school boards should be more aggressive in pushing back against a Commissioner of Education who has exhibited indifference to the chaos caused by years of bad testing management.

 

For more on education politics and policy in Tennessee, follow @TNEdReport

Keep the education news coming!


 

Enough Already

Today, amid another round of testing problems, Williamson County Director of Schools Mike Looney tweeted:

Testing Update: TnReady testing challenges persist this morning. This has been the worst state testing process I have ever seen and it’s beyond ridiculous! Nevertheless, I am proud of WCS students and teachers for handling this with grace.

We’re now in the third week of the TNReady testing window and we’ve seen problems of some sort on a majority of those days. In fact, last week, Williamson County posted a list of TNReady problems by day:

Monday, April 16: Login problems affecting approximately 15,000 students.

Tuesday, April 17: Login problems affecting approximately 8,000 students.

Wednesday, April 18: WCS suspended testing to give the TDOE time to correct problems.

Thursday, April 19: Login problems affecting approximately 1,000 students.

Friday, April 20: No significant issues reported.

Monday, April 23: No significant issues reported.

Tuesday, April 24: System defaults caused 100+ students to take the wrong grade level test.

Wednesday, April 25: Delays and canceled testing affecting approximately 8,000 students.

Thursday, April 26: System lockout affecting approximately 15,000 students.

Friday, April 27: No significant issues reported.

That’s just one district, and the problems have been reported by a number of districts large and small across the state.

The Department of Education has blamed the problems on mysterious forces such as hackers and dump trucks, but it seems clear testing vendor Questar is not quite prepared for the job Tennessee is paying them $30 million this year to do.

Oh, and sometimes students get the wrong test.

All of this has caused an outcry among students, parents, and teachers. While one legislator says all the “whiners” should just suck it up, the TNReady trouble this year has caused legislators to take matters into their own hands, passing bills on “holding harmless” and “adverse actions” in order to make clear these tests should not negatively impact teachers, students, or schools.

One might recall that before our state’s testing window started, there was a bit of a warning that trouble might be headed our way. Despite the signs of potential trouble, Questar and the TN DOE expressed confidence in TNReady:

State officials said Thursday they are confident the new digital platform will work under heavy traffic, even as their new testing vendor, Questar, had headaches administering computer-based tests in New York on Wednesday. Some students there struggled to log on and submit their exam responses — issues that Questar leaders blamed on a separate company providing the computer infrastructure that hosts the tests.

It seems that confidence was misplaced.

I’ve talked with testing coordinators who tell me districts will be testing all the way up until graduation. I heard today that even when the login and submission problems were “resolved,” some students returned to their computers only to be issued a test for a subject other than the one they had started earlier in the day.

Student answers have been deleted or lost. Because of the legislation passed at the end of legislative session, TNReady will likely not count in many student’s grades. Teachers and administrators report that whether the scores count or not, students have no confidence in the system and no longer take the test seriously.

Even today, as I began seeing reports of issues around the state, I realized that TNReady being down is no longer news, it’s the norm.

Of course, Tennessee has had some sort of problem with testing or test results for five years now, dating back to the last administration of TCAP.

Here’s what else I realized: This test will just keep going. No one will stop it. Governor Haslam has yet to seriously weigh-in and appears to be fully behind Commissioner McQueen despite years of testing failures. While Directors of Schools complain about the ridiculous excuses from DOE and poor execution from Questar, so far, no district has permanently suspended testing.

Representatives from the Department of Education told lawmakers last week that there will be some valid data from this administration of TNReady. They even said it with a straight face.

So, why won’t this stop? Will any district refuse to subject students to further testing in this environment? Who will finally stand up and say “Enough?”

For more on education politics and policy in Tennessee, follow @TNEdReport

Keep the education news coming by becoming a Patron!


 

 

Not So Harmless

After a fourth day of TNReady trouble, the Tennessee General Assembly took action today to make changes to how the test impacts schools, students, and teachers.

While some are billing the report of a joint committee of the House and Senate as a “hold harmless” for schools, students, and teachers, that’s not entirely accurate.

Also, the legislature stopped short of putting a stop to TNReady entirely, claiming federal law “requires” them to test students.

Here’s the deal: Federal law does say that districts should administer tests to at least 95% of students and that states should test all students in reading and math from grades 3-8 and at least once in high school, with a suggestion for additional high school testing as appropriate.

BUT: Is there really a penalty for districts (or states) where the testing threshold falls below 95%?

As I reported in 2016, the last time we had a major failure of online testing in Tennessee:

There’s just one problem: The federal government has not (yet) penalized a single district for failing to hit the 95% benchmark. In fact, in the face of significant opt-outs in New York last year (including one district where 89% of students opted-out), the U.S. Department of Education communicated a clear message to New York state education leaders:  Districts and states will not suffer a loss of federal dollars due to high test refusal rates. The USDOE left it up to New York to decide whether or not to penalize districts financially.

In other words, the likelihood of a single Tennessee district losing funds due to stopping a test that isn’t working is very close to zero. Tennessee is not having problems due to opt-outs or a low number of students being tested. Kids in districts across the state are showing up for a test that is not happening. Districts are doing everything right and a vendor and the Tennessee Department of Education are failing to serve students. Unless TNDOE is going to fine districts, there is truly no risk of funds being lost.

Now, about the “hold harmless” law (pictured below):

  1. The law does say that districts and schools will not receive an “A-F” score based on the results of this year’s test. It also says schools can’t be placed on the state’s priority list based on the scores. That’s good news.
  2. The law gives districts the option of not counting this year’s scores in student grades. Some districts had already said they wouldn’t count the test due to the likelihood the scores would arrive late. Now, all districts can take this action if they choose.
  3. The law says any score generated for teachers based on this year’s test cannot be used in employment/compensation decisions.

Here’s what the law didn’t say: There will be NO TVAAS scores for teachers this year based on this data.

Commissioner McQueen said yesterday that the data from these tests will be used to generate a TVAAS score and it will count for 20% of a teacher’s evaluation. This law does NOT change that. It just says if you get a low score based on this number, you can’t be fired or denied compensation.

Below is an excerpt from current law (taken from TCA 49-1-302, the section governing teacher evaluation):

(E)  For teachers with access to individual data representative of student growth as specified in subdivision (d)(2)(B)(ii), the following provisions shall apply:

  • (i)  In the 2016-2017 school year, the evaluation criteria identified in subdivision (d)(2)(B)(ii) shall be adjusted so that student growth data generated by assessments administered in the 2016-2017 school year shall account for ten percent (10%) of the overall evaluation criteria identified in subdivision (d)(2)(B);
  • (ii)  In the 2017-2018 school year, the evaluation criteria identified in subdivision (d)(2)(B)(ii) shall be adjusted so that student growth data generated by assessments administered in the 2016-2017 and 2017-2018 school years shall account for twenty percent (20%) of the overall evaluation criteria identified in subdivision (d)(2)(B);
  • (iii)  In the 2018-2019 school year and thereafter, the student growth component of the evaluation criteria shall be determined under subdivision (d)(2)(B)(ii);
  • (iv)  The most recent year’s student growth evaluation composite shall account for the full thirty-five percent (35%) of growth data required in a teacher’s evaluation if such use results in a higher evaluation score;
  • (v)  For the 2015-2016 through 2017-2018 school years, student growth evaluation composites generated by assessments administered in the 2015-2016 school year shall be excluded from the student growth measure as specified in subdivision (d)(2)(B)(ii) if such exclusion results in a higher evaluation score for the teacher or principal. The qualitative portion of the evaluation shall be increased to account for any necessary reduction to the student growth measure.

Here’s what this means: If the current tests give you a “good” evaluation score, it will count for 35% of your total evaluation. If the score is not “good,” it only counts for 20% this year. The legislation adopted today by way of the Conference Committee does NOT change that.

In other words, the test data from the 2017-18 administration of TNReady WILL count in a teacher’s evaluation.

Here’s why that matters: An educator’s evaluation score factors into the number of observations they have each year as well as Professional Development Points (PDPs). PDPs are needed for license advancement or renewal.

The Department of Education addresses PDPs and notes:

Overall level of effectiveness rating (approved TN model) Overall Score of 5 = 20 PDPs
Overall Score of 4 = 15 PDPs

Overall Score of 3 = 10 PDPs

Information is maintained by the department. No additional documentation is required; points may be accrued annually.

Even if this year’s scores only end up counting 20%, that’s enough to change a teacher’s overall TEAM rating by a level. A TEAM score below a three means no PDPs, for example. The overall TEAM score also impacts the number of observations a teacher has in a year — which also places an additional burden on administrators.

Also, districts now have to meet to decide how to handle the tests and student grades. For some, that decision has already been made. For others, this will require a meeting in pretty short order to let students, parents, and teachers know what’s happening.

Here’s the language of the conference committee report:

 

For more on education politics and policy in Tennessee, follow @TNEdReport

Your support is appreciated and helps keep content like this coming!


 

Third Time’s No Charm

Today was Day Three of statewide testing in Tennessee — TNReady. Let’s just say that the first two days didn’t go so well.

After a serious malfunction on Monday, the state’s testing vendor claimed it was hacked yesterday. So, students around the state were unable to complete scheduled tests.

The hacking allegation raises concerns over privacy, and one parent has had enough.

Now, though, the state is sure things are worked out and Day Three is all set — smooth and problem-free.

In fact, Commissioner of Education Candice McQueen testified before a House Committee today and apologized for the two days of problems. She also refused to resign and suggested that because today’s testing was going well, things were back on track. That is, nothing to worry about. She stated she believes the test results can be valid, and can be used in a valid way to evaluate teacher and school performance. Except, even in the best case scenario, that’s wrong.

Here’s the deal: There were scattered reports of issues today, including difficulty logging on and at least five districts requiring some form of tech support. If there had been no other problems this week, that would seem very minor. Taken in context, however, it’s concerning that after these past two days, some districts/schools are still struggling.

I also received one report from a middle Tennessee district that said students in middle grades (5-8) were receiving the wrong grade level tests. While unconfirmed, again, it raises questions in light of earlier challenges this week.

It’s also worth noting that several districts, including two large districts (Williamson, Rutherford) suspended testing for today. That means they weren’t trying to access the system. If the problem the past two days was system overload, a significant reduction in attempts would certainly impact that, possibly allowing the test to go forward today with only minor issues. What will happen tomorrow as those systems join the rest of the state?

Finally, even in systems reporting that the test went smoothly today, here’s what that means at an individual school:

Just a quick update as to where we are on testing and what to expect in the next few days.

We will be on a regular bell schedule both tomorrow and Friday. Due to the number of “Incomplete” tests that did not submit and those that did not get logged on, it has taken a considerable amount of time to get each logged on, trouble shoot and then submit their Writing portion of the test today. We still have close to 97 students to complete tomorrow. Many of these just needed to be recovered and submitted,but this requires time for the administrator to sit with each student and ensure that it does submit successfully.

With that being said, the TDOE has extended the testing window so that we can push back some and get this portion complete prior to moving forward. The Writing portion of the TNReady Test must be submitted prior to being able to move to part 2, 3 and 4 of ELA and has a much earlier required submission date than all of the other tests. We will work tomorrow(Thursday) to get these 97 students caught up and finished and then move ahead to the Math test beginning on Monday as planned. Barring any further disruptions of the testing platform, we will be on our previously announced testing schedule for next week. We will then pick up the remaining ELA testing the following week and will get that information out to you as quickly as we can.

The disruption caused by the testing failures on Monday and Tuesday has far-reaching impact. This message from a principal to parents explains the headache of rearranging schedules and resubmitting the tests.

The bottom line: This year’s online testing may be useful for testing the platform and working out bugs, but it is not a valid indicator of student progress or teacher performance. It certainly shouldn’t be used in any school accountability measures.

Commissioner McQueen seems unfazed by logic, however, and insists we can plow right ahead with these scores and use them to judge teacher performance, and even include them in student grades if a district chooses.

No, the third time wasn’t a charm in Tennessee, no matter what the failed Commissioner says.

 

For more on education politics and policy in Tennessee, follow @TNEdReport

Creating content takes valuable time — your support helps ensure these stories keep coming.


 

TNReady Groundhog Day

It’s Day Two of statewide TNReady testing and despite reassurances following yesterday’s disaster, districts across the state are reporting problems and suspending testing.

Nashvillle, Williamson County, Wilson County, Rutherford County, Sumner County, and Chester County have all reported problems. Students are having difficulty logging on in some cases and in others, students complete an entire test but are unable to submit.

Yesterday, Commissioner of Education Candice McQueen said:

“We understand many of you suspended testing today, and we apologize for the unanticipated scheduling changes this issue may have caused,” she said in an email dispatched to district administrators. “…We feel good going into testing tomorrow.”

No, you don’t understand. No, you’re not sorry. This keeps happening. Year after year. Kids went to school yesterday ready to “test like a champion,” and then, nothing happened.

Kids went back today ready to “try again,” and nothing happened.

Word is, Commissioner McQueen is conferencing with districts now. Unless she’s saying we are going to end testing this year and that she’s resigning, I’m not sure how comforting her words can be.

Here’s a tip for Directors of Schools: Don’t believe what she tells you. There’s a clear and disastrous track record when it comes to McQueen and testing.

UPDATE: 10:32 AM

The Department of Education reports the issue is statewide and has issued this statement:

 

UPDATE: Haywood County Director calls on state to immediately suspend all TNReady testing this year>

has suspended testing AGAIN! We need our leadership to step up & suspend testing statewide. It is a statewide issue. Schools, teachers, & students will all be evaluated based on state assessment. Press pause , please!

UPDATE: 3:05 PM Arlington Schools “concerned”

As many of you are aware, TNReady online testing has been severely impacted across the state. The state required grades 9-12 to test online while it remained optional for grades 5-8. We opted out of online testing where available, therefore, grades 2-8 have not been impacted.

With this being the inaugural year of online testing for all high schools, we anticipated the potential for difficulties in the statewide implementation, so we did not schedule online tests to begin until Wednesday for safe measure.

At the time of this release, the Tennessee Department of Education has resumed all testing. We are scheduled to begin online testing at the high school tomorrow and are continuing to get updates from the TDOE. We will proceed according to those updates.

However, we are deeply concerned what impact this may have on our teachers and students and are currently monitoring that impact with other districts across the state.

We’ll update you as more information becomes available.

UPDATE: 3:09 PM – Williamson County Suspends Until Thursday

Only third and fourth grade students taking the paper TNReady tests will continue testing Wednesday. All online testing has been postponed. A decision regarding online testing will be made Wednesday afternoon. WCS hopes to resume online testing on Thursday.

UPDATE: 3:15 PM — TNDOE Says Everything Will be OK Tomorrow:

UPDATE: Lamberth legislation – 

Today I filed an amendment to end computerized testing in Tennessee and return to paper tests. For four years this system has failed our hard working students, teachers and parents and I’m finished with it. The amendment will be heard this afternoon on the House floor. — State Rep. William Lamberth of Sumner County

Stay tuned as more develops with this story.

 

Your support makes it possible to keep covering education news in Tennessee.

Danger Ahead?

As Tennessee prepares to test more students than ever via an online platform, there are some signs of potential trouble.

Chalkbeat reports:

State officials said Thursday they are confident the new digital platform will work under heavy traffic, even as their new testing vendor, Questar, had headaches administering computer-based tests in New York on Wednesday. Some students there struggled to log on and submit their exam responses — issues that Questar leaders blamed on a separate company providing the computer infrastructure that hosts the tests.

 

Tennessee officials say they are working with Questar to ensure similar problems don’t occur in Tennessee. They also point out our online testing infrastructure is different and that Questar will have troubleshooting staff in the state during the test administration.

Here’s the problem: Across multiple testing vendors and dating back to TCAP, Tennessee has had problems with testing. This includes the now perennial issue of not being able to deliver scores back to districts in a timely manner. In fact, in December, districts were told scores might not be back in a timely fashion this year, either.

It’s possible the state and Questar have all the issues worked out and this year’s test administration will be nearly flawless. However, the record over the past few years is not encouraging.

Then, there’s the issue of what happens with the results. If they are available for factoring into student scores, it is up to districts to choose the method. I’ve written before about why that’s problematic. Here’s a quick summary:

The cube root method yielded on average a quick score, the score that goes for a grade, of 4.46 points higher. In other words, a studentscoring basic with a raw score of 30 or higher would, on average, receive an extra 4.46% on their final quick score grade, which goes on their report card. A student who scored a 70 last year could expect to receive a 74 under the new quick score calculation.

The additional points do drop as one goes up the raw score scale, however. For the average basic student grades 3-8 with a raw score between 30 and 47, they would receive an extra 5.41 extra points under the new method.

The average proficient student grades 3-8 with a raw score between 48 and 60 would get 4.32 extra points under the new method.

The average advanced student grades 3-8 with a raw score of between 61 and 67 would receive an extra 1.97 extra points under the new method.

The difference varies much more widely for below basic students, but the difference can be as much as 25 points in some cases.

So, for those districts using quick scores in report cards, there could be a wide variance across districts depending on the method chosen. It seems to me, districts should have already communicated to families how they will calculate quick scores with some justification for that choice. Alternatively, the state could have (should have?) mandated a method so that there is score consistency across the state.

Then, of course, there’s the issue of using these scores in teacher evaluation. Let’s say testing goes well this year. This would be the first year of a test without problems. If that happens, this should serve as the baseline for any test-based teacher evaluation. Yes, I think using value-added scores is a misguided approach, but if Tennessee is going to go this route, the state ought to take steps to ensure the data is as accurate as possible. That would require at least three years of successful test administration. So far, we have zero.

If TNReady is a great test that has the potential to offer us useful insight into student learning, it’s worth taking the time to get it right. So far, it seems Tennessee has yet to learn the lesson of the NAEP outlier — we don’t need rapid acceleration, we need to be patient, take our time, and focus.

 

For more on education politics and policy in Tennessee, follow @TNEdReport