Category Archives: TNReady

Posted on by

Tight Deadline

Trouble with the timeline for returning TNReady quick scores to school districts has lead to some unpleasant exchanges between districts and the Tennessee Department of Education. The latest reporting indicates that more than 75% of districts won’t have scores back in a fashion that allows them to be factored into report cards before the school year ends (which for most districts, is this week).

One question that has been asked is when did districts know there might be a problem?

A pair of emails from Commissioner Candice McQueen to directors of schools indicates it was pretty late in the game.

Here’s one sent on the evening of May 3rd. Here’s the portion of that email dedicated to TNReady and the timeline to return tests so they can be scored and returned to districts:

In order to receive TNReady raw score data back by late May, we need your support in shipping completed testing materials to our vendor in a timely fashion. We know that 75 percent of districts have shipped back some materials, and we need your help in ensuring all completed materials—particularly ELA subpart 1, which will be hand-scored—are returned quickly.

Testing coordinators should send completed subparts to Questar as soon as possible. System and building testing coordinators should follow the guidance they have received from our team as well as Questar. Our goal is to share your raw scores the week of May 22, which would be in time for TNReady results to be included in students’ grades at the 10 percent weighting for this year.

So, it’s May 3rd in the evening. You get this email that night or read it in the office the next day. The testing window ends May 5th. It looks like most districts have returned some materials and that raw scores will be back for most districts the week of May 22nd, plenty of time to use the data for student report cards.

Then, tucked inside the May 10th update (not even the top item) is this important information about deadlines for receipt of TNReady materials:

In order to receive TNReady raw score data back by late May, we need your support in shipping all completed testing materials to our vendor in a timely fashion. Testing coordinators should send completed subparts to Questar as soon as possible. System and building testing coordinators should follow the guidance they have received from our team as well as Questar. We have been working with our vendor to provide raw scores as early as the week of May 22, which would be in time for TNReady results to be included in students’ grades at the reduced 10 percent weighting for this year.

We have worked with Questar to determine the following timeline for when you can expect to have raw scores based on when they receive materials:

Subpart 1 (ELA 3–8, ENG I-III and USH) received by Questar All other test materials received by Questar Anticipated raw score file delivery date
On or before April 28 Wednesday, May 10 Monday, May 22*
April 29–May 5 Friday, May 12 Tuesday, May 30*
May 6–May 19 Friday, May 19 Monday, June 5*

*The raw score file dates are projected based on Questar’s anticipated timeline for scoring and processing.

That’s a pretty tight turnaround. The email I have on this has a time stamp of 8:45 PM — so, most people got this pretty late in the evening or read it on the 11th at the office.

But, reading it on the 11th was pretty useless since the deadline was the 10th. Oh, and getting the email on May 10th in the evening (or even during the day) was also pretty worthless.

Of course, if you acted quickly, you could get everything to Questar by May 12th and get scores back the week of May 30th. Sure, that’s after school’s out, but it would likely only mean a brief delay in report cards. But that would also mean you spent all of May 11th coordinating the logistics of getting scores to Questar the NEXT DAY.

Telling someone about a deadline that has already passed is not helpful.

Also odd is this wording about the three timelines released in response to Clarksville-Montgomery County’s results:

“We provide three different timelines for a reason, and all are equally fine and acceptable for districts to be on. We are neutral on which deadlines districts meet, and it is reasonable that larger districts would need additional time to ship materials back and may use the entire window to do so. We have always fully expected that we will have districts on all three tracks based on their local decisions.” Assistant Education Commissioner Nakia Towns confirmed that with this comment: “We emphasized that there was no “miss” of deadlines. We just provided three timelines.”

On May 3rd, the word from the Department of Education was that most districts were on track and that most districts would have scores back by the week of May 22nd. Then, on May 10th, it turns out May 10th is the deadline for getting scores back the week of May 22nd. Want scores the week of May 30th? Better get them together by May 12th — essentially a one day notice.

So, now we end up with more than 75% of districts NOT getting raw scores back by the end of May.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

 

 

 

Posted on by

Not Exactly Helpful

In a story yesterday about TNReady scores not being ready in time to be counted in student final grades, I noted a statement published in the Clarksville Leaf-Chronicle and attributed to Tennessee Department of Education spokesperson Sara Gast. Here’s that statement again:

But Sara Gast, spokeswoman for the state Department of Education, said school districts would receive their scores based on how quickly they returned their materials.

This was the first week school districts could receive data back, and districts across the state will get their scores on a rolling basis over the next couple of week through the week of June 5, she said.

She said some districts will not get their scores in time to be counted in final grades “because they did not meet the deadlines.”

Since then, Clarksville-Montgomery County Schools has posted an update on their Facebook page:

The state department of Education has clarified that CMCSS did NOT miss any deadlines. According to Sara Gast from the Tennessee Department of Education, “We provide three different timelines for a reason, and all are equally fine and acceptable for districts to be on. We are neutral on which deadlines districts meet, and it is reasonable that larger districts would need additional time to ship materials back and may use the entire window to do so. We have always fully expected that we will have districts on all three tracks based on their local decisions.” Assistant Education Commissioner Nakia Towns confirmed that with this comment: “We emphasized that there was no “miss” of deadlines. We just provided three timelines.”

What’s not clear from this statement is whether it was anticipated that scores would not be ready by the end of school depending on the track chosen by districts.

It’s also interesting how the DOE’s explanation has shifted from blaming districts for missing deadlines to now saying that having more than 75% of districts not getting scores back before the end of the year was the plan all along.

I offered a solution yesterday. It’s simple, really.

Stop using this single test as the primary indicator of student performance, teacher effectiveness, and school accountability.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

 

Posted on by

The Buck Stops Nowhere

By now it is clear that TNReady simply didn’t go as planned this year. Sure, the tests were administered and students completed them — largely on pencil and paper. But, the raw data from the tests used to generate the “quick scores” for student grades isn’t getting back to districts on time. At least not in time to include it in report cards.

The Department of Education says that’s the fault of districts. Here’s how a TN DOE spokesperson explained it to the Clarksville Leaf-Chronicle:

But Sara Gast, spokeswoman for the state Department of Education, said school districts would receive their scores based on how quickly they returned their materials.

This was the first week school districts could receive data back, and districts across the state will get their scores on a rolling basis over the next couple of week through the week of June 5, she said.

She said some districts will not get their scores in time to be counted in final grades “because they did not meet the deadlines.”

The district says that’s simply not the case and that they met the established timeline:

Shelton said tests from all Clarksville-Montgomery County schools were definitely turned in according to the state’s timeline to have them back before schools let out Wednesday, and the school district was not at fault.

All of this may sound a bit familiar to those who watched the blame game play out last year during the total meltdown of TNReady.

Then, neither testing vendor Measurement, Inc. nor the Department of Education took responsibility for a test that clearly failed.

Here’s what’s interesting this year. The state admits that more than 75% of districts will not get scores back on time. This, they claim, is because of missed deadlines. Districts dispute that claim.

Educators will tell you that if more than 75% of students miss a test question or fail a test, there’s a problem – and the problem is with the question or the test, not the students. More than 75% of districts supposedly missed established deadlines. It seems clear the Department of Education has a problem. It’s also clear that adults are failing kids.

Students are told the tests matter. They are told the tests factor into grades. Schools are held accountable based on results. Despite statistical validity issues, the test is used to evaluate teachers — so, those teachers reinforce the importance of the test to their students.

Then, after the answer sheets have been bubbled in and the test booklets sent to the vendor for grading, students are told the tests won’t count. Or, they may count, but report cards will be late. But it’s okay. The adults got it wrong. Just keep showing up and taking the test seriously. No big deal.

If you want the students to take testing seriously, you should take your job seriously. This is the fourth year in a row that there have been challenges with testing and/or returning results. When district leaders have stood up and spoken out, Commissioner McQueen has threatened to withhold funding.

Here’s a crazy idea: Stop using this single test as the primary indicator of student performance, teacher effectiveness, and school accountability.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

 

Posted on by

Rhetoric vs. Reality: TNReady 2017 Edition

Here’s what Commissioner of Education Candice McQueen had to say about this year’s TNReady tests in an email sent to educators on May 16th:

This year’s administration of TNReady was a success, both online and on paper, in schools across Tennessee. Thank you for you partnership and for preparing students with strong instruction every day. Stay tuned as we continue to share updates and resources.

Since then, it’s become clear that TNReady results won’t actually be ready for most districts in a timely fashion — meaning they’ll either be excluded from student grades or report cards will be held until results are available.

WPLN’s Blake Farmer reports on the scope of the problem:

The state department of education says less than a quarter of districts finished testing in time to get the results by the end of May. For those that did wrap up early, they started getting results back this week.

Yes, that’s right. More than 75% of districts won’t have results back before the end of May.

That’s an odd definition of success.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

Posted on by

The NeverEnding Story

Another day, more stories of districts reporting to families that TNReady scores won’t be back in time to be factored into student grades. I first reported that Williamson County sent word that scores would not be back according to the original timeline. Next, it was MNPS telling parents that TNReady scores won’t be back until June, meaning they won’t be factored into report cards.

Now, two more middle Tennessee districts have sent notices about TNReady results not being ready in time.

Here’s the notice from Clarksville-Montgomery County:

The TNReady materials from CMCSS have been returned to Questar. Tennessee has noted that they will be unable to provide the district with the test results until after the end of May. Based on CMCSS Administrative Policy INS-A023, effective April 17, 2015 in alignment with HB 36 SB 285 Amendment (005744), Clarksville Montgomery County School System will not include students’ state assessment scores in their final spring semester grades if the state assessment scores are not received by the district at least five instructional days before the end of the academic year. As we will not be receiving the scores until the end of May the scores will not be included in students’ grades for this year. The second semester average for elementary and middle will be 50% 3rd 9 weeks and 50% 4th 9 weeks. The second semester grades for high school will be 40% 3rd 9 weeks, 40% 4th 9 weeks, and 20% final exam.

And one from Wilson County Schools:

Good Afternoon!

The end of a school year always brings about a flurry of activity and excitement, but I wanted to take a moment to update you on report cards for the spring semester.

A couple of weeks ago, we announced that report cards would be available, VIA Skyward, on Tuesday May 30th. Unfortunately, it’s unclear whether the district will be able to meet that date, due to a shipping delay that was beyond our control. While our district met all of the required deadlines to ensure that our raw scores would be returned by May 22nd, the state vendor responsible for picking up the completed materials arrived several days later than scheduled. This has affected a number of large districts across the state, including Wilson County.

The TN Department of Education is aware of these delays. They’ve assured us that they’re working with the vendor to “find a remedy” for the school districts impacted. Our hope is that a solution WILL be found, and our raw scores will be returned on time. Having said that, we thought it was important to make you aware of what’s happened, in the event that report cards have to be delayed for a week.

You may remember, TNReady scores came back later than expected for the fall semester, causing report cards to be delayed. While school districts have the authority to exclude TNReady scores that are returned more than 5 days late, it is the position of Wilson County Schools that the scores be included for this semester, as they were in the fall. This is not a decision that was taken lightly. Many conversations have taken place with teachers and principals about this issue, and the overwhelming consensus is that we include the scores on report cards. Students have worked incredibly hard all year to show of their skills, and we’re eager to see just how well they did!

Thank you for remaining patient, as we work through the process. We’ll keep you updated, as we receive additional information from the state. If you have any questions, feel free to submit those to “Let’s Talk” at the following link: http://www.k12insight.com/Lets-Talk/embed.aspx?k=WK9F4DLT. You can also reach out to me directly, using the information below.

Sincerely,
Jennifer Johnson

Here’s what the Department of Education has to say about the importance of state assessments:

Our state tests serve multiple objectives:

  • They provide feedback about students’ academic progress and how it aligns with grade-level expectations, providing parents and teachers a big-picture perspective about how a student is progressing compared to peers across the district and state, including a student’s strengths and growth opportunities.
  • This builds confidence and transparency about students’ readiness for college and the workforce among Tennessee universities and employers and holds us accountable to serving all students fairly.
  • Assessments help educators strengthen instruction and reflect on their practice, and allow us to highlight schools where students are excelling, so we can learn from those who are doing well.
  • State assessments also help inform decisions at the state level and help state and district leaders determine how to allocate resources, better invest in schools, and identify where we may need to offer additional support.

All of this sounds pretty important. But, not important enough to get it right. Last year, TNReady was a complete disaster. For the past four years, there have been problems with scores being either not available or not clearly communicated.

This year, the state is not providing quick scores to districts — those are the scores used to factor into a student’s final grade. Instead, the districts were to receive the raw data and choose a method of tabulating quick scores. An analysis of the various methods indicates a significant difference in scores depending on the calculation used:

The cube root method yielded on average a quick score, the score that goes for a grade, of 4.46 points higher. In other words, a student scoring basic with a raw score of 30 or higher would, on average, receive an extra 4.46% on their final quick score grade, which goes on their report card. A student who scored a 70 last year could expect to receive a 74 under the new quick score calculation.

The additional points do drop as one goes up the raw score scale, however. For the average basic student grades 3-8 with a raw score between 30 and 47, they would receive an extra 5.41 extra points under the new method.

The average proficient student grades 3-8 with a raw score between 48 and 60 would get 4.32 extra points under the new method.

The average advanced student grades 3-8 with a raw score of between 61 and 67 would receive an extra 1.97 extra points under the new method.

The difference varies much more widely for below basic students, but the difference can be as much as 25 points in some cases.

So, for those districts using quick scores in report cards, there could be a wide variance across districts depending on the method chosen. It seems to me, districts should have already communicated to families how they will calculate quick scores with some justification for that choice. Alternatively, the state could have (should have?) mandated a method so that there is score consistency across the state.

Of course, since a number of districts now won’t have data back in a timely fashion, there may not be many districts using quick scores at all this year.

Here’s the key point: Last year’s TNReady was a debacle. That means this year is really the first year we’ve done TNReady. Instead of jerking districts (and their students) around, the state should have waived use of TNReady scores to evaluate teachers and grade students this year. Doing so would have provided insight into the time it takes to get scores back to districts and allowed for possible changes in administration for next year. Instead, the plan was rushed with a new vendor. Now, we’re where we’ve been year after year: The school year is ending, and there’s a problem with test data.

One more thing: Despite this being the first year of a successful administration of a new test and despite the gap in test results — TCAP in 2015, no results in 2016, TNReady in 2017 — the scores from TNReady will still factor into teacher evaluation.

A word of caution to districts during the 2017-18 testing cycle: The state’s track record with deadlines and score results is not so great. Maybe when they promise you scores will be ready according to a certain timeline, you should be making plans for that timeline not being met.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

Posted on by

Maybe Someday

I reported recently on Williamson County Schools posting information that indicated a delay in the return of TNReady scores for this year. That report indicated scores would not be returned on the agreed timeline and a delay in report cards would result.

Now, word comes from MNPS that scores will not be returned to them until June. This means TNReady and EOC scores will not be factored into student grades.

Here’s the text of an email sent home to parents at JT Moore Middle School in Nashville:

Dear JT Moore Families:
TCAP grades and EOC scores will not be back in time to be included on report cards.
TCAP quick scores arriving in June
The Tennessee Department of Education has confirmed that we will not receive quick scores from state assessments before the end of the school year. Thus they will not be factored into student grades.
Infinite Campus is set up to properly adjust the weighting of nine weeks grades in the event that no exam grade is entered. Each nine-week grade will count as 25 percent of the yearly average for grades 3-8 or 50 percent of the semester average for high school courses.
As a result of this the following will apply:
No grade will go in the TCAP column in ES (3-4) and MS (5-8)
For the following HS or HS for Credit that take an EOC course there will be NO EXAM grade at all.

The grade for these semester classes will calculate 50/50:
English I, II, and III
Algebra I, Algebra II, and Geometry
Integrated Math IB and Integrated Math IIB
US History
Biology

Once again, the state’s testing regime is creating chaos. In some districts, the scores may end up counting in student grades — resulting in delayed report cards. Other districts (like MNPS) will simply not factor the test scores into student grades.

Imagine studying for an exam, being prepared, and doing well — knowing your performance is a significant factor in your final grade. Then, being told that the people who mandate the test simply won’t get it back in time. That’s the level of consideration being shown to our students.

This marks the second year of problems with TNReady and the fourth consecutive year of testing trouble wreaking havoc on students and teachers.

Oh, and then there’s the matter of what these tests really tell us:

An analysis of TCAP performance over time indicates that those school systems with consistently high levels of poverty tend to have consistently low scores on TCAP. Likewise, those systems with the least amount of poverty tend to have consistently higher scores on TCAP.

Of course, while the scores may or may not count in student grades (depending on district), they WILL be factored into teacher evaluations this year. This despite the fact they won’t provide any valid information.

TNReady will be ready. Maybe. Someday.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

Posted on by

Definitely Not Ready

Last year, I wrote about how Tennessee students, teachers, and parents have come to expect that there will be issues with state tests and timely distribution of results. Last year was the biggest testing disaster in recent memory, but it seems there are problems popping up again this year.

Williamson County Schools recently posted this message about TNReady results and report cards:

The State Department of Education has notified the district that results from this spring’s TNReady testing will be delayed so grades cannot be calculated by the timeline established. The district is in the planning stages of determining how to proceed.

“We are disappointed in this delay,” said Superintendent Dr. Mike Looney. “The school district is preparing an action plan so we can accurately communicate to parents how their student performed during the 2016-17 school year.”

This marks the fourth consecutive year the state has not been able to produce testing results as promised.

Interestingly, earlier this week, Commissioner of Education Candice McQueen declared TNReady a “success.”

Here’s what Chalkbeat reported:

Testing results won’t be in for months, but Education Commissioner Candice McQueen is giving this year’s TNReady run an A-plus.

TNReady’s second year — and first full year for grades 3-8 — was a success on both paper and online, McQueen told education stakeholders in an email on Monday.

While the administration of the test may have been uneventful, the release of scores is proving problematic. I wrote in December about the State Board of Education getting involved late in the game on whether and how much TNReady scores should count in student grades.

Now, with a delay in scores being released, local school boards will have to decide what to do with the results. Will they hold report cards until quick scores can be reported OR will they release report cards with grades that don’t include TNReady scores?

In either case, we’re now on year four of testing trouble in Tennessee. Will next year continue the cycle?

For more on education politics and policy in Tennessee, follow @TNEdReport


 

Posted on by

Haslam to Kids: Be Ready, Even Though TN Hasn’t Been

In a letter sent home to students ahead of TNReady testing season, Governor Bill Haslam encourages them to do well and tells them, “Tennessee is behind you.”

Here’s the full text of the letter:

IMG_3182

These words of encouragement as well as a handy number 2 pencil were paid for by SCORE.

Here’s the thing: For the past few years, Tennessee hasn’t exactly been “behind” kids. Not in terms of delivering an annual test in an effective manner.

I wrote last year about the new “Rite of Spring.” Here’s what I said then:

Lately, this season has brought another ritual: The Tennessee Department of Education’s failure to deliver student test scores. Each of the last three years has seen TNDOE demonstrate it’s inability to get state testing right (nevermind the over-emphasis on testing to begin with).

Back in 2014, there was a delay in the release of the all-powerful “quick scores” used to help determine student grades. Ultimately, this failure led to an Assistant Commissioner losing her job.

Then, in 2015, the way “quick scores” were computed was changed, creating lots of confusion. The Department was quick to apologize, noting:

We regret this oversight, and we will continue to improve our processes such that we uphold our commitment to transparency, accuracy, and timeliness with regard to data returns, even as we experience changes in personnel.

The processes did not appear to be much improved at all as the 2016 testing cycle got into full swing, with a significant technical failure on Day One.

When it comes to actually getting test administration and subsequent details right, Tennessee hasn’t exactly been “behind” the kids taking the tests.

But this year, armed with a letter from the Governor and a new pencil, the kids are ready. Haslam wants them to do their best, even though the state has been letting them down.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

Posted on by

Shelby County Passes TNReady Resolution

The Shelby County Commission last night unanimously passed a resolution calling on state lawmakers to suspend use of TNReady data for student grades and teacher evaluations this year.

Here’s what they had to say:

RESOLUTION URGING THE TENNESSEE COMMISSIONER OF EDUCATION, GOVERNOR BILL  HASLAM, AND THE GENERAL ASSEMBLY TO ELIMINATE THE TENNESSEE READY SCORES AS A COMPONENT OF TEACHER EVALUATIONS AND STUDENT SCORES.  SPONSORED BY COMMISIONER DAVID REAVES

 

WHEREAS, the State of Tennessee has invested heavily in the development of educational standards known as Tennessee (TN) Ready, and

WHEREAS, standardized testing has become the cornerstone of measuring mastery of the TN educational standards, and

WHEREAS, TN Ready should be meant to be diagnostic in nature and help teachers and administrators understand and develop an educational plan to help students close the achievement gap in proficiency; and

WHEREAS, the TN Ready test has become a final exam for children instead of a continual diagnostic view; and

WHEREAS, the TN General Assembly has chosen to hold teachers accountable by linking student performance on the TN Ready exam to a teacher’s evaluation; and

WHEREAS the unintended consequence of such action has led to teachers teaching children to score high on a test versus teaching real mastery of subject matter; and

WHEREAS, while giving off the appearance of a better education, this type of teaching to the test behavior actually limits the amount of quality content in deference to test taking strategies; and

WHEREAS, the TN General Assembly has now also tied student scores to the results of standardized testing creating an unfair playing field for students and their college scholarship prospects with private school students who do not count standardized tests as part of their grade point average (GPA); and

WHEREAS, parents, students, and teachers are all impacted by the State of TN placing so much emphasis on testing instead of instruction; and

WHEREAS, record numbers of quality teachers are leaving the teaching profession and school districts are struggling to recruit and retain quality teachers due to the TN standards imposed in regards to standardized testing.

NOW, THEREFORE, BE IT RESOLVED BY THE SHELBY COUNTY BOARD OF COMMISSIONERS, that we urge the TN General Assembly to suspend the use of TN Ready Results as part of the teacher evaluations and as part of the students’ GPAs.

MORE on TNReady:

Will TNReady Yield Valid Data for Teacher Evaluations?

Washington County Joins Waiver Wave

State Board Makes Late Call on TNReady Data

For more on education politics and policy in Tennessee, follow @TNEdReport


 

 

Posted on by

That’s Not What You Said Last Week

Earlier this legislative session, voucher bill sponsor Brian Kelsey said TNReady was a “disaster” and he wouldn’t want to force it on private schools accepting public funds by way of vouchers.

Then, last week, he changed his tune.

Here’s how Grace Tatter of Chalkbeat reported it:

Sen. Brian Kelsey, the architect of Tennessee’s voucher bill, said he would prefer requiring students who use vouchers to take nationally normed tests, like they do in Florida and several other states with voucher programs.

But he said he understands why policymakers want to make “apple to apple” comparisons between public schools and private schools accepting government dollars. “If that gives policymakers greater comfort to vote for the bill, then I am all for that,” said the Germantown Republican.

And, with Kelsey’s blessing, the bill was amended in the House Government Operations Committee last week to include a requirement that students receiving vouchers take the TNReady test. Yes, the one Kelsey called a disaster.

Exactly one week later, this happened:

The panel voted narrowly to amend the bill so that voucher participants could take tests in their private schools that are different from what their counterparts take in public schools. But lawmakers stopped short of sending the amended bill to their finance committee after Rep. Mike Stewart, who opposes vouchers, moved to adjourn.

So, is TNReady a disaster, but one that’s worth risking in order for private schools to get public money? Or, should private schools choose their own tests?

Here’s what we do know: In states like Indiana and Louisiana, students receiving vouchers must take state tests. The results in those states paint a picture of vouchers as an education reform that not only doesn’t help kids, but also pushes them further behind. Yes, students in Indiana and Louisiana who received vouchers actually lost ground academically when they went to private schools.

For now, voucher legislation in Tennessee is stalled in the House Government Operations Committee. The Senate version is sitting in the Finance Committee there, still not scheduled for a vote.

To test or not to test? That seems to be the core question and the final answer may determine whether a voucher bill passes this session.

For more on education politics and policy in Tennessee, follow @TNEdReport