The NeverEnding Story

Another day, more stories of districts reporting to families that TNReady scores won’t be back in time to be factored into student grades. I first reported that Williamson County sent word that scores would not be back according to the original timeline. Next, it was MNPS telling parents that TNReady scores won’t be back until June, meaning they won’t be factored into report cards.

Now, two more middle Tennessee districts have sent notices about TNReady results not being ready in time.

Here’s the notice from Clarksville-Montgomery County:

The TNReady materials from CMCSS have been returned to Questar. Tennessee has noted that they will be unable to provide the district with the test results until after the end of May. Based on CMCSS Administrative Policy INS-A023, effective April 17, 2015 in alignment with HB 36 SB 285 Amendment (005744), Clarksville Montgomery County School System will not include students’ state assessment scores in their final spring semester grades if the state assessment scores are not received by the district at least five instructional days before the end of the academic year. As we will not be receiving the scores until the end of May the scores will not be included in students’ grades for this year. The second semester average for elementary and middle will be 50% 3rd 9 weeks and 50% 4th 9 weeks. The second semester grades for high school will be 40% 3rd 9 weeks, 40% 4th 9 weeks, and 20% final exam.

And one from Wilson County Schools:

Good Afternoon!

The end of a school year always brings about a flurry of activity and excitement, but I wanted to take a moment to update you on report cards for the spring semester.

A couple of weeks ago, we announced that report cards would be available, VIA Skyward, on Tuesday May 30th. Unfortunately, it’s unclear whether the district will be able to meet that date, due to a shipping delay that was beyond our control. While our district met all of the required deadlines to ensure that our raw scores would be returned by May 22nd, the state vendor responsible for picking up the completed materials arrived several days later than scheduled. This has affected a number of large districts across the state, including Wilson County.

The TN Department of Education is aware of these delays. They’ve assured us that they’re working with the vendor to “find a remedy” for the school districts impacted. Our hope is that a solution WILL be found, and our raw scores will be returned on time. Having said that, we thought it was important to make you aware of what’s happened, in the event that report cards have to be delayed for a week.

You may remember, TNReady scores came back later than expected for the fall semester, causing report cards to be delayed. While school districts have the authority to exclude TNReady scores that are returned more than 5 days late, it is the position of Wilson County Schools that the scores be included for this semester, as they were in the fall. This is not a decision that was taken lightly. Many conversations have taken place with teachers and principals about this issue, and the overwhelming consensus is that we include the scores on report cards. Students have worked incredibly hard all year to show of their skills, and we’re eager to see just how well they did!

Thank you for remaining patient, as we work through the process. We’ll keep you updated, as we receive additional information from the state. If you have any questions, feel free to submit those to “Let’s Talk” at the following link: http://www.k12insight.com/Lets-Talk/embed.aspx?k=WK9F4DLT. You can also reach out to me directly, using the information below.

Sincerely,
Jennifer Johnson

Here’s what the Department of Education has to say about the importance of state assessments:

Our state tests serve multiple objectives:

  • They provide feedback about students’ academic progress and how it aligns with grade-level expectations, providing parents and teachers a big-picture perspective about how a student is progressing compared to peers across the district and state, including a student’s strengths and growth opportunities.
  • This builds confidence and transparency about students’ readiness for college and the workforce among Tennessee universities and employers and holds us accountable to serving all students fairly.
  • Assessments help educators strengthen instruction and reflect on their practice, and allow us to highlight schools where students are excelling, so we can learn from those who are doing well.
  • State assessments also help inform decisions at the state level and help state and district leaders determine how to allocate resources, better invest in schools, and identify where we may need to offer additional support.

All of this sounds pretty important. But, not important enough to get it right. Last year, TNReady was a complete disaster. For the past four years, there have been problems with scores being either not available or not clearly communicated.

This year, the state is not providing quick scores to districts — those are the scores used to factor into a student’s final grade. Instead, the districts were to receive the raw data and choose a method of tabulating quick scores. An analysis of the various methods indicates a significant difference in scores depending on the calculation used:

The cube root method yielded on average a quick score, the score that goes for a grade, of 4.46 points higher. In other words, a student scoring basic with a raw score of 30 or higher would, on average, receive an extra 4.46% on their final quick score grade, which goes on their report card. A student who scored a 70 last year could expect to receive a 74 under the new quick score calculation.

The additional points do drop as one goes up the raw score scale, however. For the average basic student grades 3-8 with a raw score between 30 and 47, they would receive an extra 5.41 extra points under the new method.

The average proficient student grades 3-8 with a raw score between 48 and 60 would get 4.32 extra points under the new method.

The average advanced student grades 3-8 with a raw score of between 61 and 67 would receive an extra 1.97 extra points under the new method.

The difference varies much more widely for below basic students, but the difference can be as much as 25 points in some cases.

So, for those districts using quick scores in report cards, there could be a wide variance across districts depending on the method chosen. It seems to me, districts should have already communicated to families how they will calculate quick scores with some justification for that choice. Alternatively, the state could have (should have?) mandated a method so that there is score consistency across the state.

Of course, since a number of districts now won’t have data back in a timely fashion, there may not be many districts using quick scores at all this year.

Here’s the key point: Last year’s TNReady was a debacle. That means this year is really the first year we’ve done TNReady. Instead of jerking districts (and their students) around, the state should have waived use of TNReady scores to evaluate teachers and grade students this year. Doing so would have provided insight into the time it takes to get scores back to districts and allowed for possible changes in administration for next year. Instead, the plan was rushed with a new vendor. Now, we’re where we’ve been year after year: The school year is ending, and there’s a problem with test data.

One more thing: Despite this being the first year of a successful administration of a new test and despite the gap in test results — TCAP in 2015, no results in 2016, TNReady in 2017 — the scores from TNReady will still factor into teacher evaluation.

A word of caution to districts during the 2017-18 testing cycle: The state’s track record with deadlines and score results is not so great. Maybe when they promise you scores will be ready according to a certain timeline, you should be making plans for that timeline not being met.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

Maybe Someday

I reported recently on Williamson County Schools posting information that indicated a delay in the return of TNReady scores for this year. That report indicated scores would not be returned on the agreed timeline and a delay in report cards would result.

Now, word comes from MNPS that scores will not be returned to them until June. This means TNReady and EOC scores will not be factored into student grades.

Here’s the text of an email sent home to parents at JT Moore Middle School in Nashville:

Dear JT Moore Families:
TCAP grades and EOC scores will not be back in time to be included on report cards.
TCAP quick scores arriving in June
The Tennessee Department of Education has confirmed that we will not receive quick scores from state assessments before the end of the school year. Thus they will not be factored into student grades.
Infinite Campus is set up to properly adjust the weighting of nine weeks grades in the event that no exam grade is entered. Each nine-week grade will count as 25 percent of the yearly average for grades 3-8 or 50 percent of the semester average for high school courses.
As a result of this the following will apply:
No grade will go in the TCAP column in ES (3-4) and MS (5-8)
For the following HS or HS for Credit that take an EOC course there will be NO EXAM grade at all.

The grade for these semester classes will calculate 50/50:
English I, II, and III
Algebra I, Algebra II, and Geometry
Integrated Math IB and Integrated Math IIB
US History
Biology

Once again, the state’s testing regime is creating chaos. In some districts, the scores may end up counting in student grades — resulting in delayed report cards. Other districts (like MNPS) will simply not factor the test scores into student grades.

Imagine studying for an exam, being prepared, and doing well — knowing your performance is a significant factor in your final grade. Then, being told that the people who mandate the test simply won’t get it back in time. That’s the level of consideration being shown to our students.

This marks the second year of problems with TNReady and the fourth consecutive year of testing trouble wreaking havoc on students and teachers.

Oh, and then there’s the matter of what these tests really tell us:

An analysis of TCAP performance over time indicates that those school systems with consistently high levels of poverty tend to have consistently low scores on TCAP. Likewise, those systems with the least amount of poverty tend to have consistently higher scores on TCAP.

Of course, while the scores may or may not count in student grades (depending on district), they WILL be factored into teacher evaluations this year. This despite the fact they won’t provide any valid information.

TNReady will be ready. Maybe. Someday.

For more on education politics and policy in Tennessee, follow @TNEdReport