Tag Archives: Andy Spears

Posted on by

Whiners

Rep. Sabi Kumar has a message for students, parents, and teachers about the TNReady problems: Stop whining!

Yes, that’s what the Robertson County State Representative said in an email to an educator. The full email response is pictured below. Here’s the text where he responds directly about the testing issues this year:

I also ask a favor of you.

I ask that you and your colleagues rise to your calling as Educators and use this TN Ready Software Failure, that is being labeled a “Debacle” and a “Spectacular Failure”, as a Teaching Moment for your students.

I ask that you teach your students to treat this as a Bump in the Road and teach them how to handle Software Failures at home, or later, in their work space and in Life!

We do not want a child to learn that if they complain loud enough or cry in response to stress, life will get better. It is more important that they learn how to overcome stress and find solutions to problems in the Software of Life.

We want our students to be Winners Who Overcome Circumstances in Life and not whiners who complain. I do agree that each child has different needs and responses but our goal should be the same.

I admire you and your fellow Educators because you do so much for our children.

There is no successful adult who does not owe gratitude to that special teacher, or teachers, who helped shape us towards success in life.

So, Rep. Kumar ends his letter with kind-sounding words about teachers after suggesting that raising concerns about a testing system that has repeatedly failed students makes them “whiners.”

Kumar speaks of teaching children to find solutions to problems while simultaneously refusing to hold the Tennessee Department of Education accountable. He fails to mention that the voters of Robertson County send him to Nashville to help find solutions. Instead, he allows a multi-million dollar, multi-year testing failure to continue and implores those pointing that out to stop whining.

To students who have had schedules disrupted, test answers erased, and instructional time lost, Mr. Kumar says: stop complaining and don’t cry.

One thing he says is true: So far, in spite of the outcry from teachers, parents, and students, life in schools during TNReady is not getting any better. The testing marches on, the window is extended, the problems continue and those responsible are not held accountable.

Here’s an image of the email sent by Kumar:

Here’s how to contact Rep. Kumar.

For more on education politics and policy in Tennessee, follow @TNEdReport

Your support keeps the education news coming!


 

Posted on by

Weird Science

Last week, some parents suggested there was a problem with TNReady tests their children were taking. The students reported questions on material not covered or material not in their standards.

Now, it seems there may be an answer — at least when it comes to Science and Social Studies.

WBIR reports:

Over 900 TNReady Science and Social Studies test given to Anderson County student were from the wrong grade level, according to Director of Schools Tim Parrott.

Here’s the response from the Tennessee Department of Education:

“There was a poorly designed feature of the online testing system that contributed to some users accidentally administering a test to students that was below their grade level, including those at Norris Middle School. We’ve provided guidance to the district staff and the building testing coordinator to invalidate these tests. Students are not required to re-test, and their tests will not be scored. This means they will not count toward an educator’s evaluation nor will they factor into the scores we report for Norris Middle School. They will also not hurt the district’s or school’s participation rate.” – Tennessee Department of Education.

I’d suggest that the entirety of this year’s TNReady test has been a “poorly designed feature” of the Tennessee Department of Education and testing vendor Questar.

I’m interested in learning if this problem has popped up in other districts around the state. If you have something to report on this, email me: andy@tnedreport.com

For more on education politics and policy in Tennessee, follow @TNEdReport


 

Posted on by

No Adverse Action

After much wrangling in a day that saw the Tennessee House of Representatives hold up proceedings in order to move forward with an effort to truly hold students, teachers, and schools harmless in light of this year’s TNReady trouble, it appears a compromise of sorts has been reached.

Here’s the language just adopted by the Senate and subsequently passed by the House:

SECTION 1. Tennessee Code Annotated, Title 49, Chapter 6, Part 60, is amended by adding the following language as a new section: Notwithstanding any law to the contrary, no adverse action may be taken against any student, teacher, school, or LEA based, in whole or in part, on student achievement data generated from the 2017-2018 TNReady assessments. For purposes of this section, “adverse action” includes, but is not limited to, the identification of a school as a priority school and the assignment of a school to the achievement school district.

This language does not explicitly address the issue of using TNReady for TVAAS, but it has an effect similar to legislation passed in 2016 during that year’s TNReady trouble. Yes, it seems problems with testing in Tennessee are the norm rather than the exception.

Here’s what this should mean for teachers: Yes, a TVAAS score will be calculated based on this year’s TNReady. But, if that TVAAS score lowers your overall TEAM score, it will be excluded — lowering your TEAM score would be an “adverse action.”

While not perfect, this compromise is a victory — the TNReady data from a messed up test will not harm grades or be used in the state’s A-F report card for schools or be used to give a negative growth score to a teacher via TVAAS.

Yes, TVAAS is still suspect, but there’s an election in November and a new Commissioner of Education coming after that. Heading into the November election is a great time to talk with candidates for the legislature and for Governor about the importance of evaluations that are fair and not based on voodoo math like TVAAS. Remember, even under the best of circumstances, TVAAS would not have yielded valid results this year.

While it is disappointing that Senators did not want to follow the lead of their House counterparts and explicitly deal with the TVAAS issue, there’s no doubt that persistent outreach by constituents moved the needle on this issue.

For more on education politics and policy in Tennessee, follow @TNEdReport

If you enjoy the education news provided here, consider becoming a patron!


 

Posted on by

SUSPENDED: A TNReady Story

As the 2018 TNReady saga continues, there are scattered reports today of testing issues.

Testing has been suspended at Collierville High School due to issues with the vendor, Questar. Likewise, problems have been reported in Cookeville.

Various login and submission issues have been reported from some schools in Nashville.

Reports from multiple districts indicate an upgrade to the Nextera testing platform used by Questar wiped out class rosters. Guidance from Questar initially suggested that testing coordinators could manually upload the rosters.

It is not yet clear how much of an impact issues related to the Nextera upgrade have had across the state. Some schools report the rosters eventually reappeared.

UPDATE: Reports at the end of the day of testing issues (login problems, rosters disappearing/reappearing, wrong tests loaded and replaced, submission delays) from Washington County, Knox County, Wilson County, and Williamson County in addition to the problems reported earlier from Cookeville and Collierville.

If you know more about this issue or if your district or school has had testing issues today, please email me at andy@tnedreport.com 

Stay tuned for more on TNReady and testing in Tennessee.

For more on education politics and policy in Tennessee, follow @TNEdReport

Your support helps keep TNEdReport going strong!


 

Posted on by

Would You Eat This Pie?

After last week’s TNReady failure, the Tennessee General Assembly took some action to mitigate the impact the test would have on students and teachers.

I wrote at the time that the legislature’s action was a good step, but not quite enough:

  1. The law does say that districts and schools will not receive an “A-F” score based on the results of this year’s test. It also says schools can’t be placed on the state’s priority list based on the scores. That’s good news.

  2. The law gives districts the option of not counting this year’s scores in student grades. Some districts had already said they wouldn’t count the test due to the likelihood the scores would arrive late. Now, all districts can take this action if they choose.

  3. The law says any score generated for teachers based on this year’s test cannot be used in employment/compensation decisions.

Here’s what the law didn’t say: There will be NO TVAAS scores for teachers this year based on this data.

In other words, this year’s TNReady test WILL factor into a teacher’s evaluation.

The Department of Education took some steps to clarify what that means for teachers and offered a handy pie chart to explain the evaluation process:

First, this chart makes clear that this year’s TNReady scores WILL factor into a teacher’s overall evaluation.

Second, this chart is crazy. A teacher’s growth score is factored on tests from three different years and three types of tests.

15% of the growth score comes from the old TCAP (the test given in 2014-15, b/c the 2015-16 test had some problems). Then, 10% comes from last year’s TNReady, which was given on paper and pencil. Last year was the first year of a full administration of TNReady, and there were a few problems with the data calculation. A final 10% comes from this year’s TNReady, given online.

So, you have data from the old test, a skipped year, data from last year’s test (the first time TNReady had truly been administered), and data from this year’s messed up test.

There is no way this creates any kind of valid score related to teacher performance. At all.

In fact, transitioning to a new type of test creates validity issues. The way to address that is to gather three or more years of data and then build on that.

Here’s what I noted from statisticians who study the use of value-added to assess teacher performance:

Researchers studying the validity of value-added measures asked whether value-added gave different results depending on the type of question asked. Particularly relevant now because Tennessee is shifting to a new test with different types of questions.

Here’s what Lockwood and McCaffrey (2007) had to say in the Journal of Educational Measurement:

We find that the variation in estimated effects resulting from the different mathematics achievement measures is large relative to variation resulting from choices about model specification, and that the variation within teachers across achievement measures is larger than the variation across teachers. These results suggest that conclusions about individual teachers’ performance based on value-added models can be sensitive to the ways in which student achievement is measured.
These findings align with similar findings by Martineau (2006) and Schmidt et al (2005)
You get different results depending on the type of question you’re measuring.

The researchers tested various VAM models (including the type used in TVAAS) and found that teacher effect estimates changed significantly based on both what was being measured AND how it was measured.

And they concluded:

Our results provide a clear example that caution is needed when interpreting estimated teacher effects because there is the potential for teacher performance to depend on the skills that are measured by the achievement tests.

If you measure different skills, you get different results. That decreases (or eliminates) the reliability of those results. TNReady is measuring different skills in a different format than TCAP. It’s BOTH a different type of test AND a test on different standards. Any value-added comparison between the two tests is statistically suspect, at best. In the first year, such a comparison is invalid and unreliable. As more years of data become available, it may be possible to make some correlation between past TCAP results and TNReady scores.

I’ve written before about the shift to TNReady and any comparisons to prior tests being like comparing apples and oranges.

Here’s what the TN Department of Education’s pie chart does: It compares an apple to nothing to an orange to a banana.

Year 1: Apple (which counts 15%)

Year 2: Nothing, test was so messed up it was cancelled

Year 3: Orange – first year of TNReady (on pencil and paper)

Year 4: Banana – Online TNReady is a mess, students experience login, submission problems across the state.

From these four events, the state is suggesting that somehow, a valid score representing a teacher’s impact on student growth can be obtained. The representative from the Department of Education at today’s House Education Instruction and Programs Committee hearing said the issue was not that important, because this year’s test only counted for 10% of the overall growth score for a teacher. Some teachers disagree.

Also, look at that chart again. Too far up? Too confusing? Don’t worry, I’ve made a simpler version:

For more on education politics and policy in Tennessee, follow @TNEdReport


 

 

Your support keeps Tennessee Education Report going strong — thank you!

Posted on by

An Announcement

Covering the ongoing TNReady story has been fascinating and intense. It’s meant constant engagement on Twitter and via other social media and multiple posts and updates each day.

It’s also made me reflect on what is now six consecutive legislative sessions of education policy coverage via this platform.

In addition to updates on legislative action that impacts our schools, students, teachers, and parents, I’ve written extensively on a full range of education issues. I’ve covered the State Board of Education, the Commissioner of Education, and local school boards (especially in larger districts).

This blog has featured guest posts from educators (and I welcome more submissions via andy@tnedreport.com) and from policymakers.

Readers can count on 4-5 posts per week covering timely, relevant education news. On weeks like last week, posts are added and updated frequently. Additionally, in-depth reports are provided on topics like NAEP scores and teacher compensation.

All of this to say: I’ve decided to open a Patreon page as a means of generating some revenue to make this site truly sustainable.

Your support — even a few dollars a month — will ensure TNEdReport continues and grows. With steady funding, I can devote significant time to the site and explore ways to offer more and better content.

If you’d prefer to simply make a one-time contribution, you can do that, too!

Thank you for reading!

 

Posted on by

Not So Harmless

After a fourth day of TNReady trouble, the Tennessee General Assembly took action today to make changes to how the test impacts schools, students, and teachers.

While some are billing the report of a joint committee of the House and Senate as a “hold harmless” for schools, students, and teachers, that’s not entirely accurate.

Also, the legislature stopped short of putting a stop to TNReady entirely, claiming federal law “requires” them to test students.

Here’s the deal: Federal law does say that districts should administer tests to at least 95% of students and that states should test all students in reading and math from grades 3-8 and at least once in high school, with a suggestion for additional high school testing as appropriate.

BUT: Is there really a penalty for districts (or states) where the testing threshold falls below 95%?

As I reported in 2016, the last time we had a major failure of online testing in Tennessee:

There’s just one problem: The federal government has not (yet) penalized a single district for failing to hit the 95% benchmark. In fact, in the face of significant opt-outs in New York last year (including one district where 89% of students opted-out), the U.S. Department of Education communicated a clear message to New York state education leaders:  Districts and states will not suffer a loss of federal dollars due to high test refusal rates. The USDOE left it up to New York to decide whether or not to penalize districts financially.

In other words, the likelihood of a single Tennessee district losing funds due to stopping a test that isn’t working is very close to zero. Tennessee is not having problems due to opt-outs or a low number of students being tested. Kids in districts across the state are showing up for a test that is not happening. Districts are doing everything right and a vendor and the Tennessee Department of Education are failing to serve students. Unless TNDOE is going to fine districts, there is truly no risk of funds being lost.

Now, about the “hold harmless” law (pictured below):

  1. The law does say that districts and schools will not receive an “A-F” score based on the results of this year’s test. It also says schools can’t be placed on the state’s priority list based on the scores. That’s good news.
  2. The law gives districts the option of not counting this year’s scores in student grades. Some districts had already said they wouldn’t count the test due to the likelihood the scores would arrive late. Now, all districts can take this action if they choose.
  3. The law says any score generated for teachers based on this year’s test cannot be used in employment/compensation decisions.

Here’s what the law didn’t say: There will be NO TVAAS scores for teachers this year based on this data.

Commissioner McQueen said yesterday that the data from these tests will be used to generate a TVAAS score and it will count for 20% of a teacher’s evaluation. This law does NOT change that. It just says if you get a low score based on this number, you can’t be fired or denied compensation.

Below is an excerpt from current law (taken from TCA 49-1-302, the section governing teacher evaluation):

(E)  For teachers with access to individual data representative of student growth as specified in subdivision (d)(2)(B)(ii), the following provisions shall apply:

  • (i)  In the 2016-2017 school year, the evaluation criteria identified in subdivision (d)(2)(B)(ii) shall be adjusted so that student growth data generated by assessments administered in the 2016-2017 school year shall account for ten percent (10%) of the overall evaluation criteria identified in subdivision (d)(2)(B);
  • (ii)  In the 2017-2018 school year, the evaluation criteria identified in subdivision (d)(2)(B)(ii) shall be adjusted so that student growth data generated by assessments administered in the 2016-2017 and 2017-2018 school years shall account for twenty percent (20%) of the overall evaluation criteria identified in subdivision (d)(2)(B);
  • (iii)  In the 2018-2019 school year and thereafter, the student growth component of the evaluation criteria shall be determined under subdivision (d)(2)(B)(ii);
  • (iv)  The most recent year’s student growth evaluation composite shall account for the full thirty-five percent (35%) of growth data required in a teacher’s evaluation if such use results in a higher evaluation score;

  • (v)  For the 2015-2016 through 2017-2018 school years, student growth evaluation composites generated by assessments administered in the 2015-2016 school year shall be excluded from the student growth measure as specified in subdivision (d)(2)(B)(ii) if such exclusion results in a higher evaluation score for the teacher or principal. The qualitative portion of the evaluation shall be increased to account for any necessary reduction to the student growth measure.

Here’s what this means: If the current tests give you a “good” evaluation score, it will count for 35% of your total evaluation. If the score is not “good,” it only counts for 20% this year. The legislation adopted today by way of the Conference Committee does NOT change that.

In other words, the test data from the 2017-18 administration of TNReady WILL count in a teacher’s evaluation.

Here’s why that matters: An educator’s evaluation score factors into the number of observations they have each year as well as Professional Development Points (PDPs). PDPs are needed for license advancement or renewal.

The Department of Education addresses PDPs and notes:

Overall level of effectiveness rating (approved TN model) Overall Score of 5 = 20 PDPs
Overall Score of 4 = 15 PDPs

Overall Score of 3 = 10 PDPs

 Information is maintained by the department. No additional documentation is required; points may be accrued annually.

Even if this year’s scores only end up counting 20%, that’s enough to change a teacher’s overall TEAM rating by a level. A TEAM score below a three means no PDPs, for example. The overall TEAM score also impacts the number of observations a teacher has in a year — which also places an additional burden on administrators.

Also, districts now have to meet to decide how to handle the tests and student grades. For some, that decision has already been made. For others, this will require a meeting in pretty short order to let students, parents, and teachers know what’s happening.

Here’s the language of the conference committee report:

 

For more on education politics and policy in Tennessee, follow @TNEdReport

Your support is appreciated and helps keep content like this coming!


 

Posted on by

BREAKING: TNReady Day 4 – DOWN

In a developing story, at least eleven school systems across Tennessee are reporting problems with TNReady testing today. The problems include difficulty logging on and errors when attempting to submit completed tests.

While individual schools in some of these districts have been able to complete tests, most of the districts report widespread problems. The problems include several large districts, including Knox County, Davidson County, Rutherford County, and Sumner County.

The testing day was reportedly relatively smooth yesterday, when a number of large systems did not take the test.

More as this continuing saga unfolds.

UPDATE: 12:41 PM

Tennessee House of Representatives votes to delay budget vote until there is action on TNReady. Some are calling for the suspension of the test this year.

UPDATE: 1:03 PM  State says issue is “resolved”

The state of Tennessee plans to push ahead with testing, despite significant problems for students on three of the four days of statewide administration. The state says the current issue is “resolved” and that things are back to normal.

Here’s what “normal” looks like when you have these kind of delays.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

Posted on by

Third Time’s No Charm

Today was Day Three of statewide testing in Tennessee — TNReady. Let’s just say that the first two days didn’t go so well.

After a serious malfunction on Monday, the state’s testing vendor claimed it was hacked yesterday. So, students around the state were unable to complete scheduled tests.

The hacking allegation raises concerns over privacy, and one parent has had enough.

Now, though, the state is sure things are worked out and Day Three is all set — smooth and problem-free.

In fact, Commissioner of Education Candice McQueen testified before a House Committee today and apologized for the two days of problems. She also refused to resign and suggested that because today’s testing was going well, things were back on track. That is, nothing to worry about. She stated she believes the test results can be valid, and can be used in a valid way to evaluate teacher and school performance. Except, even in the best case scenario, that’s wrong.

Here’s the deal: There were scattered reports of issues today, including difficulty logging on and at least five districts requiring some form of tech support. If there had been no other problems this week, that would seem very minor. Taken in context, however, it’s concerning that after these past two days, some districts/schools are still struggling.

I also received one report from a middle Tennessee district that said students in middle grades (5-8) were receiving the wrong grade level tests. While unconfirmed, again, it raises questions in light of earlier challenges this week.

It’s also worth noting that several districts, including two large districts (Williamson, Rutherford) suspended testing for today. That means they weren’t trying to access the system. If the problem the past two days was system overload, a significant reduction in attempts would certainly impact that, possibly allowing the test to go forward today with only minor issues. What will happen tomorrow as those systems join the rest of the state?

Finally, even in systems reporting that the test went smoothly today, here’s what that means at an individual school:

Just a quick update as to where we are on testing and what to expect in the next few days.

We will be on a regular bell schedule both tomorrow and Friday. Due to the number of “Incomplete” tests that did not submit and those that did not get logged on, it has taken a considerable amount of time to get each logged on, trouble shoot and then submit their Writing portion of the test today. We still have close to 97 students to complete tomorrow. Many of these just needed to be recovered and submitted,but this requires time for the administrator to sit with each student and ensure that it does submit successfully.

With that being said, the TDOE has extended the testing window so that we can push back some and get this portion complete prior to moving forward. The Writing portion of the TNReady Test must be submitted prior to being able to move to part 2, 3 and 4 of ELA and has a much earlier required submission date than all of the other tests. We will work tomorrow(Thursday) to get these 97 students caught up and finished and then move ahead to the Math test beginning on Monday as planned. Barring any further disruptions of the testing platform, we will be on our previously announced testing schedule for next week. We will then pick up the remaining ELA testing the following week and will get that information out to you as quickly as we can.

The disruption caused by the testing failures on Monday and Tuesday has far-reaching impact. This message from a principal to parents explains the headache of rearranging schedules and resubmitting the tests.

The bottom line: This year’s online testing may be useful for testing the platform and working out bugs, but it is not a valid indicator of student progress or teacher performance. It certainly shouldn’t be used in any school accountability measures.

Commissioner McQueen seems unfazed by logic, however, and insists we can plow right ahead with these scores and use them to judge teacher performance, and even include them in student grades if a district chooses.

No, the third time wasn’t a charm in Tennessee, no matter what the failed Commissioner says.

 

For more on education politics and policy in Tennessee, follow @TNEdReport

Creating content takes valuable time — your support helps ensure these stories keep coming.


 

Posted on by

TNReady Groundhog Day

It’s Day Two of statewide TNReady testing and despite reassurances following yesterday’s disaster, districts across the state are reporting problems and suspending testing.

Nashvillle, Williamson County, Wilson County, Rutherford County, Sumner County, and Chester County have all reported problems. Students are having difficulty logging on in some cases and in others, students complete an entire test but are unable to submit.

Yesterday, Commissioner of Education Candice McQueen said:

“We understand many of you suspended testing today, and we apologize for the unanticipated scheduling changes this issue may have caused,” she said in an email dispatched to district administrators. “…We feel good going into testing tomorrow.”

No, you don’t understand. No, you’re not sorry. This keeps happening. Year after year. Kids went to school yesterday ready to “test like a champion,” and then, nothing happened.

Kids went back today ready to “try again,” and nothing happened.

Word is, Commissioner McQueen is conferencing with districts now. Unless she’s saying we are going to end testing this year and that she’s resigning, I’m not sure how comforting her words can be.

Here’s a tip for Directors of Schools: Don’t believe what she tells you. There’s a clear and disastrous track record when it comes to McQueen and testing.

UPDATE: 10:32 AM

The Department of Education reports the issue is statewide and has issued this statement:

 

UPDATE: Haywood County Director calls on state to immediately suspend all TNReady testing this year>

has suspended testing AGAIN! We need our leadership to step up & suspend testing statewide. It is a statewide issue. Schools, teachers, & students will all be evaluated based on state assessment. Press pause , please!

UPDATE: 3:05 PM Arlington Schools “concerned”

As many of you are aware, TNReady online testing has been severely impacted across the state. The state required grades 9-12 to test online while it remained optional for grades 5-8. We opted out of online testing where available, therefore, grades 2-8 have not been impacted.

With this being the inaugural year of online testing for all high schools, we anticipated the potential for difficulties in the statewide implementation, so we did not schedule online tests to begin until Wednesday for safe measure.

At the time of this release, the Tennessee Department of Education has resumed all testing. We are scheduled to begin online testing at the high school tomorrow and are continuing to get updates from the TDOE. We will proceed according to those updates.

However, we are deeply concerned what impact this may have on our teachers and students and are currently monitoring that impact with other districts across the state.

We’ll update you as more information becomes available.

UPDATE: 3:09 PM – Williamson County Suspends Until Thursday

Only third and fourth grade students taking the paper TNReady tests will continue testing Wednesday. All online testing has been postponed. A decision regarding online testing will be made Wednesday afternoon. WCS hopes to resume online testing on Thursday.

UPDATE: 3:15 PM — TNDOE Says Everything Will be OK Tomorrow:

UPDATE: Lamberth legislation – 

Today I filed an amendment to end computerized testing in Tennessee and return to paper tests. For four years this system has failed our hard working students, teachers and parents and I’m finished with it. The amendment will be heard this afternoon on the House floor. — State Rep. William Lamberth of Sumner County

Stay tuned as more develops with this story.

 

Your support makes it possible to keep covering education news in Tennessee.