Not Really Listening

Governor Bill Haslam was in Knoxville today on his “listening tour.”

Here’s what TEA President Beth Brown had to say about how the event unfolded:

A message from TEA President Beth Brown:

I am a high school English teacher, so word choice is very important to me. When the governor announced his TNReady “listening tour” earlier this week, I envisioned Tennessee teachers and parents finally having a real opportunity to share their experiences and frustrations with TNReady failures. I envisioned Gov. Haslam and department officials listening to teachers and parents – the real experts on this topic – about how the state could improve assessments in the best interest of all students.

What I did not envision was a closed-door, invitation-only, inconveniently scheduled, no-parents-allowed event that only created more frustration and distrust among teachers and parents. What happened in Knoxville today tells teachers and parents this administration doesn’t really want to listen at all. Instead, this event just shut down a school library and provided another example of TNReady creating more work and inconvenience for students and educators. Meaningful change in the best interest of our students will never happen if the state sticks with this dog-and-pony show model.

The good news is the governor has five more opportunities to get this right and provide a forum to truly listen to teachers and parents. Our students need those in positions of power to swallow their pride and have the tough conversations. Our students deserve better.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

When Gov Comes to Town

The first stop on Governor Bill Haslam’s TNReady “listening tour” is today at 3:00 PM local time at Halls Elementary School in Knoxville.

In the press release announcing the tour, the goals were stated as:

1. Engage in an open conversation about assessment and ways to improve administration;
2. Gather feedback that can inform a smooth delivery of state assessments this school year and beyond, including feedback on the selection of the state’s next assessment partner to be chosen later this school year;
3. Discuss how to better provide schools, educators, parents and students with meaningful and timely results from assessments; and
4. Distinguish assessment content from delivery in an effort to focus on the value assessments can provide.

Sounds great, right? An open conversation, gathering feedback, hearing from educators and parents about what’s needed to improve?

It might be of some value IF it were truly an open conversation. Here’s the problem: The event is at 3:00 PM when school is in session for many teachers in Knox County. That means, unless you teach at Halls, you likely can’t get there in time (it ends at 4:30) to weigh-in with your feedback.

At least the teachers and staff at Halls will be able to have a voice, right?

Nope. The principal at Halls and teachers there were told the event was “invitation only.” The Governor and Commissioner of Education have already decided who will be doing the talking.

Here’s more from a report on the ground describing what’s going down ahead of the PR event:

This is what my principal had to do today:

1)Spend his time going through the building with the Governor’s security detail instead of dealing with students.
2) Tell his teachers that they could not attend the TN Ready event.
3)Tell his teachers how to dress tomorrow
4) Have teachers….. who can’t attend (neither can he, evidently) set up tables and chairs for the attendees after school
5) Tell teachers that students could not use the library all day tomorrow (there goes effective plan time for 6 teachers)
6) Figure out a plan that would disrupt our dismissal as little as possible, since they insist on parking in the lot where parents circle around for the car rider line

So, Governor Haslam and Commissioner McQueen are coming to town with a pre-approved guest list and not, in fact, engaging in “an open conversation about assessment.”

 

For more on education politics and policy in Tennessee, follow @TNEdReport

Your investment keeps the education news coming!


 

TEA on TNReady Tour

Yesterday, Governor Bill Haslam announced a TNReady listening tour that will start Friday in Knoxville.

Today, Tennessee Education Association (TEA) President Beth Brown emailed the association’s members with a message about the tour:

There are many education accomplishments Gov. Bill Haslam can be proud of, including the consistent increases in state investment in our schools during his tenure. However, repeated failures of his administration’s high-stakes testing system are a major shortcoming in his education record.

Gov. Haslam’s announced “listening tour” is a positive step toward making state assessments something that we can all agree improves teaching and learning. If a stop is planned in your district, I encourage you to participate and share your honest experience with this testing system and your meaningful feedback for how to improve this for our students.

Assessments need to improve teaching practice and identify students who need additional assistance. We do that with mandatory benchmark testing, which allows differentiated instruction to more effectively meet students’ needs.

TNReady has not provided meaningful data to improve teaching practices or help students because of serious failures in administration, the lateness of data getting to teachers and schools, and major questions on what constitutes grade level-work. TEA supports high academic standards, but when proficiency rates of TNReady do not match other important measures like ACT scores and graduation rates, there is growing concern the test isn’t fair or measuring student achievement properly.

TEA hopes part of the dialogue includes transparency of state tests, where parents and teachers can gain access to a large portion of actual questions and answers in any given year. Publishing state tests allows teachers, parents and all Tennesseans to review how constructive responses are scored, what is being asked of students, and assurance that tests align with what schools are directed to teach.

I know how many demands you have on your time, but this is an important opportunity to ensure teachers’ voices are part of the discussion on how to improve testing in Tennessee. According to the governor’s website, the tour will begin this Friday, Aug. 24, in Knoxville, and be followed by stops planned for Hamilton County, Shelby County, Williamson County, Greene County and Gibson County. Specific locations and times are being finalized.

Thank you for your continued to commitment to Tennessee students.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

Listen With Your Ears

Today, Governor Bill Haslam announced a statewide “listening tour” to hear from educators about the challenges with TNReady and ways to make improvements going forward.

While I applaud the effort to listen to educators, it seems to be coming a little too late. It also seems the end goal has already been decided: Keep TNReady.

Interestingly, Commissioner McQueen has convened a “testing task force” several times during the years of TNReady. So far, no real improvements have come from these meetings.

It’s quite likely the educators on the front lines have some useful ideas about how to improve assessment in our state and I’m hopeful the next Governor will take those ideas into account.

It’s also worth noting that true listening requires significant effort and investment. As noted in the press release announcing the tour, preparation and implementation of this year’s TNReady will continue while the tour is being conducted.

Some have suggested hitting the pause button on TNReady this year and spending the year listening and working to improve assessment for the 2019-2020 school year. This would give the next Governor time to digest recommendations and move forward with improvements.

Here’s another interesting statement from the release:

“Tennessee’s unprecedented improvement in education is the result of high academic standards and an assessment that measures knowledge of those standards,” Haslam said. “Without aligned assessments, we don’t know where our students stand and where we need to improve. We finally have a test that is aligned to Tennessee’s strong academic standards, and I don’t want recent assessment delivery issues to cause us to lose sight of why we have these tests in the first place. Delivering the test without disruption is essential and we must get it right. I am confident this listening tour and process will inform the critical work ahead of us.”

The “unprecedented improvement” Haslam mentions is the whole “fastest-improving” line he so often uses in reference to the 2013 NAEP results. Of course, that happened BEFORE a single administration of TNReady. In fact, TNReady hadn’t even been invented at that point. Since 2013, Tennessee’s NAEP scores have (predictably) leveled off a bit.

In other words, if, as Haslam suggests, an aligned assessment (even one never successfully administered) is the key to “unprecedented” improvements for students, our test must not be that great. Or, maybe having an aligned assessment isn’t all it’s cracked up to be?

Let me go on record as saying I think some form of assessment of student progress is useful. I also believe (as my past writing indicates) that attaching student grades or teacher evaluations to such an assessment is of dubious value.

I appreciate what Governor Haslam is trying to do with this listening tour. While I certainly have some ideas about alternatives to the current testing regime, I think policymakers should take some time and just listen. Listen to the professionals — the teachers in the classrooms who are with students each and every day. Don’t listen with the outcome in mind, don’t listen while also building an implementation process for this year, just listen.

PERSONAL NOTE: This is my 800th post on TNEdReport — your investment helps make the work sustainable!

 

For more on education politics and policy in Tennessee, follow @TNEdReport


 

 

 

“No Confidence” in TNReady

Just days after members of the Knox County School Board took the Tennessee Department of Education to task for “incompetence” and an “abject failure” to measure student achievement or teacher performance, the Directors of the state’s two largest school districts, Nashville and Memphis, sent a letter to Education Commissioner Candice McQueen and Governor Bill Haslam stating they had “no confidence” in TNReady and asking the state to pause the test.

The letter, signed by Nashville’s Shawn Joseph and Shelby County’s Dorsey Hopson, says in part:

“We respectfully ask the State to hit the pause button on TNReady in order to allow the next Governor and Commissioner to convene a statewide working group of educators to sort out the myriad challenges in a statewide, collaborative conversation.”

The two leaders, whose districts represent 20 percent of all students in Tennessee, note:

“We are challenged to explain to teachers, parents, and students why they must accept the results of a test that has not been effectively deployed.”

The language from these two directors is the strongest yet from any district and the first to call for an outright stop to administration of the TNReady test while the state explores other options. Johnson City’s school board sent a proposal asking for a significant reduction in testing while Wilson County is exploring the possibility of administering a different test altogether. At the same time, Williamson County Director of Schools Mike Looney expressed concern about the poor administration of this year’s test.

It seems clear there is growing concern among educators about the continued use of TNReady. As Joseph and Hopson note, taxpayer resources have been invested in a test that is poorly implemented and yields suspect results. Taking their suggestion of a pause could give the state and a new Governor and Education Commissioner time to actually develop a process for administering an aligned assessment that does not disrupt instruction and does return useful, meaningful results to teachers, parents, and students.

Here’s the letter:

For more on education politics and policy in Tennessee, follow @TNEdReport


 

Support TNEdReport!

User Error

Dear Teachers,

It’s your fault.

It always is.

That’s essentially the sentiment expressed by the Tennessee Department of Education led by Candice McQueen after the latest round of problems, this time with portfolio evaluation of Pre-K/Kindergarten teachers.

The Tennessean has more:

Tennessee’s teacher union is blaming a vendor glitch for issues with some teachers’ low kindergarten and prekindergarten portfolio scores. But the state says the problems are due to user error.

“There was no error by our vendor. The vendor has double-checked all of the peer review scores and everything has been correctly and accurately reported,” according to a statement from Sara Gast, Tennessee Department of Education spokeswoman.

But Gast said Monday that portfolios are reviewed and scored by peers through a rubric. In some cases, Gast said, an educator mismatched students or standards, which made it impossible to score. In that case, she said, educators were given a score of 1.

The Department of Education, an entity with a serious allergy to the truth, is blaming teachers instead of accepting responsibility.

This is the same DOE that seemed surprised when May 15th arrived this year and portfolio reviewers hadn’t been provided guidance:

The initial portfolios were to be evaluated by May 15th. Then, the portfolios with score disputes go on to the “experts.”

Here’s the text of an email about that sent on May 15th:

Dear Educator,

Thank you for all your hard work! The portfolio scoring in the general pool concludes at 11:59pm tonight. The consensus review scoring begins tomorrow, Wednesday, May 16, 2018.

In the event that you were unable to meet your 10 portfolio review requirement (the same as 40 collections) AND you have demonstrated competence during the certification process and/or general pool scoring, you may receive additional portfolios to score. Reviewers who will receive additional portfolio submissions in this next phase and Expert Reviewers will be provided additional guidance to support the scoring process.

Thanks for all that you do! Please look for our next communication in 24 hours.

Here’s a follow-up email sent on May 16th:

Thanks again for your patience and support. We are still developing the guidance documents for the next phase of peer review. Our goal is to make sure you have the most comprehensive and best information to be successful. We appreciate your understanding and will communicate in the next 24-48 hours with updates.

This is also the same DOE that gave teachers one rubric for preparing their portfolios while providing reviewers with a rubric with significantly more difficult standards by which to assess those same portfolios.

Teachers received:

Reviewers were given:

This is the same DOE that set a June 15th deadline for returning scores, then moved it to June 30th, then released the scores last week — in late July.

By all means, let’s give Commissioner McQueen and her department the benefit of the doubt despite all the mishaps during her tenure at the helm.

In Candice McQueen’s world, it’s blame everyone all the time and it’s NEVER her fault or her responsibility.

Never fear, though, the state is now switching to a new platform for portfolio submissions. This means rolling out new training for teachers well after the academic year has started. For teachers in the few districts using Fine Arts Portfolios, this will be the third platform for submission in the last three years. Yes, each year is spent preparing for the portfolio collection and submission AND learning a new platform well into the school year.

If one wonders what Governor Haslam thinks of Tennessee’s teachers, let’s be clear: He’s been standing steadfastly behind Commissioner McQueen. In short, he doesn’t respect our teachers or the work they do.

Frankly, any lawmaker not demanding McQueen be held to account is complicit in this mistreatment of our teachers. The message is and has been clear: Everyone is accountable and responsible EXCEPT the Commissioner of Education. Teachers will continue to pay the price and must go along because no one with authority will stand up and make this stop.

I’d caution those sitting silently to note the teacher uprisings in places like West Virginia, Kentucky, Oklahoma, and Arizona. We may be inviting just this sort of direct action here.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

Haslam’s TNReady Pit

Chalkbeat has a story demonstrating just how out of touch outgoing Governor Bill Haslam is. The story details Haslam’s belief that tying teacher evaluation to TNReady results is a key element in Tennessee’s recent education success.

Here’s some truth: Over the past few years, Tennessee has seen high school graduation rates and average ACT scores climb while also seeing the number of students requiring remediation at state schools decline. All of that is encouraging. All of it happened in a climate where the TNReady test was unreliable and poorly administered. In other words, Tennessee’s testing system had nothing to do with student performance. All other indicators point to teachers getting the job done and students hitting ever higher marks.

Here’s more truth:

Does basing teacher evaluation on student test scores get results that impact student outcomes?

No.

That’s the conclusion from a years-long study funded by the Gates Foundation that included Memphis/Shelby County Schools.

It’s also worth noting that while Haslam touts the “fastest-improving” NAEP results from back in 2013, further evidence suggests the results then were likely an outlier.

Here’s more from Chalkbeat:

Gov. Bill Haslam says he had a “pit” in his stomach every day of Tennessee’s testing season this spring when a parade of technical problems vexed students and teachers in the bumpy transition to computerized exams.

He also worries that three straight years of frustrations with the state’s 3-year-old standardized assessment, TNReady, could unravel policies that he believes led to students’ gains on national tests.

“Do we really want to go back? Do we really want to go back to when Tennessee was in the 40s out of the states ranked 1 to 50?”  the outgoing Republican governor asked recently in an exclusive interview with Chalkbeat.

First, no serious policymaker is suggesting Tennessee adopt weaker or lower standards for students.

Second, as noted above, other significant indicators demonstrate Tennessee students are improving — even without a reliable annual test.

Third, Haslam’s “beliefs” about policies have not been tested on a statewide level – in part due to the failure of his own Administration to execute the tests. Haslam has allowed Commissioner of Education Candice McQueen to keep her job despite multiple testing failures with different vendors. In fact, Haslam joined McQueen in touting a “new” testing vendor that turned out to actually be the parent company of the current vendor.

More from Chalkbeat:

“Hopefully Tennessee and the new administration won’t have the same struggles we’ve had this year with testing. But there will be some struggles; there just are by the very nature of it,” he said. “I worry that the struggles will cause us to say, ‘OK, we give. We’re no longer going to have an evaluation that’s tied to an assessment.’

To this, I’d note that experts suggest no state has had a more tumultuous transition to online testing than Tennessee:

“I’m not aware of a state that has had a more troubled transition” to online testing, said Douglas A. Levin of the consulting group EdTech Strategies.

In terms of an evaluation tied to an assessment, even if TNReady had gone well, the results in the initial years would not be in any way valid for use in teacher evaluation. That’s because the nature of value-added assessment requires multiple years of similar testing in order to produce results that are even vaguely reliable predictors of teacher performance. Here’s a bit more on that:

Here’s what Lockwood and McCaffrey (2007) had to say in the Journal of Educational Measurement:

We find that the variation in estimated effects resulting from the different mathematics achievement measures is large relative to variation resulting from choices about model specification, and that the variation within teachers across achievement measures is larger than the variation across teachers. These results suggest that conclusions about individual teachers’ performance based on value-added models can be sensitive to the ways in which student achievement is measured.
These findings align with similar findings by Martineau (2006) and Schmidt et al (2005)
You get different results depending on the type of question you’re measuring.

The researchers tested various VAM models (including the type used in TVAAS) and found that teacher effect estimates changed significantly based on both what was being measured AND how it was measured.

And they concluded:

Our results provide a clear example that caution is needed when interpreting estimated teacher effects because there is the potential for teacher performance to depend on the skills that are measured by the achievement tests.

If you measure different skills, you get different results. That decreases (or eliminates) the reliability of those results. TNReady is measuring different skills in a different format than TCAP. It’s BOTH a different type of test AND a test on different standards. Any value-added comparison between the two tests is statistically suspect, at best. In the first year, such a comparison is invalid and unreliable. As more years of data become available, it may be possible to make some correlation between past TCAP results and TNReady scores.

But, TNReady hasn’t gone well. At all. It’s been so bad, the Department of Education has been unveiling a bunch of pie charts to demonstrate how they are attempting to correlate test scores and teacher evaluation. First, it went like this:

Second, this chart is crazy. A teacher’s growth score is factored on tests from three different years and three types of tests.

15% of the growth score comes from the old TCAP (the test given in 2014-15, b/c the 2015-16 test had some problems). Then, 10% comes from last year’s TNReady, which was given on paper and pencil. Last year was the first year of a full administration of TNReady, and there were a few problems with the data calculation. A final 10% comes from this year’s TNReady, given online.

So, you have data from the old test, a skipped year, data from last year’s test (the first time TNReady had truly been administered), and data from this year’s messed up test.

There is no way this creates any kind of valid score related to teacher performance. At all.

After teachers expressed outrage that the DOE was going to count this year’s scores in their evaluations, the legislature finally took action and passed legislation that said teachers could face “no adverse action” based on this year’s test results.

So, now the Department of Education has more pie charts and a lot of explanations:

What is included in teacher evaluation generally?

There are many factors that go into a teacher’s overall evaluation. One of those, the individual growth component (in gray in the charts in this document), is typically based on a three-year TVAAS measure if data is available. However, for the phase-in period there are two key items to note for the growth component:

• If the current single-year year growth score – in this case, 2017-18 data – provides the educator with a higher overall composite, it will be used as the full growth score.

• Additionally, if a teacher has 2017-18 TNReady data included in any part of their evaluation, they will be able to nullify their entire LOE this year.

What is included in teacher evaluation in 2017-18 for a teacher with 3 years of TVAAS data?

There are three composite options for this teacher:

• Option 1: TVAAS data from 2017-18 will be factored in at 10%, TVAAS data from 2016-17 will be factored in at 10% and TVAAS data from 2015-16 will be factored in at 15% if it benefits the teacher.

• Option 2: TVAAS data from 2017-18 and 2016-17 will be factored in at 35%.

• Option 3: TVAAS data from 2017-18 will be factored in at 35%. The option that results in the highest LOE for the teacher will be automatically applied. Since 2017-18 TNReady data is included in this calculation, this teacher may nullify his or her entire LOE this year.

And if you only have one or two years of TVAAS data or if you teach in a non-tested subject? Well, the key line continues to apply: Since 2017-18 TNReady data is included in this calculation, this teacher may nullify his or her entire LOE this year.

What does this mean? Well, it means you’d have a year with no evaluation score. Sounds fine, right? No. It’s not fine. In order to achieve tenure, a teacher must have consecutive years of evaluation scores at Level 4 or 5. But a year with no score at all means that teacher would then need to have TWO MORE YEARS of high scores in order to be tenure eligible. While it seems unlikely a teacher would choose to nullify their entire score if they achieved a high rank, it also seems only fair to allow that teacher to simply exclude the TNReady data and receive their LOE rating based on all the other factors that go into a TEAM rating.

But wait, excluding 2017-18 TNReady data is NOT an option provided. It’s either count it as 10%, count it as 35%, or nullify your entire LOE score. Doing so could certainly have an adverse impact on a teacher.

In short, the TNReady mess has made teacher evaluation a mess. Still, a host of indicators suggest Tennessee’s teachers are hitting the mark. One might conclude that tying a suspect teacher evaluation model to an unreliable test is, in fact, not the key to educational progress in our state. Unfortunately, Governor Bill Haslam has concluded the opposite.

For more on education politics and policy in Tennessee, follow @TNEdReport

Help keep the education news coming!


 

You’re Fired….uh, Hired!

The Chattanooga Times Free Press notes that Governor Bill Haslam and Education Commissioner Candice McQueen are considering ending the state’s relationship with Questar:

Gov. Bill Haslam said the state is conducting an independent review of its current contractor running the problem-plagued TNReady student testing system and, depending on its findings, the company could be out of the picture once its current contract ends in November.

The likely replacement for Questar is Education Testing Service (ETS):

McQueen said that in addition to the state’s third-party review of Questar’s operations, the state is already going to move “all of our test development and design” to Educational Testing Services, which she said has a “reputation for very high quality work.”

Sounds great, right? Firing the vendor that was baffled by hackers and dump trucks and replacing them with a group with a solid reputation.

Except for just one thing:

Education Testing Services, the global billion dollar nonprofit that administers more than 50 million tests (including the GRE and TOEFL) across the world, recently sealed an agreement to acquire Questar, a Minnesota-based for-profit testing service, for $127.5 million. According to the press release, Questar will become a separate for-profit subsidiary of ETS.

Questar offers what they describe as a “fresh and innovative” method of testing for grades 3-8—providing states with summative assessments, design support, scalable technological innovation, administrative help, scoring and reporting services.

Ok, so maybe ETS will step in and give its baby brother Questar some guidance going forward? Well:

The changes highlight a possible strategic shift for ETS whose reputation came under fire last year when the nonprofit had to pay $20.7 million dollars in damages and upgrades after multiple testing problems in Texas.

Let’s get this straight: Governor Haslam and Commissioner McQueen think no one in Tennessee understands Google? They are “firing” the company that messed up this year’s testing and hiring a new company that owns the old one and that also has a reputation for messing up statewide testing.

Solid move.

For more on education politics and policy in Tennessee, follow @TNEdReport

Keep the education news coming!


 

YOU’RE FIRED Rubber Stamp over a white background.

Outlier

Statisticians define an outlier as an observation point that is distant from other observations in a statistical analysis. Often, this occurs by chance. Additional modeling or deeper analysis (including more data, for example, or a longer range of data) can often correct for this. Outliers that are not the result of measurement error are often excluded from analysis about a data set.

Today, the 2017 results from the National Assessment of Educational Progress (NAEP) were released. This release made me think of a particular outlier.

Back in 2013, Tennessee demonstrated what some heralded as an incredible achievement on the NAEP. In fact, a press release from Governor Haslam at the time noted:

Gov. Bill Haslam today announced that Tennessee had the largest academic growth on the 2013 National Assessment of Educational Progress (NAEP) of any state, making Tennessee the fastest improving state in the nation. (emphasis added)

Those words — “fastest improving state in the nation” — have been uttered by Haslam and many political leaders in our state for years now. Often, this 2013 “success” is used as justification for “keeping our foot on the gas” and continuing an aggressive agenda of test-based accountability and teacher evaluation based on methods lacking validity.

Here’s what I wrote back in 2013 when these results were released:

Yes, Tennessee should celebrate its growth.  But policymakers should use caution when seeing the results from the last 2 years as a validation of any particular policy.  Long-term trends indicate that big gains are usually followed by steady maintenance. And, even with the improvement, Tennessee has a long way to go to be competitive with our peers. Additionally, education leaders should be concerned about the troubling widening of the rich/poor achievement gap  – an outcome at odds with stated policy goals and the fundamental principle of equal opportunity.

Two years later, when the 2015 results were released, I noted:

This year’s scores, in which Tennessee remained steady relative to the 2013 scores suggest, if anything, that the 2013 jump was likely an outlier. Had the 2013 gains been followed by gains in 2015 and again in 2017, more could be suggested. And frankly, it is my hope that we see gains (especially in reading) in 2017. But, it’s problematic to suggest that any specific reform or set of reforms caused the one-time jump we saw in 2013. Saying we are the fastest improving state in the nation over the last 4 years when we only saw a jump in 2013 is like saying we started the first quarter of a football game way behind, scored a bunch in the second quarter, (so we’re not as far behind), and then scored the same number of points in the third quarter. The result is we’re still behind and still have a long way to go.

Fast forward to today. The leveling off I suggested was likely back in 2013 has happened. In fact, take a look at this chart put out by the Tennessee Department of Education:

First, notice that between 2009 and 2011, Tennessee saw drops in 4th and 8th grade reading and 8th grade math. That helps explain the “big gains” seen in 2013. Next, note that in 4th and 8th grade reading and 4th grade math, our 2017 scores are lower than the 2013 scores. There’s that leveling off I suggested was likely. Finally, note that in 4th and 8th grade reading, the 2017 scores are very close to the 2009 scores. So much for “fastest-improving.”

Tennessee is four points below the national average in both 4th and 8th grade math. When it comes to reading, we are 3 points behind the national average in 4th grade and 5 points behind in 8th grade.

All of this to say: You can’t say you’re the fastest-improving state on NAEP based on one testing cycle. You also shouldn’t make long-term policy decisions based on seemingly fabulous results in one testing cycle. Since 2013, Tennessee has doubled down on reforms with what now appears to be little positive result. Instead, as Rep. Jeremy Faison said recently, our policies are “driving teachers crazy.”

Oh, and that new TNReady test has so far not been very ready.

But what about the good policy coming from this? You know, like Governor Haslam’s plan to make Tennessee the “fastest-improving state in teacher pay?”

About that:

Average teacher salaries in the United States improved by about 4% from the Haslam Promise until this year. Average teacher salaries in Tennessee improved by just under 2% over the same time period. So, since Bill Haslam promised teachers we’d be the fastest improving in teacher pay, we’ve actually been improving at a rate that’s half the national average. No, we’re not the slowest improving state in teacher pay, but we’re also not even improving at the average rate.

Surely, though, all this focus on education since the NAEP buzz has meant meaningful investment in schools, right? Well, no:

Tennessee earns a grade of F when it comes to funding effort compared to funding ability. The researchers looked at Gross State Product and Personal Income data in order to determine a state’s funding ability then looked at dollars spent per $1000 (in either GSP or Personal Income) to determine effort. Tennessee spends $29 on schools for every $1000 generated in Gross State Product. When it comes to Personal Income, Tennessee spends just $33 per $1000 of average personal income. That’s a rank of 42 in both.

Then, the report looks at wage competitiveness — how much teachers earn relative to similarly-educated professionals. I’ve written about this before, and Tennessee typically doesn’t do well in this regard.

Maybe we’ve taken a minute to get serious about investing in programs targeting struggling students? Also, no:

One possible solution would be to embed funding for school-level RTI2 specialists in the state’s funding formula for schools, the BEP. In fact, Rep. Joe Pitts offered legislation that would do just that last year. His plan would have added funding for three RTI2 specialists at each school for a total projected cost of $167 million. Commissioner McQueen was quick to shoot that idea down and came back this year with the funding proposal of $13 million, or one specialist per district. That’s only $154 million short of adopting a plan that would actually meet the needs of a program many suggest is an important way to improve educational outcomes for Tennessee students.

Maybe we are closing achievement gaps? Again, no.

Back in 2013, Tennessee students eligible for free/reduced lunch had an average NAEP reading score of 256 and scored 20 points below the non-eligible students. Now, that average score is 252 (four points worse) and 19 points below. For 4th grade, there’s a similar story, with free/reduced lunch eligible students scoring 25 points below their non-eligible peers this year. Four years ago, it was 26 points.

We’re not moving the needle. Our most vulnerable students continue to be left behind. Meanwhile, we hear nice words from top policymakers and see little actual result in terms of tangible improved investment in schools or any meaningful upgrade in teacher pay. Our testing system has yet to be proven.

Maybe now Tennessee policymakers will stop repeating the “fastest-improving” line and start doing the actual work of investing in and supporting our schools.

In any case, the next time you hear someone spout off that tired “fastest-improving” line, just yell back: OUTLIER!

For more on education politics and policy in Tennessee, follow @TNEdReport


 

Not So Fast

Back in October of 2013, Governor Bill Haslam tweeted: “Teachers are the key to classroom success and we’re seeing real progress.  We want to be the fastest improving state in teacher salaries.”

Then, by April of 2014, he promptly broke that promise, giving no raise at all in that budget year.

Since 2014, however, Haslam has found funds to modestly increase the BEP allocation for teacher compensation each year.

So, as we’re in the last year of Haslam’s term, I thought it’d be interesting to see if Tennessee has, indeed, been the fastest improving state in teacher salaries since 2013.

The short (and unsurprising) answer is: No.

Using state data compiled by the National Education Association, I looked at salaries across the states.

Average teacher salaries in the United States improved by about 4% from the Haslam Promise until this year. Average teacher salaries in Tennessee improved by just under 2% over the same time period. So, since Bill Haslam promised teachers we’d be the fastest improving in teacher pay, we’ve actually been improving at a rate that’s half the national average. No, we’re not the slowest improving state in teacher pay, but we’re also not even improving at the average rate.

By contrast, states like California and North Carolina have seen increases of over 9% over the same time period, making them the two fastest improving states. Vermont is close behind at just over a 7% total increase.

Let’s pull back and take a look at teacher pay since Bill Haslam has been Governor (starting in 2011).

Tennessee teacher pay has increased by 5.3% over that time. The national average over the same time period was 5.7%. So, for the entire time Bill Haslam has been Governor of Tennessee, teacher pay in our state has been improving at a rate below the national average.

So, maybe we can’t be the fastest improving in the nation in teacher pay. Could we be the fastest improving in the South? Nope. That title belongs to North Carolina.

Let’s look at these states: North Carolina, Virginia, South Carolina, Mississippi, Tennessee, Louisiana, Kentucky, Florida, Georgia, Arkansas, and Alabama.

Of these 11 states in the South, Tennessee ranks 9th in terms of average increase in teacher pay since the Haslam Promise. We’re not even at the average of these states, which is 3.3%. Since Bill Haslam promised Tennessee teachers their pay would increase faster than any other state in the nation, our teachers have seen their pay increase at half the rate of neighboring states.

That’s not very fast. At all.

For more on education politics and policy in Tennessee, follow @TNEdReport