Affirmed

The Maury County School Board by a 10-1 vote affirmed the position of Director of Schools Chris Marczak who has called for a halt to TNReady this year and a move to replace the state exam with the ACT suite of assessments.

The Columbia Daily Herald reports:

During the board’s regular meeting this week, representatives voted 10-1 to send a letter calling for the halt of TNReady testing. Former school board chairman David Bates cast the sole dissenting vote.

The letter, penned by Maury County Public Schools Superintendent Chris Marczak, asks the state to end TNReady testing, requests schools be held harmless in the Tennessee Value-Added Assessment System (TVASS) and calls for the ACT to be made the standardized testing tool for high school juniors and seniors by the year 2020.

Marczak called the vote an answer to an ongoing rally cry in Maury County.

“This is a huge affirmation for our educators who are working to do the best for our students,” Marczak told The Daily Herald. “To me, it is an affirmation for the community and the families and the students. I want to commend the school board for being forward thinking. They really took a stance and I am really impressed with their leadership.”

The School Board’s position drew immediate praise from the Maury County Education Association, the local affiliate of the Tennessee Education Association:

“After years of failure, confidence and trust in the state testing system is at an all-time low,” the statement reads. “There are calls to suspend testing completely and allow a reset, recognizing an entire generation of students have known nothing but glitches and disappointment.”

The TNReady failures have recently been the subject of an exchange of letters among directors, lawmakers, and Commissioner of Education Candice McQueen.

Additionally, Governor Bill Haslam and McQueen are currently on a statewide tour talking to invited guests about TNReady.

Stay tuned to see if additional districts join Maury County in pushing for a reset on testing and, ultimately, a move to a different test altogether.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

Students Will Suffer

Knox County School Board member Jennifer Owen offers an inside view of how Governor Haslam’s “listening tour” went down in Knoxville.

Her conclusion gets to the heart of why Tennessee education policy is where it is today:

While some of our legislators, in this ELECTION SEASON, are suddenly declaring that they disagree with all of this, we know that they have not stopped it, after EIGHT YEARS.  And if they haven’t stopped this after EIGHT YEARS, they sure as hell aren’t going to stop it just because there is a new governor in town.

As long as we keep these legislators, Tennessee students will continue to suffer, while parents, teachers, and the public are lied to, regarding trumped up visions of “successes” used to make the governor look like he has actually done something while in office.

If we keep doing the same thing, we’ll keep getting the same results. If we keep sending lawmakers to Nashville who support TNReady or get behind minor changes around the edges, we won’t see anything new in 2019 or beyond.

Owen was in the meeting in Knoxville and her full description of how it went down is worth a read.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

Graphs!

I’ve written a lot about school funding and teacher pay in Tennessee. About how our state pays teachers at a discount rate and hasn’t really been improving that much.

Now, I’ve found a couple of helpful graphs to demonstrate that in spite of all the rhetoric you might hear from Governor Haslam and some legislators, Tennessee still has a long way to go in order to be making proper investments in our schools.

First, we’ll look at per pupil spending in inflation-adjusted (2016) dollars:

To translate, in 2010 (the year before Bill Haslam became Governor), Tennessee spent an average of $8877 per student in 2016 dollars. In 2016 (the most recent data cited), that total was $8810. So, we’re effectively spending slightly less per student now than in 2010. The graph indicates that Tennessee spending per student isn’t really growing, instead it is stagnating. Further evidence can be found in noting that in 2014, Tennessee ranked 43rd in the nation in spending per student. In 2015, that ranking dropped to 44th. 2016? Still 44th.

Here’s the graph that shows per pupil spending by state for 2016:

Tennessee is near the bottom. The data shows we’re not improving. At least not faster than other states. I’ve written about how we’re not the fastest-improving in teacher pay, in spite of Bill Haslam’s promise to make it so:

Average teacher salaries in the United States improved by about 4% from the Haslam Promise until this year. Average teacher salaries in Tennessee improved by just under 2% over the same time period. So, since Bill Haslam promised teachers we’d be the fastest improving in teacher pay, we’ve actually been improving at a rate that’s half the national average. No, we’re not the slowest improving state in teacher pay, but we’re also not even improving at the average rate.

School spending doesn’t happen in a vacuum — it’s not like when Tennessee spends, other states stop. So, to catch up, we have to do more. Or, we have to decide that remaining 43rd or 44th in investment per student is where we should be.

 

For more on education politics and policy in Tennessee, follow @TNEdReport


 

 

Scheduling Matters

Governor Bill Haslam held his first of six TNReady listening meetings in Knoxville last week. While the tour was initially billed as an open discussion of challenges and ways to improve the state test, the timing of the event and an approved guest list raised questions about the event.

The Knoxville News Sentinel reports Haslam saying he did not intend to keep anyone out of the meeting, despite holding it at 3:00 PM when most teachers in Knox County are still required to be at work.

Knox County School Board Chair Patty Bounds noted:

“I was like, I can’t even imagine what they’re thinking or if they’re that out of touch,” Bounds said. “(Because of their) contract teachers can’t leave their building until 3:15 and for middle and high school, it’s later than that.”

Bounds questioned how the state could rationalize hand-picking the teachers allowed in the meeting Friday if they wanted a true listening tour.

The Directors of Schools in Nashville and Memphis have indicated support for pausing TNReady while the state transitions to a new Governor. This would allow the new Commissioner of Education time to digest feedback and work with a testing vendor to improve delivery.

In a similar vein, the Director of Schools in Maury County has suggested moving to the ACT suite of assessments and Wilson County is said to be exploring legislative options to move beyond the state-mandated test.

Despite criticism over the timing and invitation list for his first listening tour stop, Haslam’s second stop will be at Soddy-Daisy High School in Hamilton County on Tuesday, August 28th at 3:30 PM.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

Not Really Listening

Governor Bill Haslam was in Knoxville today on his “listening tour.”

Here’s what TEA President Beth Brown had to say about how the event unfolded:

A message from TEA President Beth Brown:

I am a high school English teacher, so word choice is very important to me. When the governor announced his TNReady “listening tour” earlier this week, I envisioned Tennessee teachers and parents finally having a real opportunity to share their experiences and frustrations with TNReady failures. I envisioned Gov. Haslam and department officials listening to teachers and parents – the real experts on this topic – about how the state could improve assessments in the best interest of all students.

What I did not envision was a closed-door, invitation-only, inconveniently scheduled, no-parents-allowed event that only created more frustration and distrust among teachers and parents. What happened in Knoxville today tells teachers and parents this administration doesn’t really want to listen at all. Instead, this event just shut down a school library and provided another example of TNReady creating more work and inconvenience for students and educators. Meaningful change in the best interest of our students will never happen if the state sticks with this dog-and-pony show model.

The good news is the governor has five more opportunities to get this right and provide a forum to truly listen to teachers and parents. Our students need those in positions of power to swallow their pride and have the tough conversations. Our students deserve better.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

When Gov Comes to Town

The first stop on Governor Bill Haslam’s TNReady “listening tour” is today at 3:00 PM local time at Halls Elementary School in Knoxville.

In the press release announcing the tour, the goals were stated as:

1. Engage in an open conversation about assessment and ways to improve administration;
2. Gather feedback that can inform a smooth delivery of state assessments this school year and beyond, including feedback on the selection of the state’s next assessment partner to be chosen later this school year;
3. Discuss how to better provide schools, educators, parents and students with meaningful and timely results from assessments; and
4. Distinguish assessment content from delivery in an effort to focus on the value assessments can provide.

Sounds great, right? An open conversation, gathering feedback, hearing from educators and parents about what’s needed to improve?

It might be of some value IF it were truly an open conversation. Here’s the problem: The event is at 3:00 PM when school is in session for many teachers in Knox County. That means, unless you teach at Halls, you likely can’t get there in time (it ends at 4:30) to weigh-in with your feedback.

At least the teachers and staff at Halls will be able to have a voice, right?

Nope. The principal at Halls and teachers there were told the event was “invitation only.” The Governor and Commissioner of Education have already decided who will be doing the talking.

Here’s more from a report on the ground describing what’s going down ahead of the PR event:

This is what my principal had to do today:

1)Spend his time going through the building with the Governor’s security detail instead of dealing with students.
2) Tell his teachers that they could not attend the TN Ready event.
3)Tell his teachers how to dress tomorrow
4) Have teachers….. who can’t attend (neither can he, evidently) set up tables and chairs for the attendees after school
5) Tell teachers that students could not use the library all day tomorrow (there goes effective plan time for 6 teachers)
6) Figure out a plan that would disrupt our dismissal as little as possible, since they insist on parking in the lot where parents circle around for the car rider line

So, Governor Haslam and Commissioner McQueen are coming to town with a pre-approved guest list and not, in fact, engaging in “an open conversation about assessment.”

 

For more on education politics and policy in Tennessee, follow @TNEdReport

Your investment keeps the education news coming!


 

TEA on TNReady Tour

Yesterday, Governor Bill Haslam announced a TNReady listening tour that will start Friday in Knoxville.

Today, Tennessee Education Association (TEA) President Beth Brown emailed the association’s members with a message about the tour:

There are many education accomplishments Gov. Bill Haslam can be proud of, including the consistent increases in state investment in our schools during his tenure. However, repeated failures of his administration’s high-stakes testing system are a major shortcoming in his education record.

Gov. Haslam’s announced “listening tour” is a positive step toward making state assessments something that we can all agree improves teaching and learning. If a stop is planned in your district, I encourage you to participate and share your honest experience with this testing system and your meaningful feedback for how to improve this for our students.

Assessments need to improve teaching practice and identify students who need additional assistance. We do that with mandatory benchmark testing, which allows differentiated instruction to more effectively meet students’ needs.

TNReady has not provided meaningful data to improve teaching practices or help students because of serious failures in administration, the lateness of data getting to teachers and schools, and major questions on what constitutes grade level-work. TEA supports high academic standards, but when proficiency rates of TNReady do not match other important measures like ACT scores and graduation rates, there is growing concern the test isn’t fair or measuring student achievement properly.

TEA hopes part of the dialogue includes transparency of state tests, where parents and teachers can gain access to a large portion of actual questions and answers in any given year. Publishing state tests allows teachers, parents and all Tennesseans to review how constructive responses are scored, what is being asked of students, and assurance that tests align with what schools are directed to teach.

I know how many demands you have on your time, but this is an important opportunity to ensure teachers’ voices are part of the discussion on how to improve testing in Tennessee. According to the governor’s website, the tour will begin this Friday, Aug. 24, in Knoxville, and be followed by stops planned for Hamilton County, Shelby County, Williamson County, Greene County and Gibson County. Specific locations and times are being finalized.

Thank you for your continued to commitment to Tennessee students.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

Listen With Your Ears

Today, Governor Bill Haslam announced a statewide “listening tour” to hear from educators about the challenges with TNReady and ways to make improvements going forward.

While I applaud the effort to listen to educators, it seems to be coming a little too late. It also seems the end goal has already been decided: Keep TNReady.

Interestingly, Commissioner McQueen has convened a “testing task force” several times during the years of TNReady. So far, no real improvements have come from these meetings.

It’s quite likely the educators on the front lines have some useful ideas about how to improve assessment in our state and I’m hopeful the next Governor will take those ideas into account.

It’s also worth noting that true listening requires significant effort and investment. As noted in the press release announcing the tour, preparation and implementation of this year’s TNReady will continue while the tour is being conducted.

Some have suggested hitting the pause button on TNReady this year and spending the year listening and working to improve assessment for the 2019-2020 school year. This would give the next Governor time to digest recommendations and move forward with improvements.

Here’s another interesting statement from the release:

“Tennessee’s unprecedented improvement in education is the result of high academic standards and an assessment that measures knowledge of those standards,” Haslam said. “Without aligned assessments, we don’t know where our students stand and where we need to improve. We finally have a test that is aligned to Tennessee’s strong academic standards, and I don’t want recent assessment delivery issues to cause us to lose sight of why we have these tests in the first place. Delivering the test without disruption is essential and we must get it right. I am confident this listening tour and process will inform the critical work ahead of us.”

The “unprecedented improvement” Haslam mentions is the whole “fastest-improving” line he so often uses in reference to the 2013 NAEP results. Of course, that happened BEFORE a single administration of TNReady. In fact, TNReady hadn’t even been invented at that point. Since 2013, Tennessee’s NAEP scores have (predictably) leveled off a bit.

In other words, if, as Haslam suggests, an aligned assessment (even one never successfully administered) is the key to “unprecedented” improvements for students, our test must not be that great. Or, maybe having an aligned assessment isn’t all it’s cracked up to be?

Let me go on record as saying I think some form of assessment of student progress is useful. I also believe (as my past writing indicates) that attaching student grades or teacher evaluations to such an assessment is of dubious value.

I appreciate what Governor Haslam is trying to do with this listening tour. While I certainly have some ideas about alternatives to the current testing regime, I think policymakers should take some time and just listen. Listen to the professionals — the teachers in the classrooms who are with students each and every day. Don’t listen with the outcome in mind, don’t listen while also building an implementation process for this year, just listen.

PERSONAL NOTE: This is my 800th post on TNEdReport — your investment helps make the work sustainable!

 

For more on education politics and policy in Tennessee, follow @TNEdReport


 

 

 

User Error

Dear Teachers,

It’s your fault.

It always is.

That’s essentially the sentiment expressed by the Tennessee Department of Education led by Candice McQueen after the latest round of problems, this time with portfolio evaluation of Pre-K/Kindergarten teachers.

The Tennessean has more:

Tennessee’s teacher union is blaming a vendor glitch for issues with some teachers’ low kindergarten and prekindergarten portfolio scores. But the state says the problems are due to user error.

“There was no error by our vendor. The vendor has double-checked all of the peer review scores and everything has been correctly and accurately reported,” according to a statement from Sara Gast, Tennessee Department of Education spokeswoman.

But Gast said Monday that portfolios are reviewed and scored by peers through a rubric. In some cases, Gast said, an educator mismatched students or standards, which made it impossible to score. In that case, she said, educators were given a score of 1.

The Department of Education, an entity with a serious allergy to the truth, is blaming teachers instead of accepting responsibility.

This is the same DOE that seemed surprised when May 15th arrived this year and portfolio reviewers hadn’t been provided guidance:

The initial portfolios were to be evaluated by May 15th. Then, the portfolios with score disputes go on to the “experts.”

Here’s the text of an email about that sent on May 15th:

Dear Educator,

Thank you for all your hard work! The portfolio scoring in the general pool concludes at 11:59pm tonight. The consensus review scoring begins tomorrow, Wednesday, May 16, 2018.

In the event that you were unable to meet your 10 portfolio review requirement (the same as 40 collections) AND you have demonstrated competence during the certification process and/or general pool scoring, you may receive additional portfolios to score. Reviewers who will receive additional portfolio submissions in this next phase and Expert Reviewers will be provided additional guidance to support the scoring process.

Thanks for all that you do! Please look for our next communication in 24 hours.

Here’s a follow-up email sent on May 16th:

Thanks again for your patience and support. We are still developing the guidance documents for the next phase of peer review. Our goal is to make sure you have the most comprehensive and best information to be successful. We appreciate your understanding and will communicate in the next 24-48 hours with updates.

This is also the same DOE that gave teachers one rubric for preparing their portfolios while providing reviewers with a rubric with significantly more difficult standards by which to assess those same portfolios.

Teachers received:

Reviewers were given:

This is the same DOE that set a June 15th deadline for returning scores, then moved it to June 30th, then released the scores last week — in late July.

By all means, let’s give Commissioner McQueen and her department the benefit of the doubt despite all the mishaps during her tenure at the helm.

In Candice McQueen’s world, it’s blame everyone all the time and it’s NEVER her fault or her responsibility.

Never fear, though, the state is now switching to a new platform for portfolio submissions. This means rolling out new training for teachers well after the academic year has started. For teachers in the few districts using Fine Arts Portfolios, this will be the third platform for submission in the last three years. Yes, each year is spent preparing for the portfolio collection and submission AND learning a new platform well into the school year.

If one wonders what Governor Haslam thinks of Tennessee’s teachers, let’s be clear: He’s been standing steadfastly behind Commissioner McQueen. In short, he doesn’t respect our teachers or the work they do.

Frankly, any lawmaker not demanding McQueen be held to account is complicit in this mistreatment of our teachers. The message is and has been clear: Everyone is accountable and responsible EXCEPT the Commissioner of Education. Teachers will continue to pay the price and must go along because no one with authority will stand up and make this stop.

I’d caution those sitting silently to note the teacher uprisings in places like West Virginia, Kentucky, Oklahoma, and Arizona. We may be inviting just this sort of direct action here.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

Haslam’s TNReady Pit

Chalkbeat has a story demonstrating just how out of touch outgoing Governor Bill Haslam is. The story details Haslam’s belief that tying teacher evaluation to TNReady results is a key element in Tennessee’s recent education success.

Here’s some truth: Over the past few years, Tennessee has seen high school graduation rates and average ACT scores climb while also seeing the number of students requiring remediation at state schools decline. All of that is encouraging. All of it happened in a climate where the TNReady test was unreliable and poorly administered. In other words, Tennessee’s testing system had nothing to do with student performance. All other indicators point to teachers getting the job done and students hitting ever higher marks.

Here’s more truth:

Does basing teacher evaluation on student test scores get results that impact student outcomes?

No.

That’s the conclusion from a years-long study funded by the Gates Foundation that included Memphis/Shelby County Schools.

It’s also worth noting that while Haslam touts the “fastest-improving” NAEP results from back in 2013, further evidence suggests the results then were likely an outlier.

Here’s more from Chalkbeat:

Gov. Bill Haslam says he had a “pit” in his stomach every day of Tennessee’s testing season this spring when a parade of technical problems vexed students and teachers in the bumpy transition to computerized exams.

He also worries that three straight years of frustrations with the state’s 3-year-old standardized assessment, TNReady, could unravel policies that he believes led to students’ gains on national tests.

“Do we really want to go back? Do we really want to go back to when Tennessee was in the 40s out of the states ranked 1 to 50?”  the outgoing Republican governor asked recently in an exclusive interview with Chalkbeat.

First, no serious policymaker is suggesting Tennessee adopt weaker or lower standards for students.

Second, as noted above, other significant indicators demonstrate Tennessee students are improving — even without a reliable annual test.

Third, Haslam’s “beliefs” about policies have not been tested on a statewide level – in part due to the failure of his own Administration to execute the tests. Haslam has allowed Commissioner of Education Candice McQueen to keep her job despite multiple testing failures with different vendors. In fact, Haslam joined McQueen in touting a “new” testing vendor that turned out to actually be the parent company of the current vendor.

More from Chalkbeat:

“Hopefully Tennessee and the new administration won’t have the same struggles we’ve had this year with testing. But there will be some struggles; there just are by the very nature of it,” he said. “I worry that the struggles will cause us to say, ‘OK, we give. We’re no longer going to have an evaluation that’s tied to an assessment.’

To this, I’d note that experts suggest no state has had a more tumultuous transition to online testing than Tennessee:

“I’m not aware of a state that has had a more troubled transition” to online testing, said Douglas A. Levin of the consulting group EdTech Strategies.

In terms of an evaluation tied to an assessment, even if TNReady had gone well, the results in the initial years would not be in any way valid for use in teacher evaluation. That’s because the nature of value-added assessment requires multiple years of similar testing in order to produce results that are even vaguely reliable predictors of teacher performance. Here’s a bit more on that:

Here’s what Lockwood and McCaffrey (2007) had to say in the Journal of Educational Measurement:

We find that the variation in estimated effects resulting from the different mathematics achievement measures is large relative to variation resulting from choices about model specification, and that the variation within teachers across achievement measures is larger than the variation across teachers. These results suggest that conclusions about individual teachers’ performance based on value-added models can be sensitive to the ways in which student achievement is measured.
These findings align with similar findings by Martineau (2006) and Schmidt et al (2005)
You get different results depending on the type of question you’re measuring.

The researchers tested various VAM models (including the type used in TVAAS) and found that teacher effect estimates changed significantly based on both what was being measured AND how it was measured.

And they concluded:

Our results provide a clear example that caution is needed when interpreting estimated teacher effects because there is the potential for teacher performance to depend on the skills that are measured by the achievement tests.

If you measure different skills, you get different results. That decreases (or eliminates) the reliability of those results. TNReady is measuring different skills in a different format than TCAP. It’s BOTH a different type of test AND a test on different standards. Any value-added comparison between the two tests is statistically suspect, at best. In the first year, such a comparison is invalid and unreliable. As more years of data become available, it may be possible to make some correlation between past TCAP results and TNReady scores.

But, TNReady hasn’t gone well. At all. It’s been so bad, the Department of Education has been unveiling a bunch of pie charts to demonstrate how they are attempting to correlate test scores and teacher evaluation. First, it went like this:

Second, this chart is crazy. A teacher’s growth score is factored on tests from three different years and three types of tests.

15% of the growth score comes from the old TCAP (the test given in 2014-15, b/c the 2015-16 test had some problems). Then, 10% comes from last year’s TNReady, which was given on paper and pencil. Last year was the first year of a full administration of TNReady, and there were a few problems with the data calculation. A final 10% comes from this year’s TNReady, given online.

So, you have data from the old test, a skipped year, data from last year’s test (the first time TNReady had truly been administered), and data from this year’s messed up test.

There is no way this creates any kind of valid score related to teacher performance. At all.

After teachers expressed outrage that the DOE was going to count this year’s scores in their evaluations, the legislature finally took action and passed legislation that said teachers could face “no adverse action” based on this year’s test results.

So, now the Department of Education has more pie charts and a lot of explanations:

What is included in teacher evaluation generally?

There are many factors that go into a teacher’s overall evaluation. One of those, the individual growth component (in gray in the charts in this document), is typically based on a three-year TVAAS measure if data is available. However, for the phase-in period there are two key items to note for the growth component:

• If the current single-year year growth score – in this case, 2017-18 data – provides the educator with a higher overall composite, it will be used as the full growth score.

• Additionally, if a teacher has 2017-18 TNReady data included in any part of their evaluation, they will be able to nullify their entire LOE this year.

What is included in teacher evaluation in 2017-18 for a teacher with 3 years of TVAAS data?

There are three composite options for this teacher:

• Option 1: TVAAS data from 2017-18 will be factored in at 10%, TVAAS data from 2016-17 will be factored in at 10% and TVAAS data from 2015-16 will be factored in at 15% if it benefits the teacher.

• Option 2: TVAAS data from 2017-18 and 2016-17 will be factored in at 35%.

• Option 3: TVAAS data from 2017-18 will be factored in at 35%. The option that results in the highest LOE for the teacher will be automatically applied. Since 2017-18 TNReady data is included in this calculation, this teacher may nullify his or her entire LOE this year.

And if you only have one or two years of TVAAS data or if you teach in a non-tested subject? Well, the key line continues to apply: Since 2017-18 TNReady data is included in this calculation, this teacher may nullify his or her entire LOE this year.

What does this mean? Well, it means you’d have a year with no evaluation score. Sounds fine, right? No. It’s not fine. In order to achieve tenure, a teacher must have consecutive years of evaluation scores at Level 4 or 5. But a year with no score at all means that teacher would then need to have TWO MORE YEARS of high scores in order to be tenure eligible. While it seems unlikely a teacher would choose to nullify their entire score if they achieved a high rank, it also seems only fair to allow that teacher to simply exclude the TNReady data and receive their LOE rating based on all the other factors that go into a TEAM rating.

But wait, excluding 2017-18 TNReady data is NOT an option provided. It’s either count it as 10%, count it as 35%, or nullify your entire LOE score. Doing so could certainly have an adverse impact on a teacher.

In short, the TNReady mess has made teacher evaluation a mess. Still, a host of indicators suggest Tennessee’s teachers are hitting the mark. One might conclude that tying a suspect teacher evaluation model to an unreliable test is, in fact, not the key to educational progress in our state. Unfortunately, Governor Bill Haslam has concluded the opposite.

For more on education politics and policy in Tennessee, follow @TNEdReport

Help keep the education news coming!