Monthly Archives: November 2016

Posted on by

Doing the Right Thing

Shelby County’s Director of Schools Dorsey Hopson announced that all teachers will receive a three percent raise this year, not just those who meet certain scores on the state’s flawed value-added evaluation system.

More from Chalkbeat:

Hopson told the district’s educators in an email Thursday that they’ll see the raise reflected in their Nov. 18 paychecks. The pay hikes will be retroactive and will also go to librarians, counselors, instructional facilitators, coaches, social workers, physical/speech therapists and psychologists.

The decision came after Hopson learned that the district won’t receive the state’s testing data until December.

The decision by Hopson came about as a result of last year’s TNReady debacle. It also came in the same week that Knox County’s School Board asked the state for a waiver from included this year’s TNReady test results in student grades and teacher evaluations.

Hopson made the right decision — it is unfair to ask teachers to wait to receive pay raises because of the state’s mistakes with TNReady. It’s also unfair to use data from last year’s mess of a test administration to evaluate teachers. While I’ve expressed doubts about the usefulness of value-added data in evaluating teachers, even those who haven’t should acknowledge that using data from last year (or this year) is problematic.

Shelby County educators will all see a raise this year. The next question: Will the school board there join Knox County in requesting a waiver from using test data for students and teachers this year?

For more on education politics and policy in Tennessee, follow @TNEdReport


 

Posted on by

PET Talks TNReady

JC Bowman is the Executive Director of Professional Educators of Tennessee 

Tennessee has made a decade long effort to raise ours standards in public education, with mixed results and contentious debate among stakeholders and policymakers. We have high expectations for our students and our schools, which is a point all can agree upon. The appropriate role of assessment is still being debated. Getting it right is important. We need an accurate measure of student achievement and we must treat LEA’s and our educators fairly in this process.

We agree with the Tennessee Department of Education’s opinion that in previous transitions to more rigorous expectations, while scores dropped initially, they rose over the long term. We believe policymakers should continue to see Tennessee students perform better on national assessments.

One thing is certain: “This year’s scores cannot be compared to last year’s TCAP. And it is not practical to judge schools, students or educators by these results as we establish a new baseline with first year TNReady results” according to JC Bowman, executive director of Professional Educators of Tennessee.

Professional Educators of Tennessee would caution policymakers to be less concerned with these test scores, especially with the frustrations of last year’s TNReady experience. We should put more emphasis on the immeasurable impact that teachers may make on a child’s life. To that end we continue to work with the department to reduce the amount of standardized testing in our classrooms. And we are pleased that they have been proactive in that arena with us. TNReady is apparently on track to run smoothly this school year, and a lot of work is currently underway to ensure success. It is also important to know that the new testing vendor Questar, as well as the TNDOE, is making a genuine effort to work with classroom educators across the state to provide responsive customer service and high quality assessments.

In Tennessee, Questar is responsible for developing, administering, scoring and providing reports for the TNReady assessment program, including grades 3 through 8 State Summative Assessment in ELA and Math as well as State End-of-Course Assessments in ELA I, II, III; Algebra I and II; Geometry; and Integrated Math I, II, and III.

It has long been acknowledged that a strong public educational system is essential not only to the successful functioning of a democracy, but also to its future. That system must provide all children with an equitable and exceptional education that prepares them for college, career and life.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

Posted on by

Knox County Takes a Stand

Last night, the Knox County School Board voted 6-3 in favor of a resolution calling on the General Assembly and State Board of Education to waive the use of TCAP/TNReady data in student grades and teacher evaluations this year.

The move comes as the state prepares to administer the tests this year with a new vendor following last year’s TNReady disaster. The lack of a complete testing cycle last year plus the addition of a new vendor means this year is the first year of the new test.

The Board passed the resolution in spite of Governor Haslam warning against taking such a step.

In his warning, Haslam said:

“The results we’ve seen are not by accident in Tennessee, and I think you have to be really careful about doing anything that could cause that to back up,” Haslam said.

He added:

Haslam attributed that progress to three things, including tying standardized tests to teacher evaluations.

“It’s about raising our standards and expectations, it’s about having year-end assessments that match those standards and then I think it’s about having assessments that are part of teachers’ evaluations,” Haslam said. “I think that you have to have all of those for a recipe for success.”

Haslam can present no evidence for his claim about the use of student assessment in teacher evaluation. In fact, it’s worth noting that prior to 2008, Tennessee students achieved at a high level according to what were then the state standards. While the standards themselves were determined to need improvement, the point is teachers were helping students hit the designated mark.

Teachers were moving students forward at this time without evaluations tied to student test results. Policymakers set a mark for student performance, teachers worked to hit that mark and succeeded. Standards were raised in 2008, and since then, Tennessee has seen detectable growth in overall results, including some exciting news when NAEP results are released.

To suggest that a year without the use of TVAAS scores in teacher evaluations will cause a setback is to insult Tennessee’s teachers. As if they’ll just relax and not teach as hard.

Another argument raised against the resolution is that it will somehow absolve teachers and students of accountability.

Joe Sullivan reports in the Knoxville Mercury:

In an email to board members, [Interim Director of Schools Buzz] Thomas asserted that, “We need a good standardized test each year to tell us how we are doing compared to others across the state and the nation. We will achieve greatness not by shying away from this accountability but by embracing it.” And he fretted that, “This resolution puts that at risk. In short, it will divide us. Once again we could find ourselves in two disputing camps. The pro-achievement folks on the one side and the pro-teacher folks on the other.”

Right now, we don’t know if we have a good standardized test. Taking a year to get it right is important, especially in light of the frustrations of last year’s TNReady experience.

Of course, there’s no need for pro-achievement and pro-teacher folks to be divided into two camps, either. Tennessee can have a good, solid test that is an accurate measure of student achievement and also treat teachers fairly in the evaluation process.

To be clear, teachers aren’t asking for a waiver from all evaluation. They are asking for a fair, transparent evaluation system. TVAAS has long been criticized as neither. Even under the best of circumstances, TVAAS provides a minimal level of useful information about teacher performance.

Now, we’re shifting to a new test. That shift alone makes it impossible to achieve a valid value-added score. In fact, researchers in the Journal of Educational Measurement have said:

We find that the variation in estimated effects resulting from the different mathematics achievement measures is large relative to variation resulting from choices about model specification, and that the variation within teachers across achievement measures is larger than the variation across teachers. These results suggest that conclusions about individual teachers’ performance based on value-added models can be sensitive to the ways in which student achievement is measured.
These findings align with similar findings by Martineau (2006) and Schmidt et al (2005)
You get different results depending on the type of question you’re measuring.

The researchers tested various VAM models (including the type used in TVAAS) and found that teacher effect estimates changed significantly based on both what was being measured AND how it was measured.

Changing to a new type of test creates value-added uncertainty. That means results attributed to teachers based on a comparison of this year’s tests and the old tests will not yield valid results.

While insisting that districts use TVAAS in teacher evaluations this year, the state is also admitting it’s not quite sure how that will work.

From Sullivan’s story:

When asked how these determinations will be made, a spokesperson for the state Department of Education acknowledges that a different methodology will have to be employed and says that, “we are still working with various statisticians and experts to determine the exact methodology we will use this year.”

Why not at take at least a year, be sure there’s a test that works, and then build a model based on that? What harm would come from giving teachers and students a year with a test that’s just a test? Moreover, the best education researchers have already warned that testing transitions create value-added bumps. Why not avoid the bumps and work to create an evaluation system that is fair and transparent?

Knox County has taken a stand. We’ll soon see if others follow suit. And if the state is listening.

For more on education politics and policy in Tennessee, follow @TNEdReport