Validating the Invalid?

The Tennessee House of Representatives passed legislation today (HB 108) that makes changes to current practice in teacher evaluation as Tennessee transitions to its new testing regime, TNReady.

The changes adjust the percentage of a teacher’s evaluation that is dependent on TVAAS scores to 10% next year, 20% the following year, and back to the current 35% by the 2017-18 academic year.

This plan is designed to allow for a transition period to the new TNReady tests which will include constructed-response questions and be aligned to the so-called Tennessee standards which match up with the Common Core State Standards.

Here’s the problem: There is no statistically valid way to predict expected growth on a new test based on the historic results of TCAP. First, the new test has (supposedly) not been fully designed. Second, the test is in a different format. It’s both computer-based and it contains constructed-response questions. That is, students must write-out answers and/or demonstrate their work.

Since Tennessee has never had a test like this, it’s impossible to predict growth at all. Not even with 10% confidence. Not with any confidence. It is the textbook definition of comparing apples to oranges.

Clearly, legislators feel like at the very least, this is an improvement. A reasonable accommodation to teachers as our state makes a transition.

But, how is using 10% of an invalid number a good thing? Should any part of a teacher’s evaluation be made up of a number that reveals nothing at all about that teacher’s performance?

While value-added data alone is a relatively poor predictor of teacher performance, the value-added estimate used next year is especially poor because it is not at all valid.

But, don’t just take my word for it. Researchers studying the validity of value-added measures asked whether value-added gave different results depending on the type of question asked. Particularly relevant now because Tennessee is shifting to a new test with different types of questions.

Here’s what Lockwood and McCaffrey (2007) had to say in the Journal of Educational Measurement:

We find that the variation in estimated effects resulting from the different mathematics achievement measures is large relative to variation resulting from choices about model specification, and that the variation within teachers across achievement measures is larger than the variation across teachers. These results suggest that conclusions about individual teachers’ performance based on value-added models can be sensitive to the ways in which student achievement is measured.
These findings align with similar findings by Martineau (2006) and Schmidt et al (2005)
You get different results depending on the type of question you’re measuring.

The researchers tested various VAM models (including the type used in TVAAS) and found that teacher effect estimates changed significantly based on both what was being measured AND how it was measured. 

And they concluded:

Our results provide a clear example that caution is needed when interpreting estimated teacher effects because there is the potential for teacher performance to depend on the skills that are measured by the achievement tests.

If you measure different skills, you get different results. That decreases (or eliminates) the reliability of those results. TNReady is measuring different skills in a different format than TCAP. It’s BOTH a different type of test AND a test on different standards. Any value-added comparison between the two tests is statistically suspect, at best. In the first year, such a comparison is invalid and unreliable. As more years of data become available, it may be possible to make some correlation between past TCAP results and TNReady scores.

Or, if the state is determined to use growth scores (and wants to use them with accuracy), they will wait several years and build completely new growth models based on TNReady alone. At least three years of data would be needed in order to build such a model.

It seems likely that the Senate will follow the House’s lead on Monday and overwhelmingly support the proposed evaluation changes. But in doing so, they should be asking themselves if it’s really ok to base any part of a teacher’s evaluation on numbers that reliably predict nothing.

More on Value-Added:

Real World Harms of Value-Added Data

Struggles with Value-Added Data

 

Is THAT even legal?

That’s the question the Tennessee Education Association is asking about the use of value-added data (TVAAS) in teacher evaluations.

The TEA, joining with the National Education Association, has filed a lawsuit challenging the constitutionality of Tennessee’s use of TVAAS data in teacher evaluations.

According to a press release, TEA is specifically concerned about teachers who receive value-added scores based on students they have never taught. A significant number of Tennessee teachers currently receive a portion of their evaluation score based on TVAAS scores from school-wide or other data, meaning teachers are graded based on students they’ve never taught.

The release states:

More than half of the public school teachers in Tennessee receive evaluations that are based substantially on standardized test scores of students in subjects they do not teach. The lawsuit seeks relief for those teachers from the arbitrary and irrational practice of measuring their effectiveness with statistical estimates based on standardized test scores from students they do not teach and may have never met. 

While Governor Haslam is proposing that the legislature reduce the impact of TVAAS scores on teacher evaluations during the state’s transition to new standardized tests, his proposal does not address the issues of statistical validity with the transition. There is no way to determine how TCAP scores will interface with the scores from a test that has not even been developed yet. To hold teachers accountable for data generated in such an unreliable fashion is not only statistically suspect, it’s disrespectful.

Finally, it’s worth noting that value-added data doesn’t do much in terms of differentiating teacher performance. Of course, even if it did, holding teachers accountable for students they don’t teach defies logic.

For more on education politics and policy in Tennessee, follow @TNEdReport

 

Do Your Job, Get Less Money

Over at Bluff City Ed, there’s an article analyzing the new pay scale for teachers in Shelby County Schools. The scale is weighted toward TVAAS data and the evaluation rubric, which rates teachers on a scale of 1-5, 1 being significantly below expectations and 5 being significantly above. A teacher earning a 3 “meets expectations.” That means they are doing their job and doing it well.

Jon does a nice job of breaking down what it means to “meet expectations.” But, here’s the problem he’s highlighting:  Teachers who meet expectations in the new system would see a reduction in their annual step raise. That’s right: They do their job and meet the district’s performance expectations and yet earn LESS than they would with the current pay system.

Jon puts it this way:

But what the district outlines as meeting expectations exemplifies a hardworking and effective educator who is making real progress with their community, school and students. If a teacher is doing all these things, I believe that they should be in line for a yearly raise, not a cut. At its core, this new merit pay system devalues our teachers who fulfill their professional duties in every conceivable way.

I would add to this argument that to the extent that the new pay scale is based on a flawed TVAAS system which provides minimal differentiation among teachers, it is also flawed. Value-added data does not reveal much about the differences in teacher performance. As such, this data shouldn’t weigh heavily (or at all) in performance pay schemes.

Systems like Shelby County may be better served by a pay scale that starts teachers at a high salary and rewards them well over time. Increasing pay overall creates the type of economic incentives that both attract strong teachers and encourage school systems to develop talent and counsel out low performers.

Shelby County can certainly do more to attract and retain strong teaching talent. But the new pay scale is the wrong way to achieve that goal.

For more on education politics and policy in Tennessee, follow @TNEdReport

 

Little Value Added?

 

That’s the conclusion teacher Jon Alfuth draws about Governor Bill Haslam’s recently announced changes to teacher evaluation and support.

Alfuth notes with frustration that Haslam appears happy to support teachers in ways that don’t involve any new money.

Reducing the weight given TVAAS on a teacher’s evaluation, for example, doesn’t cost anything. Adding a few teachers to a “cabinet” to give feedback on tests is welcome change, but also doesn’t carry a price tag.

Haslam’s changes still unfairly assess teachers in non-tested subjects, in Alfuth’s view:

While reducing the percentage from 25 to 15 percent achievement data for non-EOC teachers is a step in the right direction, I don’t feel that it goes far enough. I personally think it’s unfair to use test scores from courses not taught by a teacher in their evaluation given the concerns surrounding the reliability of these data systems overall.

And, Alfuth says, the financial support teachers and schools need is simply not discussed:

Consider the teacher salary discussion we’ve been having here in Tennessee. This is something that Tennessee Teachers have been clamoring for and which the governor promised but then went back on this past spring. There’s no mention of other initiatives that would require extra funding, such as BEP2.0, which would provide millions of additional dollars to our school districts across the state and do much to help teachers. There’s also no mention of expanding training Common Core trainng, which is essential if we’re going to continue to enable teachers to be successful when the three year phase in of growth scores winds down.

In short, while the proposed changes are step forward, at least in the view of one teacher, much more can be done to truly support teachers and their students.

More on the importance of investing in teacher pay:

Notes on Teacher Pay

More on the state’s broken school funding formula, the BEP:

A BEP Lawsuit?

The Broken BEP

What is BEP 2.0?

For more from Jon Alfuth and education issues in Memphis, follow @BluffCityEd

For more on education politics and policy in Tennessee, follow @TNEdReport

Value Added Changes

 

In what is certain to be welcome news to many teachers across the state, Governor Bill Haslam announced yesterday that he will be proposing changes to the state’s teacher evaluation process in the 2015 legislative session.

Perhaps the most significant proposal is to reduce the weight of value-added data on teacher evaluations during the transition to a new test for Tennessee students.

From the Governor’s press release explaining the proposed changes:

The governor’s proposal would:
•        Adjust the weighting of student growth data in a teacher’s evaluation so that the new state assessments in ELA and math will count 10 percent of the overall evaluation in the first year of
administration (2016), 20 percent in year two (2017) and 35 percent in year
three (2018). Currently 35 percent of an educator’s evaluation is comprised of
student achievement data based on student growth;
•        Lower the weight of student achievement growth for teachers in non-tested grades and subjects
from 25 percent to 15 percent;
•        And make explicit local school district discretion in both the qualitative teacher evaluation model that is used for the observation portion of the evaluation as well as the specific
weight student achievement growth in evaluations will play in personnel
decisions made by the district.

 

The proposal does not go as far as some have proposed, but it does represent a transition period to new tests that teachers have been seeking.  It also provides more local discretion in how evaluations are conducted.

Some educators and critics question the ability of value-added modeling to accurately predict teacher performance.

In fact, the American Statistical Association released a statement on value-added models that says, in part:

Most VAM studies find that teachers account for about 1% to 14% of the variability in test scores

Additional analysis of the ability of value-added modeling to predict significant differences in teacher performance finds that this data doesn’t effectively differentiate among teachers.

I certainly have been critical of the over-reliance on value-added modeling in the TEAM evaluation model used in Tennessee. While the proposed change ultimately returns to using VAM for a significant portion of teacher scores, it also represents an opportunity to both transition to a new test AND explore other options for improving the teacher evaluation system.

For more on value-added modeling and its impact on the teaching profession:

Saving Money and Supporting Teachers

Real World Harms of Value-Added Data

Struggles with Value-Added Data

An Ineffective Teacher?

Principals’ Group Challenges VAM

 

For more on education policy and politics in Tennessee, follow @TNEdReport

Ravitch: Ed Reform is a Hoax

Education scholar and activist Diane Ravitch spoke at Vanderbilt University in Nashville last night at an event hosted by Tennesseans Reclaiming Educational Excellence (TREE), the Tennessee BATs (Badass Teachers), and the Momma Bears.

Ravitch touched on a number of hot-button education issues, including vouchers, charter schools, teacher evaluations, and testing. Many of these issues are seeing plenty of attention in Tennessee public policy circles both on the local and state levels.

She singled out K12, Inc. as a bad actor in the education space, calling the Tennessee Virtual Academy it runs a “sham.”

Attempts have been made to cap enrollment and shut down K12, Inc. in Tennessee, but they are still operating this year. More recently, the Union County School Board defied the State Department of Education and allowed 626 students to remain enrolled in the troubled school. The reason? Union County gets a payoff of $132,000 for their contract with K12.

Ravitch noted that there are good actors in the charter sector, but also said she adamantly opposes for-profit charter schools. Legislation that ultimately failed in 2014 would have allowed for-profit charter management companies to be hired by Tennessee charter schools.

On vouchers, an issue that has been a hot topic in the last two General Assemblies, Ravitch pointed to well-established data from Milwaukee that vouchers have made no difference in overall student performance.

Despite the evidence against vouchers, it seems quite likely they will again be an issue in the 2015 General Assembly. In fact, the Koch Brothers and their allies spent heavily in the recent elections to ensure that vouchers are back on the agenda.

Ravitch told the crowd that using value-added data to evaluate teachers makes no sense. The Tennessee Value-Added Assessment System (TVAAS) has been around since the BEP in 1992. It was created by UT Ag Professor Bill Sanders. Outgoing Commissioner of Education Kevin Huffman made an attempt to tie teacher licenses to TVAAS scores, but that was later repealed by the state board of education. A careful analysis of the claims of value-added proponents demonstrates that the data reveals very little in terms of differentiation among teachers.

Ravitch said that instead of punitive evaluation systems, teachers need resources and support. Specifically, she mentioned Peer Assistance and Review as an effective way to provide support and meaningful development to teachers.

A crowd of around 400 listened and responded positively throughout the hour-long speech. Ravitch encouraged the audience to speak up about the harms of ed reform and rally for the reforms and investments our schools truly need.

For more on education politics and policy in Tennessee, follow @TNEdReport

An Interview with TEA President-elect Barbara Gray

Below is an interview with incoming TEA President Barbara Gray who will take over from Gera Summerford on July 1st.

 

What are your goals for TEA during your term?

My goal as TEA president is to continue advancing the association’s mission to promote, advance, and protect public education by:

  • Educating the public about the good things happening in public schools;
  • Continuing to build positive relationships with legislators, the state board of education and other key policy makers whose decisions impact students, public educators (this include ESPs, teachers, administrators) and our profession; and
  • Organizing our members to work together to reverse decisions made by elected officials that have been detrimental to public education and the teaching profession.

 TEA membership has been declining since the loss of collective bargaining. What are your plans to reverse this trend?

In recent months, TEA has begun a shift to more of an organizing culture. This move, prompted by the hiring of a new executive director at the end of 2013, will help us engage our members in a new way. We will be placing more emphasis on organizing members around issues which affect our profession at both the local and statewide levels.

TEA will continue to be a vocal advocate and provide the high quality legal and professional development services that helped us become the largest professional association for educators in the state.

 

 Do you foresee TEA fighting to restore collective bargaining rights for teachers in the near future?

Collective bargaining is an important tool in protecting students’ learning environment and the rights of our teachers. I do believe TEA will fight to restore bargaining rights for Tennessee’s educators in the future, but it is not a top priority right now. TEA was advocating for teachers’ rights long before collective bargaining was implemented and will continue to do so.

 

Outgoing TEA President Gera Summerford has talked about de-emphasizing the importance of standardized tests.  Do you support that stand? Do you believe Tennessee should explore deployment of alternative models of assessment?

Yes, I share President Summerford’s belief that there is too much emphasis on standardized tests in Tennessee. The state continues to tie more and more high-stakes decisions to these tests, and it is simply inappropriate. We need to take a serious look at alternative models of assessments and how multiple measures can be implemented to ensure fair, reliable results.

I do not believe, and I know many educators share this belief, that a one-time test at the end of the school year accurately tells me how much a student learned in my classroom. Teachers assess students throughout the year in many different ways – common formative assessments (CFA), projects, teacher-made assessments, student portfolios and more. These methods are far better indicators of student achievement and teacher effectiveness than standardized tests.

 

TEA has taken a strong stand against the use of TVAAS data in teacher evaluation. What do you propose as an alternative method of teacher evaluation?

TVAAS is a flawed, unreliable and inaccurate way to measure teacher effectiveness. TEA is leading the fight against the inappropriate use of TVAAS in our state, but we are hardly its only critic. It seems every week there is a new study coming out about the inaccuracies of value-added measures nationwide.

TEA proposes basing teacher evaluation on a system that includes multiple measures of student achievement, instead of relying only on the unreliable TVAAS estimates. I believe a pre-test/post-test assessment would be a more accurate indicator of the effectiveness of a teacher. Measuring how much a student learned during the school year by testing the student’s knowledge at the beginning of the year and then again at the end of the school year would show the true impact of a teacher.

As I mentioned above, teachers evaluate their students in many different ways to determine academic achievement. Teacher evaluation should be approached in the same way.

 

Could you foresee TEA supporting an evaluation system along the lines of Peer Assistance and Review (PAR) which has had some success in Ohio and Maryland?

I am not very familiar with the Peer Assistance and Review program. From what I have read, it does sound like an evaluation model worth exploring. TEA supports learning from other states’ best practices. The ultimate goal is to get an evaluation system in place that is fair and clearly understood by educators. A solid evaluation system will support teachers and provide quality professional development to help those who are struggling, which is not being accomplished by what Tennessee currently has in place.

What would you say will be TEA’s top 3 legislative priorities in 2015?

TEA’s number one priority will be pay raises for teachers. The governor promised to make Tennessee the fastest improving state in teacher salary and we plan to hold him to it. To recruit and retain the best teachers, we must make sure that promise becomes a reality and our teachers receive a well-deserved raise.

Another priority for the association will be to increase per-student funding from the state. It is unacceptable to be below Mississippi in what the state invests per child. Tennessee educators are performing miracles in their classrooms every day. In order to sustain and improve on that success, the state must properly fund our schools.

The third legislative priority will be to continue the fight against privatization. Vouchers, for-profit charters and less restrictive parent trigger laws are all schemes that threaten the livelihood of public education in Tennessee. Out-of-state organizations are funneling millions of dollars into Tennessee because they mistakenly believe there is an opportunity to make a profit off of our students. TEA, along with the help of some new parent and teacher grassroots groups, had great success last year in defeating these bills and will continue the fight in the upcoming session.

 What’s your view of the education landscape in Tennessee? What would you do differently?

The education landscape in Tennessee is constantly changing. First, let me say that there are a lot of things going right in Tennessee schools. Our students are graduating in record numbers. Our classrooms are filled with qualified, committed educators who work tirelessly for their students. Parents and teachers are uniting in the fight against over-testing and privatization.

It feels now like we are starting to see the light at the end of the tunnel after years of negative changes. This legislative session we saw groups of angry, engaged educators, parents, students and even legislators standing together to say, “Enough!” Enough with the unproven reform initiatives, enough with placing the weight of the world on our students and teachers, and enough with making a one-time test the center of the public education universe.

We pushed back together and we won on numerous issues.

Part of the landscape that I would love to see change is the public perception of Tennessee schools and teachers. TEA research has shown that people think their local public schools are doing great. However, when asked about the performance of public schools statewide, the response is often negative.

I want to change that perception. Commissioner Huffman is so often in the news saying negative things about our students, teachers and schools. I want to do everything in my power to combat the image he paints of public education in our state by educating Tennesseans about the many great things happening inside our schools.

For more on education politics and policy in Tennessee, follow @TNEdReport

 

A Letter on Common Core from Bluff City Ed and TN Ed Report

As adults, we constantly need to master new skills and adjust our thinking to new information to solve the many challenges facing our world.  Our schools should be designed to empower our children to accomplish the same.  To accomplish this, it’s essential that our teachers have a rigorous set of standards to guide them.  Currently our existing standards don’t adequately prepare students for these challenges.  They don’t push our kids to fully build the critical thinking skills necessary for college and career readiness, let alone to lead the next generation.

That is why the Tennessee Education Report and Bluff City Education jointly support the adoption of the Common Core state standards here in Tennessee.  These standards represent a dramatic improvement over our existing state standards.  They reduce the amount of content required for teachers to cover and give teachers more time and freedom in how to pursue their goals.  This in turn empowers educators and schools to push their kids to higher levels of critical thinking every day throughout the year.

These standards also represent a crucial transition for our state’s future.  In recent months we’ve focused on increasing the number of students with access to a college degree through Governor Haslam’s Drive to 55 initiative.  However, college access is not enough if our students are not prepared for the rigors of a post-secondary education.  We believe that the Common Core standards should be viewed as a crucial component of this effort.  If we want our state to be truly competitive in a global economy, we cannot afford to allow our public education system to linger in the limbo of the status quo any longer.  Failing to do so will ensure that we fall compared to others raising their academic standards.  In this way, the fight to adopt Common Core represents a fight for Tennessee’s future.

However, we have some serious questions about the common core standards as it relates to testing.  We are concerned about the implementation of the new PARCC tests and their potential impact on teachers and schools, particularly in the area of evaluations.  Other states that have enacted the common core have seen dramatic declines in test scores.  This is to be expected if we are truly holding students to a higher level of critical thinking.  Over time we expect these scores to rise as teachers and schools become more comfortable with these standards and the state continues to support their implementation.

However, this becomes a concern when these scores are used to evaluate teachers and schools in the existing evaluation system.  Teachers and schools will likely see their scores drop dramatically for the first few years.  This will impact their evaluation scores and by association is likely to cause a decline in support for these important standards.  We are also concerned that we may see strong schools placed on the failing list in these first few years of common core implementation simply by virtue of the fact that they have not had the time to fully adjust to the new standards and their accompanying assessments.

Another concern is that while these tests have been field tested throughout this year, there will still be kinks that need to be worked out of the system in regards to data and implementation.  For example, test questions will likely need to be dropped, added or modified and the standards themselves may need to be tweaked to improve them as time goes on.  Additionally, over the years we’ve given students their yearly assessments in paper form.  They will need time to adjust to taking assessments online, which is a crucial component of the PAARC assessments.  Lastly, the entire TVAAS system will need to be adjusted from analyzing a complete multiple choice assessment to a mixed multiple choice-open response assessment.  Teachers and schools should not be held accountable for these factors which are outside of their control.

We propose three modifications to the current process to ensure a successful Common Core implementation.  First, we propose that the state board of education issue a moratorium stating that the first year of tests scores will not be used on teacher evaluations.  In the second year, test scores would increase to 15% of evaluation score and in the third year they would return to the full 35%.  This would allow teachers adequate time to adjust their instruction to the new standards and their accompanying assessments and give students a full three years to accustom themselves to the higher level of thinking demanded by the common core.

In addition, during the moratorium year, the state Department of Education should seek feedback on the TEAM model from teachers around the state and make necessary changes as it relates to common core. These could include a broader rollout of portfolio-based assessments for teachers in related arts, for example.  It could also include ways to factor in teachers in non-tested, academic subjects, such as using AP scores in place of whole school value-added data.  If teacher evaluation is to be tied to student performance data, we should ensure that data represent students taught by the teacher being evaluated.

Second, we propose that the state place at minimum a one year moratorium on using these test scores to evaluate schools.  This should give schools additional time to adjust to these new tests and adequately prepare their teachers and students for the new format.  We would never teach students the entirety of calculus in a month and then penalize schools when they fail to pass the advanced placement exam.  We shouldn’t do the same to schools.  Students need time to adjust to the new content and the new ways of thinking demanded by the standards before schools are assessed on their performance, which a one year moratorium will provide.

Third, we also propose that the state of Tennessee leave open the possibility of switching tests if it appears that PARCC is not working by including an exit clause in any new contract created with PARCC to hold it accountable for continuing to provide a high quality assessment. After the second year of PARCC, the State Board of Education should issue a report on its effectiveness in meeting the goal of assessing achievement of Common Core State Standards.  Factors for making this judgment should include the cost of PARCC relative to similar tests that also assess the standards. To facilitate this, the governor should appoint a committee to establish metrics which would be used to evaluate the effectiveness of PARCC as an assessment tool in meeting the academic goals established by the common core state standards.

A comparison of new tests in states like Kentucky and Florida is also warranted. We should not be locked into a test if it is found that PARCC has not met the state goals.  If in a worst case scenario Tennessee decided to continue to delay or even pull out of PARCC, including such a clause would mean we would not need to end our use of the Common Core State Standards.  Other states, notably Kentucky to our north, continue to strongly support Common Core implementation in their state but have chosen to create their own assessments.

We support Common Core and sincerely hope that PARCC is successful in our state.  Above all, we should constantly evaluate both the quantitative data gleaned from the new PARCC assessments and the qualitative data we hear from teachers, students and parents.  Common Core represents a necessary change for our state, but there will be challenges along the way that demand adjustments.  Only by listening carefully to those directly impacted by these new standards will we truly be able to fully implement them and alter the trajectory of the future of public education here in Tennessee.

Tennessee Education Report Endorsers: Andy Spears, Zack Barnes, John Haubenreich

Bluff City Education Endorsers: Jon Alfuth, Ryan Winn, James Aycock, Tamera Malone, Elana Cole, Casie Jones

Follow these Tennessee education writers on Twitter @BluffCityEd and @TNEdReport

 

TEA Files TVAAS Lawsuit in Knox County

Use of TVAAS is Arbitrary and Violates 14th Amendment, TEA Alleges

The Tennessee Education Association (TEA) has filed a lawsuit on behalf of a Knox County teacher who was denied a bonus under that school system’s pay plan after Tennessee Value-Added Assessment System (TVAAS) data for 10 of her students was unknowingly attributed to her.

TVAAS is Tennessee’s system of measuring student growth over time. It generates data based on student test scores on TCAP and end of course tests.

In this specific case, the teacher, Lisa Trout, was assigned TVAAS data for 10 students after being told her evaluation would be based on system-wide TVAAS data because she taught at an alternative school.

The TEA lawsuit cites two different memos which indicated that Ms. Trout could expect an evaluation (and bonus eligibility) to be based on system-wide data. At the conclusion of the school year, Ms. Trout was informed that her overall evaluation score, including observations and TVAAS data was a 4, making her eligible for a bonus under the Knox County pay plan.

When she did not receive the bonus as expected, she began asking questions about why the bonus had not been paid.  She ultimately determined that without her knowledge, a school counselor had assigned 10 students to Ms. Trout for the factoring of TVAAS scores.  The students were in an Algebra II course Ms. Trout taught, even though she does not hold an endorsement for teaching Alegbra II.

Though the suit does not specifically mention this, it should be noted that 10 students is a particularly small sample size subject to significant statistical anomaly.

The TEA lawsuit contends that Ms. Trout was owed the bonus based on Knox County School Board policy and in this specific instance, the bonus should have been paid.

Arbitrary?

The TEA goes on to contend that Ms. Trout and similarly situated teachers for whom there is little or no specific TVAAS data are held to an arbitrary standard in violation of the 14th Amendment of the U.S. Constitution.

Specifically, the suit notes: ” … the majority of teachers in the Knox County Schools … have had their eligibility for additional compensation (under the APEX bonus system) determined on the basis of the test scores of students they do not teach and/or the test scores of their students in subjects unrelated to the subjects they teach.”

The suit alleges that such a system violates the Equal Protection Clause of the 14th Amendment because some teachers are evaluated and receive bonuses based on the scores of their own students while other teachers are held accountable for students they do not teach and over which they have no influence or control.

In short, the entire system is flawed and should be discarded.

A spokesperson for TEA confirmed that the organization does not believe that teacher pay should be tied to TVAAS data.

On a related note, the Metro Nashville Public Schools recently announced it is putting plans to pay teachers in part based on TVAAS scores on hold indefinitely.

A TEA press release announcing the Knox County suit indicated that the organization anticipates additional lawsuits along these lines.

For more on Tennessee education politics and policy, follow @TNEdReport

 

Interview with Speaker Beth Harwell

We had the pleasure to interview Speaker Beth Harwell again.

1) You have been quoted as saying that districts might need more time to absorb current reform before a voucher plan is enacted. Do you support the adoption of a voucher plan in this legislative session?

I think we need to be mindful about the changes we have already made, and certainly ensure any changes can be as seamless as possible. Most of the proposals that have been brought forth are limited in some way, so I think there is a desire to ease into it.

2) If a voucher program is implemented, would you consider independent funding of the voucher students, i.e. funding their tuition through new state funding rather than by redirecting BEP and local funds that would have gone to the LEA?  If the voucher program is limited, as Governor Haslam would like, this could be a relatively inexpensive way to test whether vouchers can raise student achievement without penalizing LEAs for the experiment.

I want everyone’s voice to be heard throughout the process, and welcome all ideas. However, we are already anticipating a tight budget due to revenue shortfalls, so a new funding source may not be possible at this time.
3) Under Republican leadership, Tennessee expanded access to charter schools beyond the original limitations based on students eligible for free and reduced-price lunch, as well as those in currently failing schools.  Currently, access to pre-kindergarten is limited along similar lines, with free and reduced-price lunch students eligible first, and others eligible if there is enough space.  Why not follow the same path as charter schools, and make pre-K available for more students?

I believe we should keep Pre-K funding in place for those at-risk children that are currently eligible for the program. I am not for an expansion, however, because I think our focus right now needs to be on K-12 and making sure those public schools have the resources they need at their disposal. If there is additional money available, I would like to see it go to remedial programs in our K-12 schools.

4) There has been some recent discussion from MNPS and other districts about the state needing to fix the BEP. Perhaps along the lines of the reform started under BEP 2.0. Do you support moving forward with new BEP investment at this time?

The Governor just announced this week that he has formed a task force to take a hard look at the BEP funding formula, including the changes that were made with BEP 2.0. I applaud that approach, because even BEP 2.0 was passed seven years ago. I think allowing the stakeholders come to the table and have a serious discussion about the future of the BEP and what, if any, changes need to be made is important.
5) Some groups have called for the suspension of the use of TVAAS data in teacher evaluations until PARCC is fully implemented. Would you support this?

There are bills that have been proposed this year to take a look at a delay. While my personal preference is not to suspend or delay the use of this data, I will let the legislative process work and a full and healthy debate happen. I understand the concerns, and I’m listening, but I believe it is very important to use the data we are collecting to ensure Tennessee students are getting the education they deserve.

6) TNEdReport interviewed you last June, what has changed in the educational landscape of Tennessee since then?

I don’t know that much has changed, but there has been a lot of healthy discussion on the direction of education in Tennessee, and I think that is a positive thing.

7) What do you tell the teachers who are upset with the constant changes in education policy in Tennessee?

I value the work our teachers do, and I am pleased the Governor has committed to make Tennessee’s teacher salaries the fastest growing in the nation. They deserve that recognition and compensation. We share the same goal: to see that every child in Tennessee has the opportunity to succeed.