TEA Files TVAAS Lawsuit in Knox County

Use of TVAAS is Arbitrary and Violates 14th Amendment, TEA Alleges

The Tennessee Education Association (TEA) has filed a lawsuit on behalf of a Knox County teacher who was denied a bonus under that school system’s pay plan after Tennessee Value-Added Assessment System (TVAAS) data for 10 of her students was unknowingly attributed to her.

TVAAS is Tennessee’s system of measuring student growth over time. It generates data based on student test scores on TCAP and end of course tests.

In this specific case, the teacher, Lisa Trout, was assigned TVAAS data for 10 students after being told her evaluation would be based on system-wide TVAAS data because she taught at an alternative school.

The TEA lawsuit cites two different memos which indicated that Ms. Trout could expect an evaluation (and bonus eligibility) to be based on system-wide data. At the conclusion of the school year, Ms. Trout was informed that her overall evaluation score, including observations and TVAAS data was a 4, making her eligible for a bonus under the Knox County pay plan.

When she did not receive the bonus as expected, she began asking questions about why the bonus had not been paid.  She ultimately determined that without her knowledge, a school counselor had assigned 10 students to Ms. Trout for the factoring of TVAAS scores.  The students were in an Algebra II course Ms. Trout taught, even though she does not hold an endorsement for teaching Alegbra II.

Though the suit does not specifically mention this, it should be noted that 10 students is a particularly small sample size subject to significant statistical anomaly.

The TEA lawsuit contends that Ms. Trout was owed the bonus based on Knox County School Board policy and in this specific instance, the bonus should have been paid.

Arbitrary?

The TEA goes on to contend that Ms. Trout and similarly situated teachers for whom there is little or no specific TVAAS data are held to an arbitrary standard in violation of the 14th Amendment of the U.S. Constitution.

Specifically, the suit notes: ” … the majority of teachers in the Knox County Schools … have had their eligibility for additional compensation (under the APEX bonus system) determined on the basis of the test scores of students they do not teach and/or the test scores of their students in subjects unrelated to the subjects they teach.”

The suit alleges that such a system violates the Equal Protection Clause of the 14th Amendment because some teachers are evaluated and receive bonuses based on the scores of their own students while other teachers are held accountable for students they do not teach and over which they have no influence or control.

In short, the entire system is flawed and should be discarded.

A spokesperson for TEA confirmed that the organization does not believe that teacher pay should be tied to TVAAS data.

On a related note, the Metro Nashville Public Schools recently announced it is putting plans to pay teachers in part based on TVAAS scores on hold indefinitely.

A TEA press release announcing the Knox County suit indicated that the organization anticipates additional lawsuits along these lines.

For more on Tennessee education politics and policy, follow @TNEdReport

 

MNPS Defers Plan to Pay Teachers Based on Test Scores

Joey Garrison has the story on MNPS deferring previously stated plans to base future pay raises for teachers on test scores and the TEAM evaluation model.

District officials suggest they need more time to determine how best to incorporate the TEAM evaluations into a pay plan for teachers.  TEAM includes both TVAAS scores and teacher observations to create a 1-5 ranking for teachers (1 being the lowest ranking, 5 the highest).

Some have suggested teacher resistance to the proposal played a role in the delay, but MNPS says they simply want to take the time needed to develop the best plan.

MNPS also offered no timeline for revisiting the TEAM-based portion of the pay plan.

For now, there’s more work to be done to devise a pay plan that meets new state requirements.

The MNPS decision may foreshadow similar action by other districts as teachers express concerns about pay being tied to student test scores, especially TVAAS data.

 

 

A Broader, Bolder SCORE Report

Today, newly-formed education advocacy group TREE (Tennesseans Reclaiming Educational Excellence) hosted a presentation by Elaine Weiss of the Broader, Bolder Approach to Education.

Weiss discussed recent Tennessee education policy in the context of the drivers of educational inequality.  She pointed to research suggesting that poverty is a significant contributor to student outcomes and noted other research that suggests as much as 2/3 of student outcomes are predicted by factors outside of school.

Later in the day, SCORE (Statewide Collaborative on Reforming Education) released its annual State of Education in Tennessee Report.

Both reports indicate Tennessee has much work to do to improve educational outcomes.  There were some similarities and some differences in the approaches presented, however.

The SCORE report outlined five specific priorities for Tennessee education policy in 2014.  I’ll examine those and note where the Broader, Bolder Approach supported by Weiss matches up and where there are differences.

Here are the SCORE priorities:

  • Maintaining a commitment to rigorous standards and assessments. The report says Tennessee must push forward with the continued implementation of the Common Core State Standards. It also points out that measuring student success with higher standards is needed for effective instruction, so Tennessee must continue its commitment to implementing the Partnership for Assessment of Readiness for College and Career (PARCC) assessments.
  • Strengthening schools through effective leadership. As Tennessee continues to implement student-centered initiatives it is crucial to have strong instructional leadership in every school, the report concludes. To build a pipeline of strong leaders, the state focus should be on creating an aligned, rigorous system for recruiting, training, evaluating and providing ongoing support to school leaders.
  • Expanding student access to great teaching. The report specifically calls for providing teachers with the tools and resources – including instructional coaching, collaborative planning time, and targeted professional learning – that will enable them to be experts in their profession. The report also calls for helping teacher preparation programs implement more selective admissions processes and rigorous curriculum requirements that prioritize the skills and knowledge teachers need to support students in the classroom.
  • Investing in technology to enhance instruction. The report says that although the upcoming online PARCC assessments are a catalyst for increasing technological capabilities in schools and school districts, investing in technology must be an ongoing priority and not just a one-time purchase. Students and teachers need daily access to technology and must be trained on using it, the report says.
  • Supporting students from kindergarten to career. The report points out that in today’s economy most careers require training after high school. It specifically calls for creating a data-rich environment that equips leaders, educators, and parents with the information and tools they need and a data-driven approach to making decisions about policy and practice that will advance student success. It also recommends expanded opportunities for more students to take AP, International Baccalaureate, dual-credit, and dual-enrollment courses and to study science, technology, engineering, and math (STEM) subjects.

And here is some analysis in light of the Broader, Bolder presentation:

Standards/Assessment: Weiss suggests that higher standards alone do not improve student achievement.  She points to persistent achievement gaps over time in spite of increasing standards, particularly in the NCLB era.  She also notes the stress caused to students and parents due to increased testing.  She notes that in some cases, as much as 30 instructional days are lost to testing and test prep. She suggests that raising student achievement over time must not simply be a function of high standards but also must include a commitment to supporting students and families outside of school.

Strengthening Schools Through Effective Leadership: Here, SCORE focuses on providing support for the development of effective school principals.  Weiss also suggests the importance of providing support and development to teachers and school leaders.  She would note that having an effective leader alone won’t close the gap, but that having supported leaders along with strong community supports can make a difference.

Expanding Student Access to Great Teaching: Weiss notes that Tennessee’s teachers are among the lowest paid in the country.  SCORE does not specifically address teacher pay in its report.  SCORE does call for improved professional development and additional collaboration with teachers going forward.  SCORE also calls for continued use of TVAAS to identify quality teachers.  Weiss is clear that value-added modeling is inconsistent and unreliable as a tool for evaluating teachers.  At the same time, SCORE calls for adding growth measures to additional teachers (these may or may not be in the form of tests that feed into the TVAAS formula).

Access to Technology: While Weiss might also place value on technology, she’d also suggest that access to summer learning opportunities and enriching extended learning is important.  She points to research suggesting that low-income students tend to proceed at a rate comparable to their peers but lose significant ground over the summer.  That is, what teachers are doing is working, but outside supports are lacking.  Adding meaningful time to the school calendar is one way to address this.

Supporting Kids from Kindergarten to Career:  Weiss absolutely states that kids need a variety of supports throughout school to ensure their success.  She’d likely expand this recommendation to include supporting kids from Pre-Kindergarten through career.  In fact, Weiss notes that while Tennessee was once moving quickly to grow a high-quality Pre-K program, the state has not added a single Pre-K seat since winning Race to the Top. Weiss explicitly recommends continuing the growth of the state’s Pre-K program in order to provide a proven intervention that closes opportunity gaps.

With the exception of TVAAS, it seems the Broader, Bolder Approach outlined by Weiss would generally be in agreement with the SCORE recommendations.  However, as the name indicates, the approach favored by Weiss would be broader and more expansive.  It would include expanded access to Pre-K. It would provide both targeted support to teachers AND significantly better pay for teachers.  It would examine ways to add valuable learning time to the school calendar.  And it would seek a more balanced approach to administering tests in order to avoid an over-reliance on test-based assessments.

For more on Tennessee education politics and policy, follow us @TNEdReport

 

 

The Education Agenda

What’s the best way to move Tennessee schools forward? It seems lots of people have opinions about this.  And some organized groups (teachers, superintendents, parents) are familiar faces around the General Assembly as education legislation is discussed, debated, and voted on.

Here, I attempt to break down the education agenda according to various groups attempting to influence the debate at the General Assembly this session.

Professional Educators of Tennessee (PET)

This group of teachers is the smaller of the two organizations in the state representing teachers (the other being the Tennessee Education Association).

We’ve written about PET’s 2014 agenda before.

Essentially, they are focusing on teacher licensure (and the use of TVAAS to determine continuation), protection of student and teacher data, and testing.

Tennesseans Reclaiming Educational Excellence (TREE)

We reported last week on the launch of this new group. They appear to stand in opposition to much of the current reform agenda in Nashville (state charter authorizer, vouchers, etc.). They also support full funding of BEP 2.0.

Tennessee Education Association (TEA)

TEA is the state’s oldest and largest association of teachers.  The TEA has historically opposed the expansion of charter schools and the use of public dollars for private schools (vouchers). They have a fairly wide-ranging legislative agenda. Additionally, they are currently undertaking a “road trip” to expose flaws in the Tennessee Value-Added Assessment System (TVAAS).

Tennessee School Boards Association (TSBA)

As its name implies, this group represents school boards across the state.  Though a few systems are not members, most in Tennessee are.  Here’s their complete agenda.  The organization opposes vouchers and opposes revoking a teacher’s license based solely on TVAAS data.

Tennessee Organization of School Superintendents (TOSS)

The statewide organization representing school superintendents.  Their full legislative agenda can be found here. TOSS opposes vouchers, a statewide charter authorizer, and the revocation of a teacher’s license based on TVAAS data.

Statewide Collaborative on Reforming Education (SCORE)

SCORE is headed-up by former U.S. Senate Majority Leader Bill Frist.  The organization is comprised of many education stakeholders and aims to provide information to policymakers as they make decisions that impact schools.  They have been supportive of the new teacher evaluation model and are the leading organization in Tennessee in support of the Common Core State Standards.  More on SCORE here.

Stand for Children

This organization has been active in Tennessee since 1999.  For the sake of full disclosure, I worked for Stand in TN from 2007-2009. The organization made its mark in Tennessee advocating for expanded access to Pre-K.  According to a recent email from new Executive Director Betty Anderson, the organization plans to focus this year’s legislative efforts on maintaining the Common Core State Standards.  They are also supportive of expanded access to Pre-K and to improvements to the BEP.

StudentsFirst

This is the Tennessee affiliate of Michelle Rhee’s nationwide StudentsFirst organization. Here’s the group’s official issue agenda.  They have been supportive of vouchers, a statewide charter authorizer, and teacher merit pay.

Tennessee Parent Teacher Association (PTA)

The Tennessee PTA is comprised of parents organized at the local school level. While these groups typically support their specific school, the PTA also supports schools and students in the community and state. Their complete legislative agenda can be found here. The PTA includes in its agenda support for the inclusion of parent and student feedback in teacher evaluation and the use of “strategic compensation” for teachers.  They also support the Coordinated School Health program and changes to the BEP that would provide funding for additional nurses. The PTA opposes vouchers.

School Choice Now

This group is a joint project of the Tennessee Federation for Children and the Beacon Center of TN.  Their focus is on a statewide school voucher program, which they call “opportunity scholarships.”

Those are the major groups I’m aware of attempting to influence education policy in Tennessee. There are likely others.  But this is a starting point to understanding what’s going on at the Legislative Plaza regarding education policy and who is pushing for what policies.

For more on Tennessee education politics and policy, follow us @TNEdReport

 

Strategies for Retaining Educators

Memphis teacher and blogger Jonathan Alfuth writes about strategies for retaining educators in an urban environment.

This past June, I completed my second year as a Teach for America teacher.  I’d worked in one of the most struggling high schools in Memphis but rather than being scared away, it strengthened my commitment to teaching.  Yet I knew that there was no way I’d return to my placement school.  The culture didn’t promote student achievement, individual teachers operated in isolation and we had little shared vision for where we were going as a school.

Over the next few weeks, I did a comprehensive search of schools across Memphis. While I turned up several schools that I believed embodied the type of culture I desired, none of them were Shelby County Schools (all were charter).  I made the choice to move to a charter school and I’ve been amazed by the difference in culture and its impact on student achievement.  Our leaders are hardworking and dedicated to a common mission.  My colleagues and I are given common planning time in content and grade level teams each and every week. And most importantly, we work together to develop the kind of school culture that drives students to success.  I see its impact each and every day in the quality of my students work and their academic outcomes as so far, 100% of our graduating students have been accepted to 4-year schools.

My dilemma was recently discussed at the policy level in Shelby County during the school board’s decision whether or not to extend Teach for America’s contract with the district.  The board voted to extend the contract, but the two opponents of extending the contract cited poor TFA retention beyond the program’s two year commitment in their opposition to its continuation.  In the same piece, she also quoted Superintendent Hopson in a statement that perfectly encompasses my dilemma and the dilemma of second year TFA teachers every year.  Hopson said, “I have to say, if effective talent is leaving the district at a 70-something percent rate, we have to look at strategies we can use to retain talent.”

I often find myself thinking that we’ve done so much to improve education both here in Memphis and across Tennessee.  We’ve reformed teacher evaluation to identify our best and brightest.  We’re on the verge of dramatically reforming teacher compensation in Tennessee.   And yet all this means NOTHING if we cannot keep great teachers in high need classrooms once they are placed.  This begs the question; what do educators really want?  What will keep them in district classrooms?  In my experience, young education professionals, TFA or otherwise, aren’t much different from most other young professions.  We all have highly varied motivations for entering the profession.  But in the end, great teachers gravitate towards environments with great school and district leaders, great office (or in this case school) culture that focuses on achievement and great colleagues that work together to achieve a common vision.

I am a TFA alumni but I also work closely with young educators from both alternative and traditional certification programs.  And I believe strongly that my decision is one that almost every young educator in Shelby County faces at some point in their first two years.  At the end of two years, many young educators, TFA or otherwise, feel a strong sense of commitment to their children and a desire to continue in education.  However, we are often placed in such dysfunctional environments that we have to make a choice which feels like choosing between being a martyr for our kids by staying or abandoning them by quitting or moving schools.  And so often the challenges inherent in district schools make the former untenable, and so we leave, either choosing a different school like I have or leaving the profession all together.

I should add that some schools in Shelby County have found a way to make it work and retain young educators beyond their first few years.  Colleagues of mine at Ridgeway High, Whitehaven and Kingsbury High consistently tell me about the strength of their school leadership and the support they receive from their colleagues.  We should certainly study these schools further, but they represent the exception rather than the norm.

Until district leaders devote attention to improving school cultures to make them attractive and professional work environments that attract young educators, we will continue to see an exodus of young teaching talent to other systems, schools or professions.  And it won’t matter what program those educators come from if conditions are so challenging that teachers can’t fathom working in high need environments.  We can extend or eliminate contracts with organizations like Teach for America, but that won’t fix the underlying fact that many young educators simply don’t feel that the school culture where the work is one where they can be successful.

I don’t want to leave this post without offering some solutions.  I’ve already written a seven part series on a package of strategies that could be used to promote teacher retention in SCS, so I  won’t rehash it here. If you’re interested in some research based strategies for how we could start building the types of school cultures that attract and retain high quality educators by enacting district level policies, I invite you to check the series out here.

Jonathan Alfuth is a math teacher at a charter school in Memphis.  He blogs about education issues at Bluff City Ed

For more on Tennessee education politics and policy, follow us @TNEdReport

 

Raj Chetty and Tennessee Education Policy

No, Raj Chetty, economics professor at Harvard,  is not specifically making recommendations to Tennessee about how to conduct education policy.  But he did join with other scholars to analyze Tennessee’s STAR program (1985-1989) for early education (K-3) which included students in 79 Tennessee schools and random student assignment.

The results of Chetty’s study suggest that the quality of a kindergarten class matters greatly to a child’s future.  It’s important to note that the study focused on the overall quality of the class — from the teacher to the resources provided to class size to peer group.  So, yes, quality matters.  And certainly, the teacher is a factor in that overall quality picture.

Chetty notes that a top quartile teacher (based on test scores) can make a significant difference in lifetime income for a child.  Yes, I’ve been critical about the “big” differences Chetty notes in terms of lifetime income in other studies. And, I certainly have questions about how important this particular finding is in terms of overall income impact. And then there’s the whole notion about the limitations of the knowledge we can gain about an individual teacher based on test scores alone.

That said, Chetty does note the findings are statistically significant and his study does control for many outside factors in order to isolate classroom inputs.

Moreover, the current Tennessee Department of Education policy framework is geared toward improving results on just these sorts of tests.

So, it becomes interesting, then to see what Chetty’s research says about how to improve results on such tests (which provide at least some predictive value about how a student will do later in life) and how that compares to current Tennessee education policy being pursued by the Haslam-Huffman regime.

1) Class Size Matters: According to the Chetty study, “Small-class students went on to attend college at higher rates and to do better on a variety of measures such as retirement savings, mar- riage rates, and quality of their neighborhood of residence.”  Which makes it difficult to understand why among the first proposals of Commissioner Huffman was to attempt to adopt a policy that would have raised class sizes across Tennessee.

2) Teacher Experience Matters: Contrary to what Commissioner Huffman told the State Board of Education about teacher experience (that a teacher’s years of experience don’t effectively predict student outcomes), the Chetty study noted, “We find that kindergarten teachers with more years of teaching experience are more effective at raising both kindergarten test scores and adult earnings. This may partly be the effect of learning on the job, but it may also reflect the fact that teachers who have taught for a long time are more devoted to the profession or were trained differently.” In spite of this Tennessee-specific data on the importance of years of experience to improved student outcomes, Commissioner Huffman proposed and the State Board of Education adopted a teacher pay plan that discounts years of experience as a factor in compensation.

3) Teacher Merit Pay is Problematic: When discussing the policy implications of the study, Chetty notes, “Merit pay policies could potentially improve teaching quality but may also
lead to teaching to the test without gains on the all- important noncognitive dimensions” (soft skills). Which, as stated above, would point to policies that move away from merit pay for individual teachers, in contrast to the Haslam-Huffman policy.

4) Teacher Support is Critical: Chetty specifically points to improved teacher training, early career mentoring, and reducing class sizes as policies that could work to improve the overall quality of early (K-3) classrooms.  Again, Tennessee has no statewide program for new teacher mentoring and is not systematically working on reducing class size, especially in the early grades.  In fact, as noted above, the initial proposal from this administration would have increased class sizes.

While I may be among the first to look skeptically at the current administration’s education policy goals, it would be nice if their policy solutions actually lined up with the stated goals.  In this case, using Tennessee data, it seems clear the proposed solutions are not matching the stated challenges.

For more on Tennessee education policy and politics, follow us @TNEdReport

Rutherford County to Consider Alternative Pay Plan

The Rutherford County School Board will begin discussions tonight on a new pay plan as required by the State Board of Education.  The State Board approved Commissioner Kevin Huffman’s recommendations for a new pay scale and a requirement that districts come up with differentiated pay schemes, including merit pay and pay based on performance on the Tennessee Value Added Assessment System (TVAAS).

TVAAS is facing continued criticism from some who don’t wish to tie teacher licensure to the scores it produces. It has also been suggested that TVAAS has done very little so far to improve Tennessee schools despite having been in existence for 20 years. And, some critics of value-added data note that it is unable to effectively differentiate among teachers.

It will be interesting to see the general outline of the pay plan discussed in Rutherford tonight as it may offer insight in to how the state is “guiding” districts to develop such plans.

For more on education politics and policy in Tennessee, follow us @TNEdReport

Cleveland, Bradley County Speak Out on State Ed Policy

The School Boards of Cleveland and Bradley County have both passed resolutions this week calling on the State Board of Education to stop using TVAAS (Tennessee Value Added Assessment System) scores in teacher evaluation and licensure.

UPDATE:  Read the resolution here.  We’re told this resolution will be presented to the TSBA (Tennessee School Boards Association) Delegate Assembly for a vote in November.

Cleveland’s Board expressed support for Common Core while the Bradley resolution questions the appropriateness of Common Core standards for younger children.

The two districts join Roane and Marshall counties in passing resolutions raising concerns about state education policies and a lack of collaboration from state leaders.

Specific to TVAAS, Professional Educators of Tennessee (PET) has also called on the state to stop using value-added data until 2016-17 when the PARCC tests are fully phased-in.

TVAAS has come under criticism recently for providing a smokescreen that has allowed Tennessee policy makers to claim schools are making gains while masking relatively low proficiency rates on tests like NAEP (National Assessment of Educational Progress).

Additionally, some question the ability of value-added data to provide meaningful differentiation among teachers.

For more on Tennessee education politics and policy, follow us @TNEdReport

 

 

Test Questions

A group of parents attempting to reduce the amount of standardized testing Tennessee students are subjected to each year is now raising questions about Commissioner Kevin Huffman’s testimony in defense of Common Core at a recent state Senate Education Committee hearing.

Huffman essentially admitted that TCAP is not a very strong test.  The parent group wants an explanation of why this weak test is being used to determine teacher licensure and possibly teacher pay.

For more on Tennessee education politics and policy, follow us @TNEdReport

20 Years of TVAAS has Told Us Almost Nothing

Valerie Strauss has an interesting piece over at the Washington Post dealing with Value-Added Modeling.  More specifically, the post analyzes what can be learned from 20 years of the Tennessee Value-Added Assessment System (TVAAS) implemented as a result of the Education Improvement Act — the Act that created the Basic Education Program (Tennessee’s school funding formula, also known as BEP).

The promise of Value-Added Assessment was that we could learn a lot about which schools were working and which weren’t.  We could learn a lot about kids and how they were progressing.  We could even learn about teachers and how they were doing with all their students and with specific groups of students.  With all this information, Tennessee would intervene and take action that would move schools forward.

Unfortunately, that promise has not been delivered.  At all.

Here, I highlight the key takeaways from the Strauss piece.  Tennessee parents and policymakers should take note – TVAAS is taking up tax dollars and impacting teacher evaluations and it doesn’t really work all that well.

1. Using TVAAS masked persistently low proficiency rates.

The Tennessee value-added assessment model basically identified the schools that were already making required annual proficiency targets, but it failed to distinguish between schools with rising or declining proficiency scores.

In short, the Sanders Model did little to address the essential unfairness perpetuated by NCLB proficiency requirements, which insisted that those student further behind and with fewer resources than those in economically privileged schools had to work harder to reach the same proficiency point.  More importantly, there was no evidence that the Sanders version of value-added testing did anything to help or even predict the future outcomes for those furthest behind.

 

2. TVAAS is unstable and inappropriate for high-stakes decisions — like hiring and firing teachers, renewing licenses, or determining pay.

And despite the National Research Council and the National Academies’ flagging of value-added assessment as too unstable for high-stakes decisions in education …

…states like Tennessee rushed to implement a federally recommended system whereby value-added growth scores would come to dominate teacher evaluation for educators who teach tested subjects.  And contrary to the most basic notions of accountability and fairness, two-thirds of Tennessee teachers who teach non-tested subjects are being evaluated based on school-wide scores in their schools, rather than their own.

3. Continued use of TVAAS as an indicator of “success” leaves the most vulnerable students further and further behind.

In a 2009 Carnegie-funded report, Charles Barone points out that focus on value-added gains, or growth in test scores, may downplay the need for interventions to address low proficiency rates:  “Due to the projection toward proficiency being recalculated annually [in the TVAAS model], there is not necessarily a significant progression, over time toward proficiency . . . causing a delay of needed intervention at appropriate developmental times” (p. 8). So while showing academic progress, gain scores or growth scores easily mask the fact that minority and poor children are far below their well-heeled peers in becoming intellectually prepared for life and careers. And in masking the actual academic progress of the poor and minority students, the state (and the nation) is let off the hook for maintaining and supporting an adequate and equally accessible system of public education for all students. At the same time, politicians and ideologues can celebrate higher “progress rates” for poor and minority students who are, in fact, left further and further behind.

4. Tennessee has actually lost ground in terms of student achievement relative to other states since the implementation of TVAAS.

Tennessee received a D on K-12 achievement when compared to other states based on NAEP achievement levels and gains, poverty gaps, graduation rates, and Advanced Placement test scores (Quality Counts 2011, p. 46).  Educational progress made in other states on NAEP [from 1992 to 2011] lowered Tennessee’s rankings:

• from 36th/42 to 46th/52 in the nation in fourth-grade math[2]

• from 29th/42 to 42nd/52 in fourth-grade reading[3]

• from 35th/42 to 46th/52 in eighth-grade math

• from 25th/38 (1998) to 42nd/52 in eighth-grade reading.

5. TVAAS tells us almost nothing about teacher effectiveness.

While other states are making gains, Tennessee has remained stagnant or lost ground since 1992 — despite an increasingly heavy use of TVAAS data.

So, if TVAAS isn’t helping kids, it must be because Tennessee hasn’t been using it right, right? Wrong. While education policy makers in Tennessee continue to push the use of TVAAS for items such as teacher evaluation, teacher pay, and teacher license renewal, there is little evidence that value-added data effectively differentiates between the most and least effective teachers.

In fact, this analysis demonstrates that the difference between a value-added identified “great” teacher and a value-added identified “average” teacher is about $300 in earnings per year per student.  So, not that much at all.  Statistically speaking, we’d call that insignificant.  That’s not to say that teachers don’t impact students.  It IS to say that TVAAS data tells us very little about HOW teachers impact students.

Surprisingly, Tennessee has spent roughly $326 million on TVAAS and attendant assessment over the past 20 years. That’s $16 million a year on a system that is not yielding much useful information. Instead, TVAAS data has been used to mask a persistent performance gap between middle to upper income students and their lower-income peers.  Overall student achievement in Tennessee remains stagnant (which means we’re falling behind our neighboring states) while politicians and policy makers tout TVAAS-approved gains as a sure sign of progress.

In spite of mounting evidence contradicting the utility of TVAAS, Commissioner Huffman and Governor Haslam announced last week they want to “improve” Tennessee teacher salaries along the lines of merit — and in their minds, TVAAS gains are a key determinant of teacher merit.

Perhaps 2014 will at least produce questions from the General Assembly about the state’s investment in an assessment system that has over 20 years yielded incredibly disappointing results.

For more on Tennessee education politics and policy, follow us @TNEdReport