How to Properly Deploy a New Teacher Evaluation System

Like Tennessee, Kentucky has a new teacher evaluation model — The Professional Growth and Effectiveness System (PGES). Similar to reforms in Tennessee, the new model uses multiple measures to evaluate teachers, including classroom observation and student growth.

Unlike Tennessee, Kentucky has rolled out its new evaluation in phases, improving it along the way based on feedback from teachers and administrators.

Here’s a description of how the model, to be fully implemented in 2014-15, has been rolled out:

During the 2012-2013 school year, over 50 school districts in Kentucky have participated in a field test of the new system.  The field test has allowed educator experience and feedback to inform improvements prior to the statewide pilot during the 2013-2014 school year.  During the statewide pilot in 2013-2014, as least 10% of the schools in each district will implement the Professional Growth & Effectiveness System.  In 2014-2015 the system will be fully implemented statewide with full accountability in Spring 2015.

That’s two years of pilot work before a single teacher is held fully accountable for the results of the new system.  Of course, those evaluated get the chance to have their practice informed by the strengths of the new system. But they also are not held back by problems that may need reform or improvement.

Contrast that with Tennessee, which implemented a new evaluation system in 2011-12.  Teachers were responsible for meeting the evaluation standards immediately.  There was no statewide pilot, no partial implementation, testing, and then improvement.  The evaluation has been changed or “improved” along the way, but that process has caused confusion as the standard by which teachers are evaluated seems to change from year to year.

Yes, there are strengths to evaluating teachers through multiple measures. Certainly, the old evaluation system warranted improvement.  But the implementation process directed by the Department of Education failed to adequately take into account teacher and administrator feedback. A more measured approach, as seen in Kentucky, could have helped build educator support and buy-in and could have improved the process without the fear that comes with instant accountability for a previously unused standard.

It’s not too late for Tennessee to “re-launch” it’s evaluation process in light of new Common Core tests.  A suspension of the use of TVAAS for teacher evaluation, as called for by PET and others could allow the state to re-examine the evaluations and phase-in improvements, fully implementing the new system as Common Core tests replace the old TCAP and EOC tests.

Doing so would require a step back from the rapid pace of recent reforms in the state. But the best way forward is not always the fastest. Tennessee would do well to emulate our neighbors, slow down, and focus on getting education reform right.

For more on Tennessee education politics and policy, follow us @TNEdReport

 

A Case Against Vouchers

Memphis teacher Jon Alfuth writes a compelling piece arguing against the adoption of vouchers in Tennessee.

Here’s an excerpt providing some very good reasons why vouchers should be looked at skeptically by Tennessee lawmakers:

Voucher programs also struggle to achieve their mission of providing low-income students with a way out of failing schools.  For example a critical study of the Milwaukee program found that it overwhelmingly helped those already receiving education through private means.  Two thirds of Milwaukee students using the voucher program in the city already attended private schools.  Instead of increasing mobility for low-income students, the program primarily served to perpetuate status quo.

Voucher programs have also caused to students inadvertently attending failing schools, thereby maintaining the very problem they are meant to solve.  It’s often difficult to determine the quality of the schools serving voucher students because private schools are not required to make public the same amount of student data as public schools.  An example of this occurring can be found right next door in Louisiana where approximately 2250 students were recently found to be attending failing schools through the state’s voucher program.

Alfuth writes from the perspective of a teacher at a charter school who supports much of the current education reform agenda, including expansion of school choice.  His concerns about vouchers are reasonable, fair, and insightful.

For more on Tennessee education politics and policy, follow us @TNEdReport

 

 

PET Agenda

Professional Educators of Tennessee (PET) recently released their 2014 legislative agenda.  They have three key areas of focus for the upcoming legislative session.

1) Teacher Licensure. PET is asking for a straightforward, common sense appeal process to address concerns regarding the proposed changes to teacher licensure. PET has also been asking for the suspension of the use of TVAAS data until Common Core is fully implemented. The group also mentions a need to focus on teacher remediation and targeted professional development.

2) Student/Teacher Data. PET is seeking legislation that will ensure the privacy of both student and teacher data.  Specifically, they want to ensure no personally identifiable data on students and their families religion, political affiliation, psychometric data, biometric information, or voting history is collected or otherwise tracked and that such data is not provided to either the federal government or private vendors.  They are also seeking limits on who may access teacher evaluation data.

3) Testing. PET notes the “overuse of testing in our schools” as a key area of concern.  While PET notes that testing comes with good intentions, the result of an increased focus on testing is now a “detriment to public education.” PET suggests policies that find a balance between the need to assess in order to gain knowledge about what’s working and what’s not working for kids and the over-reliance on tests for uses beyond their intended, useful purpose.

For more on Tennessee education policy and politics, follow us @TNEdReport

 

 

Time to Fix the BEP?

The Metro Nashville School Board this week suggested that the state revise and improve its funding formula for schools, known as the BEP.

A resolution drafted by board member Amy Frogge and passed unanimously by the MNPS board indicates that the current formula does not allow districts to properly implement rigorous news standards and provide improved salaries for teachers.

If legislators and Governor Haslam want to take a look at improving the BEP, they need only take a look at the BEP 2.0 formula developed under Governor Phil Bredesen with significant input from then-state Senator Jamie Woodson, who now heads SCORE.

Of course, current Metro board member Will Pinkston was a key Bredesen staffer when the BEP 2.0 formula was developed, so he’s quite familiar with how it would improve the funding situation not just for MNPS but for most districts in the state.

Fully funding BEP 2.0 may take incremental steps and perhaps could be complete in two to three years with some focus and budget prioritization from the General Assembly and the Governor.

If the current formula is not re-examined and improved, it seems likely that districts large and small will continue to complain of mandates coming from the state without adequate funding for their implementation.

For more on Tennessee education politics and policy, follow us @TNEdReport

Strategies for Retaining Educators

Memphis teacher and blogger Jonathan Alfuth writes about strategies for retaining educators in an urban environment.

This past June, I completed my second year as a Teach for America teacher.  I’d worked in one of the most struggling high schools in Memphis but rather than being scared away, it strengthened my commitment to teaching.  Yet I knew that there was no way I’d return to my placement school.  The culture didn’t promote student achievement, individual teachers operated in isolation and we had little shared vision for where we were going as a school.

Over the next few weeks, I did a comprehensive search of schools across Memphis. While I turned up several schools that I believed embodied the type of culture I desired, none of them were Shelby County Schools (all were charter).  I made the choice to move to a charter school and I’ve been amazed by the difference in culture and its impact on student achievement.  Our leaders are hardworking and dedicated to a common mission.  My colleagues and I are given common planning time in content and grade level teams each and every week. And most importantly, we work together to develop the kind of school culture that drives students to success.  I see its impact each and every day in the quality of my students work and their academic outcomes as so far, 100% of our graduating students have been accepted to 4-year schools.

My dilemma was recently discussed at the policy level in Shelby County during the school board’s decision whether or not to extend Teach for America’s contract with the district.  The board voted to extend the contract, but the two opponents of extending the contract cited poor TFA retention beyond the program’s two year commitment in their opposition to its continuation.  In the same piece, she also quoted Superintendent Hopson in a statement that perfectly encompasses my dilemma and the dilemma of second year TFA teachers every year.  Hopson said, “I have to say, if effective talent is leaving the district at a 70-something percent rate, we have to look at strategies we can use to retain talent.”

I often find myself thinking that we’ve done so much to improve education both here in Memphis and across Tennessee.  We’ve reformed teacher evaluation to identify our best and brightest.  We’re on the verge of dramatically reforming teacher compensation in Tennessee.   And yet all this means NOTHING if we cannot keep great teachers in high need classrooms once they are placed.  This begs the question; what do educators really want?  What will keep them in district classrooms?  In my experience, young education professionals, TFA or otherwise, aren’t much different from most other young professions.  We all have highly varied motivations for entering the profession.  But in the end, great teachers gravitate towards environments with great school and district leaders, great office (or in this case school) culture that focuses on achievement and great colleagues that work together to achieve a common vision.

I am a TFA alumni but I also work closely with young educators from both alternative and traditional certification programs.  And I believe strongly that my decision is one that almost every young educator in Shelby County faces at some point in their first two years.  At the end of two years, many young educators, TFA or otherwise, feel a strong sense of commitment to their children and a desire to continue in education.  However, we are often placed in such dysfunctional environments that we have to make a choice which feels like choosing between being a martyr for our kids by staying or abandoning them by quitting or moving schools.  And so often the challenges inherent in district schools make the former untenable, and so we leave, either choosing a different school like I have or leaving the profession all together.

I should add that some schools in Shelby County have found a way to make it work and retain young educators beyond their first few years.  Colleagues of mine at Ridgeway High, Whitehaven and Kingsbury High consistently tell me about the strength of their school leadership and the support they receive from their colleagues.  We should certainly study these schools further, but they represent the exception rather than the norm.

Until district leaders devote attention to improving school cultures to make them attractive and professional work environments that attract young educators, we will continue to see an exodus of young teaching talent to other systems, schools or professions.  And it won’t matter what program those educators come from if conditions are so challenging that teachers can’t fathom working in high need environments.  We can extend or eliminate contracts with organizations like Teach for America, but that won’t fix the underlying fact that many young educators simply don’t feel that the school culture where the work is one where they can be successful.

I don’t want to leave this post without offering some solutions.  I’ve already written a seven part series on a package of strategies that could be used to promote teacher retention in SCS, so I  won’t rehash it here. If you’re interested in some research based strategies for how we could start building the types of school cultures that attract and retain high quality educators by enacting district level policies, I invite you to check the series out here.

Jonathan Alfuth is a math teacher at a charter school in Memphis.  He blogs about education issues at Bluff City Ed

For more on Tennessee education politics and policy, follow us @TNEdReport

 

Value-Added Transparency

At a working session last night, the Knox County School Board announced a collaborative effort to push for transparency in the Tennessee Value-Added Assessment System (TVAAS).  The idea is to ensure that teachers understand the inputs that create the value-added score that makes up 50% of their overall evaluation in the TEAM model.

From Tamara Shepherd via KnoxViews:

Finally, the board is collaborating on a resolution to be delivered to the legislature to urge, if I understood correctly, legislators’ assistance in ensuring that the mechanics of TVAAS be made understandable to teachers.

Some conversation ensued concerning the potential for employing a different model for measuring student growth if Sanders/TVAAS cannot honor the resolution’s request, given that TVAAS is proprietary property

 

Bill Sanders, creator of TVAAS, has been reluctant to give much detail about TVAAS over the years.  As the story explains, it seems that there could be a push for using a different model that is more transparent if the current value-added model can’t be made transparent.

While there are doubts about the validity and reliability of TVAAS data in general, at the very least, the method for arriving at a teacher’s score should be made transparent.

Lots of other happenings at the meeting.  Read more here.

For more on Tennessee education politics and policy, follow us @TNEdReport

Voucher Backers Gearing up for 2014

Following a 2013 legislative session that saw voucher proposals competing and ultimately, no proposal succeeding, advocates for a vouchers, or “opportunity scholarships,” are gearing up for the 2014 legislative session.

2014 in education will likely look a lot like 2013 in terms of proposals on vouchers and charter schools.

Voucher advocates, organized under a coalition known as School Choice NOW, held a recent event in Hendersonville. There, they noted that this year’s discussions will start with Governor Haslam’s proposal from last session.  His proposal was a limited voucher plan that would initially offer 5000 vouchers in Memphis and Nashville and eventually grow to 20,000.  While it seems no competing proposal will be offered, it’s not clear what shape the final legislation will take.

Lawmakers in Chattanooga also recently discussed vouchers, with a solid pro-voucher bent coming from that delegation.

One possible stumbling block is the rapid pace of recent education reforms.  Some in the legislature, including House Speaker Beth Harwell, are suggesting that perhaps school systems need time to absorb the current crop of reforms before vouchers are allowed to move forward.

For more on Tennessee education politics and policy, follow us @TNEdReport

Raj Chetty and Tennessee Education Policy

No, Raj Chetty, economics professor at Harvard,  is not specifically making recommendations to Tennessee about how to conduct education policy.  But he did join with other scholars to analyze Tennessee’s STAR program (1985-1989) for early education (K-3) which included students in 79 Tennessee schools and random student assignment.

The results of Chetty’s study suggest that the quality of a kindergarten class matters greatly to a child’s future.  It’s important to note that the study focused on the overall quality of the class — from the teacher to the resources provided to class size to peer group.  So, yes, quality matters.  And certainly, the teacher is a factor in that overall quality picture.

Chetty notes that a top quartile teacher (based on test scores) can make a significant difference in lifetime income for a child.  Yes, I’ve been critical about the “big” differences Chetty notes in terms of lifetime income in other studies. And, I certainly have questions about how important this particular finding is in terms of overall income impact. And then there’s the whole notion about the limitations of the knowledge we can gain about an individual teacher based on test scores alone.

That said, Chetty does note the findings are statistically significant and his study does control for many outside factors in order to isolate classroom inputs.

Moreover, the current Tennessee Department of Education policy framework is geared toward improving results on just these sorts of tests.

So, it becomes interesting, then to see what Chetty’s research says about how to improve results on such tests (which provide at least some predictive value about how a student will do later in life) and how that compares to current Tennessee education policy being pursued by the Haslam-Huffman regime.

1) Class Size Matters: According to the Chetty study, “Small-class students went on to attend college at higher rates and to do better on a variety of measures such as retirement savings, mar- riage rates, and quality of their neighborhood of residence.”  Which makes it difficult to understand why among the first proposals of Commissioner Huffman was to attempt to adopt a policy that would have raised class sizes across Tennessee.

2) Teacher Experience Matters: Contrary to what Commissioner Huffman told the State Board of Education about teacher experience (that a teacher’s years of experience don’t effectively predict student outcomes), the Chetty study noted, “We find that kindergarten teachers with more years of teaching experience are more effective at raising both kindergarten test scores and adult earnings. This may partly be the effect of learning on the job, but it may also reflect the fact that teachers who have taught for a long time are more devoted to the profession or were trained differently.” In spite of this Tennessee-specific data on the importance of years of experience to improved student outcomes, Commissioner Huffman proposed and the State Board of Education adopted a teacher pay plan that discounts years of experience as a factor in compensation.

3) Teacher Merit Pay is Problematic: When discussing the policy implications of the study, Chetty notes, “Merit pay policies could potentially improve teaching quality but may also
lead to teaching to the test without gains on the all- important noncognitive dimensions” (soft skills). Which, as stated above, would point to policies that move away from merit pay for individual teachers, in contrast to the Haslam-Huffman policy.

4) Teacher Support is Critical: Chetty specifically points to improved teacher training, early career mentoring, and reducing class sizes as policies that could work to improve the overall quality of early (K-3) classrooms.  Again, Tennessee has no statewide program for new teacher mentoring and is not systematically working on reducing class size, especially in the early grades.  In fact, as noted above, the initial proposal from this administration would have increased class sizes.

While I may be among the first to look skeptically at the current administration’s education policy goals, it would be nice if their policy solutions actually lined up with the stated goals.  In this case, using Tennessee data, it seems clear the proposed solutions are not matching the stated challenges.

For more on Tennessee education policy and politics, follow us @TNEdReport

Rutherford County to Consider Alternative Pay Plan

The Rutherford County School Board will begin discussions tonight on a new pay plan as required by the State Board of Education.  The State Board approved Commissioner Kevin Huffman’s recommendations for a new pay scale and a requirement that districts come up with differentiated pay schemes, including merit pay and pay based on performance on the Tennessee Value Added Assessment System (TVAAS).

TVAAS is facing continued criticism from some who don’t wish to tie teacher licensure to the scores it produces. It has also been suggested that TVAAS has done very little so far to improve Tennessee schools despite having been in existence for 20 years. And, some critics of value-added data note that it is unable to effectively differentiate among teachers.

It will be interesting to see the general outline of the pay plan discussed in Rutherford tonight as it may offer insight in to how the state is “guiding” districts to develop such plans.

For more on education politics and policy in Tennessee, follow us @TNEdReport

20 Years of TVAAS has Told Us Almost Nothing

Valerie Strauss has an interesting piece over at the Washington Post dealing with Value-Added Modeling.  More specifically, the post analyzes what can be learned from 20 years of the Tennessee Value-Added Assessment System (TVAAS) implemented as a result of the Education Improvement Act — the Act that created the Basic Education Program (Tennessee’s school funding formula, also known as BEP).

The promise of Value-Added Assessment was that we could learn a lot about which schools were working and which weren’t.  We could learn a lot about kids and how they were progressing.  We could even learn about teachers and how they were doing with all their students and with specific groups of students.  With all this information, Tennessee would intervene and take action that would move schools forward.

Unfortunately, that promise has not been delivered.  At all.

Here, I highlight the key takeaways from the Strauss piece.  Tennessee parents and policymakers should take note – TVAAS is taking up tax dollars and impacting teacher evaluations and it doesn’t really work all that well.

1. Using TVAAS masked persistently low proficiency rates.

The Tennessee value-added assessment model basically identified the schools that were already making required annual proficiency targets, but it failed to distinguish between schools with rising or declining proficiency scores.

In short, the Sanders Model did little to address the essential unfairness perpetuated by NCLB proficiency requirements, which insisted that those student further behind and with fewer resources than those in economically privileged schools had to work harder to reach the same proficiency point.  More importantly, there was no evidence that the Sanders version of value-added testing did anything to help or even predict the future outcomes for those furthest behind.

 

2. TVAAS is unstable and inappropriate for high-stakes decisions — like hiring and firing teachers, renewing licenses, or determining pay.

And despite the National Research Council and the National Academies’ flagging of value-added assessment as too unstable for high-stakes decisions in education …

…states like Tennessee rushed to implement a federally recommended system whereby value-added growth scores would come to dominate teacher evaluation for educators who teach tested subjects.  And contrary to the most basic notions of accountability and fairness, two-thirds of Tennessee teachers who teach non-tested subjects are being evaluated based on school-wide scores in their schools, rather than their own.

3. Continued use of TVAAS as an indicator of “success” leaves the most vulnerable students further and further behind.

In a 2009 Carnegie-funded report, Charles Barone points out that focus on value-added gains, or growth in test scores, may downplay the need for interventions to address low proficiency rates:  “Due to the projection toward proficiency being recalculated annually [in the TVAAS model], there is not necessarily a significant progression, over time toward proficiency . . . causing a delay of needed intervention at appropriate developmental times” (p. 8). So while showing academic progress, gain scores or growth scores easily mask the fact that minority and poor children are far below their well-heeled peers in becoming intellectually prepared for life and careers. And in masking the actual academic progress of the poor and minority students, the state (and the nation) is let off the hook for maintaining and supporting an adequate and equally accessible system of public education for all students. At the same time, politicians and ideologues can celebrate higher “progress rates” for poor and minority students who are, in fact, left further and further behind.

4. Tennessee has actually lost ground in terms of student achievement relative to other states since the implementation of TVAAS.

Tennessee received a D on K-12 achievement when compared to other states based on NAEP achievement levels and gains, poverty gaps, graduation rates, and Advanced Placement test scores (Quality Counts 2011, p. 46).  Educational progress made in other states on NAEP [from 1992 to 2011] lowered Tennessee’s rankings:

• from 36th/42 to 46th/52 in the nation in fourth-grade math[2]

• from 29th/42 to 42nd/52 in fourth-grade reading[3]

• from 35th/42 to 46th/52 in eighth-grade math

• from 25th/38 (1998) to 42nd/52 in eighth-grade reading.

5. TVAAS tells us almost nothing about teacher effectiveness.

While other states are making gains, Tennessee has remained stagnant or lost ground since 1992 — despite an increasingly heavy use of TVAAS data.

So, if TVAAS isn’t helping kids, it must be because Tennessee hasn’t been using it right, right? Wrong. While education policy makers in Tennessee continue to push the use of TVAAS for items such as teacher evaluation, teacher pay, and teacher license renewal, there is little evidence that value-added data effectively differentiates between the most and least effective teachers.

In fact, this analysis demonstrates that the difference between a value-added identified “great” teacher and a value-added identified “average” teacher is about $300 in earnings per year per student.  So, not that much at all.  Statistically speaking, we’d call that insignificant.  That’s not to say that teachers don’t impact students.  It IS to say that TVAAS data tells us very little about HOW teachers impact students.

Surprisingly, Tennessee has spent roughly $326 million on TVAAS and attendant assessment over the past 20 years. That’s $16 million a year on a system that is not yielding much useful information. Instead, TVAAS data has been used to mask a persistent performance gap between middle to upper income students and their lower-income peers.  Overall student achievement in Tennessee remains stagnant (which means we’re falling behind our neighboring states) while politicians and policy makers tout TVAAS-approved gains as a sure sign of progress.

In spite of mounting evidence contradicting the utility of TVAAS, Commissioner Huffman and Governor Haslam announced last week they want to “improve” Tennessee teacher salaries along the lines of merit — and in their minds, TVAAS gains are a key determinant of teacher merit.

Perhaps 2014 will at least produce questions from the General Assembly about the state’s investment in an assessment system that has over 20 years yielded incredibly disappointing results.

For more on Tennessee education politics and policy, follow us @TNEdReport