A Matter of Fairness

A coalition of education advocacy groups released an online petition today calling for a one year waiver from using student test scores in teacher evaluations in Tennessee.

Here’s the press release:

A coalition of groups supporting public education today launched an online petition asking the Tennessee General Assembly and Governor Bill Haslam to grant teachers a grace period from the use of student test scores in their evaluations in the first year of new TNReady tests. The petition tracks language adopted unanimously by the Knox County School Board, which passed a resolution last week opposing the use of student test scores in teacher evaluation for this academic year.

“The state has granted waivers so that TNReady scores aren’t required to be counted in student grades for this year,” said Lyn Hoyt, president of Tennesseans Reclaiming Educational Excellence (TREE). “If TNReady won’t count in student grades, it’s only fair that it shouldn’t count for teacher evaluation.” Hoyt noted that the transition to the new test means entering uncharted territory in terms of student scores and impact on teacher evaluation scores. As such, she said, there should be a one year or more grace period to allow for adjustment to the new testing regime.

“TNReady is different than the standardized tests we’ve had in the past,” Hoyt said. “Our students and teachers both deserve a reasonable transition period. We support the Knox County resolution and we are calling on the General Assembly to take notice and take action. Taking a thoughtful path transitioning to the new test can also build confidence and trust in the process.”

Hoyt also cited a recent policy statement by the American Educational Research Association that cautions against using value-added data in teacher evaluations and for high-stakes purposes. “Researchers who study value-added data are urging states to be cautious in how it is used to evaluate teachers,” Hoyt said. “The transition to TNReady is the perfect time to take a closer look at how test scores are used in teacher evaluations. Let’s take a year off, and give our students and teachers time to adjust. It’s a matter of fundamental fairness.”

Groups supporting the petition include:

Strong Schools (Sumner County)
Williamson Strong (Williamson County)
SPEAK (Students, Parents, Educators Across Knox County)
SOCM (Statewide Organizing for Community eMpowerment)

Middle TN CAPE (Coalition Advocating for Public Education)
Momma Bears Blog
Advocates for Change in Education (Hamilton County)
Concerned Parents of Franklin County (Franklin County)
Parents of Wilson County, TN, Schools
Friends of Oak Ridge Schools (City of Oak Ridge Schools)
TNBATs (State branch of National BATs)
TREE (Tennesseans Reclaiming Educational Excellence)
TEA (Tennessee Education Association)

For more on education politics and policy in Tennessee, follow @TNEdReport

New and Not Ready

Connie Kirby and Carol Bomar-Nelson, English teachers at Warren County High School, share their frustration with the transition to TNReady and what it means for teacher evaluation.

Connie Kirby:

This is going to be long, but I don’t usually take to social media to “air my grievances.” Today I feel like there’s no better answer than to share how I feel. It’s been a long year with some of the highest of the highs and lowest of the lows. I work in a wonderful department at a great school with some of the most intelligent, hard-working people I know. As the years have progressed, we have gone through many changes together and supported each other through the good and the bad (personally and professionally). We do our best to “comply” with the demands that the state has put on us, but this year everything that we’ve been hearing about and preparing for for years has come to fruition. We’re finally getting familiar with the “real deal” test, instead of dealing with EOCs and wondering how it’s going to change. I’ve seen the posts and rants about Common Core and have refrained from jumping on the bandwagon because I have had no issues with the new standards. I do, however, see an issue with the new assessment, so I have held my hand in the hopes that I might find something worth sharing and putting my name next to. Today, I witnessed an exchange between one of my colleagues and the state, and I couldn’t have said it better myself. With her permission, I am sharing her words.

Carol Bomar-Nelson:

I don’t know how to fix the problems with the test. I agree that teachers should have accountability, and I think student test scores are one way of doing that. Having said that, if the state is going to hold teachers accountable for student test scores, then the test needs to be fair. From what I have seen, I firmly believe that is not the case. I am not just basing this conclusion on the one “Informational Test” in MICA. Other quizzes I have generated in MICA have had similar flaws. When my department and I design common assessments in our PLC’s, we all take the tests and compare answers to see which questions are perhaps ambiguous or fallacious in some way. I do not see any evidence that the state is doing this for the tests that it is manufacturing. A team of people can make a test that is perfect with respect to having good distractors, clear wording, complex passages, and all the other components that make up a “good” test, but until several people take the test, compare answers, and discuss what they missed, that test is not ready for students to take–especially not on a high stakes test that is supposed to measure teacher effectiveness. I understand that this is the first year of this test. I am sympathetic to the fact that everyone is going through a ‘learning process’ as they adapt to the new test. Students have to learn how to use the technology; teachers have to learn how to prepare their students for a new type of tests; administrators have to figure out how to administer the test; the state has to work out the kinks in the test itself…The state is asking everyone to be “patient” with the new system. But what about for the teachers? Yes, the teacher effectiveness data only counts for 10% this year, but that 10% still represents how I am as a teacher. In essence, this new tests is like a pretest, correct? A pretest to get a benchmark about where students stand at the end of the year with this new test that has so many flaws and so many unknowns. In the teaching profession, I think all would agree that it is bad practice to count a pretest AT ALL for a student’s grade. Not 35%, not 25%, not even 10%. So how is it acceptable practice to count a flawed test for 10% of a teacher’s evaluation? We can quibble all day about which practice questions…are good and which questions are flawed, but that will not fix the problem. The problem lies in the test development process. If the practice questions go through the same process as the real questions, it would stand to reason that the real test questions are just as flawed as the practice questions. My students have to take that test; I never get to see it to determine if it is a fair test or not, and yet it still counts as 10% of my evaluation that shows my effectiveness as a teacher. How is that fair in any way whatsoever? In what other profession are people evaluated on something that they never get to see? Especially when that evaluation ‘tool’ is new and not ready for use?

I know how to select complex texts. I know how to collaborate with my PLC. I can teach my students how to read, think critically, analyze, and write. When I do not know how to do something, I have no problem asking other teachers or administrators for suggestions, advice, and help. I am managing all of the things that are in my control to give my students the best possible education. Yet in the midst of all of these things, my teacher accountability is coming from a test that is generated by people who have no one holding them accountable. And at the end of the year, when those scores come back to me, I have no way to see the test to analyze its validity and object if it is flawed.

For more on education politics and policy in Tennessee, follow @TNEdReport

Not Yet Ready for Teacher Evaluation?

Last night, the Knox County Board of Education passed a resolution asking the state to not count this year’s new TNReady test in teacher evaluation.

Board members cited the grace period the state is granting to students as one reason for the request. While standardized test scores count in student grades, the state has granted a waiver of that requirement in the first year of the new test.

However, no such waiver was granted for teachers, who are evaluated using student test scores and a metric known as value-added modeling that purports to reflect student growth.

Instead, the Department of Education proposed and the legislature supported a plan to phase-in the TNReady scores in teacher evaluations. This plan presents problems in terms of statistical validity.

Additionally, the American Educational Research Association released a statement recently cautioning states against using value-added models in high-stakes decisions involving teachers:

In a statement released today, the American Educational Research Association (AERA) advises those using or considering use of value-added models (VAM) about the scientific and technical limitations of these measures for evaluating educators and programs that prepare teachers. The statement, approved by AERA Council, cautions against the use of VAM for high-stakes decisions regarding educators.

So, regardless of the phase-in of TNReady, value-added models for evaluating teachers are problematic. When you add the transition to a new test to the mix, you only compound the existing problems, making any “score” assigned to a teacher even more unreliable.

Tullahoma City Schools Superintendent Dan Lawson spoke to the challenges with TVAAS recently in a letter he released in which he noted:

Our teachers are tasked with a tremendous responsibility and our principals who provide direct supervision assign teachers to areas where they are most needed. The excessive reliance on production of a “teacher number” produces stress, a lack of confidence and a drive to first protect oneself rather than best educate the child.

It will be interesting to see if other school systems follow Knox County’s lead on this front. Even more interesting: Will the legislature take action and at the least, waive the TNReady scores from teacher evaluations in the first year of the new test?

A more serious, long-term concern is the use of value-added modeling in teacher evaluation and, especially, in high-stakes decisions like the granting of tenure, pay, and hiring/firing.

More on Value-Added Modeling

The Absurdity of VAM

Unreliable and Invalid

Some Inconvenient Facts About VAM

For more on education politics and policy in Tennessee, follow @TNEdReport

 

TSBA Leader Named to Education Commission of the States

The Tennessee School Boards Association has announced that its Executive Director, Dr. Tammy Grissom, has been named to the Education Commission of the States:

TSBA is pleased to announce that Governor Bill Haslam has appointed Dr. Tammy Grissom, TSBA Executive Director, to the Education Commission of the States (ECS) as a Representative of state education policymaking.  ECS supports all 50 states and four territories – the District of Columbia, American Samoa, Puerto Rico andthe Virgin Islands. Each state appoints seven commissioners who help guide the work of ECS and their own state’s education agendas. Commissioners also have the authority to approve amendments to bylaws and provide strategic information to ECS staff regarding state education policy issues.  Governor Haslam’s comments about Dr. Grissom were, “ your individual characteristics and professional qualifications were exceptional among the number of nominees who expressed interest and your participation is certain to leave a positive impact on this board and the work it does.”

For more on education politics and policy in Tennessee, follow @TNEdReport

Lunchtime Lecture on Chamber Education Initiatives

The Tennessee Chapter of the American Society for Public Administration (TN-ASPA) will host a lunchtime lecture tomorrow on the Nashville Chamber of Commerce’s K-12 Education initiatives. The event is free and open to the public.

Here’s the press release:

TN-ASPA hosts the third lunchtime lecture in our Fall series on Education in Tennessee and Nashville. Rita McDonald will speak on the Nashville Chamber’s K-12 education initiatives.

  • Who: Rita McDonald, Nashville Area Chamber of Commerce
  • Topic: Nashville Chamber of Commerce K-12 Education Initiatives
  • When: Thursday, November 19, 2015, 12noon1pm
  • Where: UT Center for Industrial Services
    2nd Floor Training Room
    193 Polk Avenue, Nashville, TN
    (Parking available on-site, please park in the front of building and enter through the middle entrance under the “T”)
The Nashville Area Chamber of Commerce has set improvement of public education as its number one priority. The Chamber focuses on helping metro public school students succeed and on getting the community and business leaders involved in public education. The Chamber has several K-12 education programs and initiatives, including the Education Report Card, Freshman Career Exploration Fairs, speaker series, and awards.
Rita McDonald, the Director of Community and Business Engagement in Education with the Nashville Area Chamber of Commerce, will speak on:

  • Why public education is the Chamber’s #1 priority
  • the Chamber’s major initiatives to improve public education
  • the major challenges and opportunities in public education in Nashville
  • the Chamber’s positions on key local and state public policy issues related to education
Lecture is FREE and open to the public.
For more on education politics and policy in Tennessee, follow @TNEdReport

Dear SC: Don’t Believe the Hype

South Carolina’s State Supreme Court has ruled that the education system in that state is not adequate for all students. Now, the legislature must find a solution that will deliver on the promise of equal access to education.

As P. L. Thomas notes, among the possible solutions being floated to help improve the situation is an Achievement School District, modeled after similar districts in Tennessee and Louisiana.

In fact, in a recent op-ed, one teacher and education blogger who Thomas notes is at least loosely affiliated with Students First, puts forth an Achievement School District as a key solution to the state’s education woes.

The piece directs readers to a website that advocates for the creation of an Achievement School District (ASD) in South Carolina.

That site, under the heading “Proven Results” cites Tennessee as a place where an ASD has positively impacted the education landscape.

What results? Well, the results outlined in a press release from the TN ASD touting its own success.

What is not mentioned is a thorough look at the numbers offered by Gary Rubinstein. The key finding from Rubinsteins analysis:

As you can see, four of the original six schools are still in the bottom 5% while the other two have now ‘catapulted’ to the bottom 6%.

The schools under ASD control the longest didn’t improve all that much. In fact, contrary to the attitude reflected in the pro-South Carolina ASD op-ed, Tennessee’s first ASD Superintendent, Chris Barbic said:

“As a charter school founder, I did my fair share of chest pounding over great results,” he wrote. “I’ve learned that getting these same results in a zoned neighborhood school environment is much harder.”

Another item not mentioned is that Tennessee’s ASD took over a school that was outperforming other ASD schools.

That’s a result, I contend, of the ASD expanding beyond its original mission. If policymakers in South Carolina do go the ASD route, they should build in safeguards against this sort of unchecked expansion.

Finally, South Carolina’s lawmakers should ask if the sort of educational disruption caused by an ASD does more harm than good.

Certainly, South Carolina must take action to improve the education environment there. However, as they explore creation of an ASD, I would suggest they proceed with extreme caution.

For more on education politics and policy in Tennessee, follow @TNEdReport

 

 

They Noticed

Tom Humphrey reports that school boards across the state have noticed that this year’s BEP Review Committee report is missing a few items that total some $500 million or more in shortfalls in the state’s funding of schools.

From his story:

Last week the Bradley board, also part of the suit, passed a resolution denouncing the exclusion of the recommendations and calling on the TSBA to adopt its own resolution “calling upon State officials to fund the true cost of educating Tennessee students, specifically to include the cost components recognized and recommended by the BEP Review Committee in past years.”

That’s what happened Sunday night, when 217 of the 219 delegates voted for the resolution seeking full funding of past priorities.

I noted earlier that the Committee’s omissions this year amounted to, “a deliberate attempt to avoid tough issues.”

And, it’s not like the state is short on funds to actually begin properly investing in schools. In fact, there’s a surplus that’s projected to be at least $1 billion by the end of this fiscal year.

For more on education politics and policy in Tennessee, follow @TNEdReport

School Discipline Panel in Nashville

Three advocacy groups are hosting a panel on discipline in public schools tomorrow night in Nashville.

From a press release:

Public school discipline in Nashville is a topic of discussion among parents, city leaders and educators in MNPS. What is the best way to keep children on task and learning in the classroom? What can reduce suspension rates and drop out rates?

There are two methods at work in MNPS and in local charter schools. One is a very strict approach called “No-Excuses Discipline”, lauded for results that improve classroom control. But, is criticized for an oppressive approach to zero-tolerance and punitive measures. The other method is restorative justice that works to lower rates of suspension and expulsion and to foster positive school climates with the goal of eliminating racially disproportionate discipline practices and the resulting push-out of students into the prison pipeline. Both methods are used in charters and in MNPS.

“We are pleased to bring together advocates locally and from across the country to discuss different discipline efforts we are seeing in MNPS.” says Lyn Hoyt, president of TREE. “As a community we need to understand what is working and what is not. We hope this panel can share stories and methods to better refine the social emotional growth of our children.”

National experts on charter school discipline, along with local parents and teachers who have experienced no-excuses and restorative justice school environments will make up the panel set to convene November 17th at Margaret Allen Middle School, 500 Spence Lane in Nashville at 6:30 pm.

Joining the panel is New Orleans native Ramon M. Gri­ffin, a third-year Ph.D student in K-12 Educational Administration at Michigan State University. His research interests include urban education, urban community engagement and the intersection between trauma exposure, PTSD and discipline policies in no-excuses charter school culture.

From the Annenberg Standards: ” Community-based groups have fought for, and in many cases won, new district-wide discipline policies that focus on restorative practices, eliminate or reduce the role of police in schools, and end out-of-school suspension. But most of these new discipline policies apply only to traditional public schools. Charter schools in most states are free to design their own protocols for student discipline. Increasingly, community-based and youth organizing groups are expanding their campaigns for just and fair discipline policies to include charter schools.”

Middle Tennessee Coalition Advocating for Public Education (CAPE) is a regional coalition that organizes actions advocating for public education. facebook.com/MTCAPE

Tennesseans Reclaiming Educational Excellence (TREE) is a state-wide volunteer advocacy organization rooted in fighting for strong, equitable public education and is committed to growing child-centered education policy. treetn.org

Statewide Organizing for Community eMpowerment (SOCM) is a member-run organization that encourages civic involvement and collective action so that the people of Tennessee have a greater voice in determining their future. We have been working for social, economic, and environmental justice in Tennessee for more than 40 years. http://www.socm.org/

For more on education politics and policy in Tennessee, follow @TNEdReport

It’s Raining Money, But Not on Schools

Tom Humphrey reports on the most recent budget projections which predict a surplus of between $300-$400 million for the fiscal year ending June 30, 2016.

This money, combined with the $600 million surplus from the fiscal year which ended on June 30, 2015, means the state will have about $1 billion in unanticipated, uncommitted revenue.

On top of that, economists are projecting growth in the $400-$500 million range for the upcoming budget year.

As Humphrey notes, proposals are floating so spend the surplus on road projects or tax cuts or both.

What’s not being mentioned?

Schools.

Despite a pair of lawsuits contending the state’s school funding formula, the BEP, is inadequate, lawmakers and the Governor are not rushing to suggest significant new investments in Tennessee schools.

This in spite of the fact that after a one year bounce on NAEP results, our state is now holding flat. Maybe that’s because Senate Education Committee Chair Dolores Gresham is suggesting our state aspire toward “mediocrity” while holding a forum on disastrous (and expensive) school voucher schemes.

If the state invested half of the available surplus on the BEP formula, that would be a $500 million injection of funds to local schools. That would be a sure way to hold down local property tax increases while also beefing up the resources school systems have to provide an education. The revenue projections for the 2016-17 fiscal year indicate an investment of this magnitude is sustainable. And, by holding a portion of the surplus in reserve, the state could ensure against any unanticipated shortfalls.

All of that would still leave $200-$300 million available to spend on one-time costs like road projects.

Will Tennessee put its foot on the accelerator and invest in schools so our students have the resources they need to compete with the rest of the country? Will Bill Haslam use the surplus and projected new revenue to truly make Tennessee the fastest improving state in the nation in teacher pay?

The General Assembly will have answers to these questions starting in January.

For more on education politics and policy in Tennessee, follow @TNEdReport

It All Comes Down to a Number

Dan Lawson is the Director of Schools for Tullahoma City Schools. He sent this message and the American Educational Research Association press release to a group of Tennessee lawmakers.

I am the superintendent of Tullahoma City Schools and in light of the media coverage associated with Representative Holt and a dialogue with teachers in west Tennessee I wanted to share a few thoughts with each of who represent teachers in other districts in Tennessee. I am thankful that each of you have a commitment to service and work to cultivate a great relationship with teachers and communities that you represent.

While it is certainly troubling that the standards taught are disconcerting in that developmental appropriateness is in question by many, and that the actual test administration may be a considerable challenge due to hardware, software and capacity concerns, I think one of the major issues has been overlooked and is one that could easily address many concerns and restore a sense of confidence in many of our teachers.

Earlier this week the American Educational Research Association released a statement (see below) cautioning states “against the use of VAM for high-stakes decisions regarding educators.” It seems to me that no matter what counsel I provide, what resources I bring to assist and how much I share our corporate school district priorities, we boil our work and worth as a teacher down to a number. And for many that number is a product of how well they guess on what a school-wide number could be since they don’t have a tested area.

Our teachers are tasked with a tremendous responsibility and our principals who provide direct supervision assign teachers to areas where they are most needed. The excessive reliance on production of a “teacher number” produces stress, a lack of confidence and a drive to first protect oneself rather than best educate the child. As an example, one of my principals joined me in meeting with an exceptional middle school math teacher, Trent Stout. Trent expressed great concerns about the order in which the standards were presented (grade level) and advised that our math department was confident that a different order would better serve our students developmentally and better prepare them for higher level math courses offered in our community. He went on to opine that while he thought we (and he) would take a “hit” on our eighth grade assessment it would serve our students better to adopt the proposed timeline. I agreed. It is important to note that I was able to dialogue with this professional out of a sense of joint respect and trust and with knowledge that his status with our district was solely controlled by local decision makers. He is a recipient of “old tenure.” However, don’t mishear me, I am not requesting the restoration of “old tenure,” simply a modification of the newly enacted statute. I propose that a great deal of confidence in “listening and valuing” teachers could be restored by amending the tenure statute to allow local control rather than state eligibility.

I have teachers in my employ with no test data who guess well and are eligible for the tenure status, while I have others who guess poorly and are not eligible. Certainly, the final decision to award tenure is a local one, but local based on state produced data that may be flawed or based on teachers other than the potential nominee. Furthermore, if we opine that tenure does indeed have value, I am absolutely lost when I attempt to explain to new teachers that if they are not eligible for tenure I may employ them for an unlimited number of added contracts but if they are eligible based on their number and our BOE decides that they will not award tenure to anyone I am compelled to non-renew those who may be highly effective teachers. The thought that statue allows me to reemploy a level 1 teacher while compelling me to non-renew a level 5 teacher seems more than a bit ironic and ridiculous.

I greatly appreciate your service to our state and our future and would love to see an extensive dialogue associated to the adoption of Common Sense.

The American Educational Research Association Statement on Value-Added Modeling:

In a statement released today, the American Educational Research Association (AERA) advises those using or considering use of value-added models (VAM) about the scientific and technical limitations of these measures for evaluating educators and programs that prepare teachers. The statement, approved by AERA Council, cautions against the use of VAM for high-stakes decisions regarding educators.

In recent years, many states and districts have attempted to use VAM to determine the contributions of educators, or the programs in which they were trained, to student learning outcomes, as captured by standardized student tests. The AERA statement speaks to the formidable statistical and methodological issues involved in isolating either the effects of educators or teacher preparation programs from a complex set of factors that shape student performance.

“This statement draws on the leading testing, statistical, and methodological expertise in the field of education research and related sciences, and on the highest standards that guide education research and its applications in policy and practice,” said AERA Executive Director Felice J. Levine.

The statement addresses the challenges facing the validity of inferences from VAM, as well as specifies eight technical requirements that must be met for the use of VAM to be accurate, reliable, and valid. It cautions that these requirements cannot be met in most evaluative contexts.

The statement notes that, while VAM may be superior to some other models of measuring teacher impacts on student learning outcomes, “it does not mean that they are ready for use in educator or program evaluation. There are potentially serious negative consequences in the context of evaluation that can result from the use of VAM based on incomplete or flawed data, as well as from the misinterpretation or misuse of the VAM results.”

The statement also notes that there are promising alternatives to VAM currently in use in the United States that merit attention, including the use of teacher observation data and peer assistance and review models that provide formative and summative assessments of teaching and honor teachers’ due process rights.

The statement concludes: “The value of high-quality, research-based evidence cannot be over-emphasized. Ultimately, only rigorously supported inferences about the quality and effectiveness of teachers, educational leaders, and preparation programs can contribute to improved student learning.” Thus, the statement also calls for substantial investment in research on VAM and on alternative methods and models of educator and educator preparation program evaluation.

The AERA Statement includes 8 technical requirements for the use of VAM:

  1. “VAM scores must only be derived from students’ scores on assessments that meet professional standards of reliability and validity for the purpose to be served…Relevant evidence should be reported in the documentation supporting the claims and proposed uses of VAM results, including evidence that the tests used are a valid measure of growth [emphasis added] by measuring the actual subject matter being taught and the full range of student achievement represented in teachers’ classrooms” (p. 3).
  2. “VAM scores must be accompanied by separate lines of evidence of reliability and validity that support each [and every] claim and interpretative argument” (p. 3).
  3. “VAM scores must be based on multiple years of data from sufficient numbers of students…[Related,] VAM scores should always be accompanied by estimates of uncertainty to guard against [simplistic] overinterpretation[s] of [simple] differences” (p. 3).
  4. “VAM scores must only be calculated from scores on tests that are comparable over time…[In addition,] VAM scores should generally not be employed across transitions [to new, albeit different tests over time]” (AERA Council, 2015, p. 3).
  5. “VAM scores must not be calculated in grades or for subjects where there are not standardized assessments that are accompanied by evidence of their reliability and validity…When standardized assessment data are not available across all grades (K–12) and subjects (e.g., health, social studies) in a state or district, alternative measures (e.g., locally developed assessments, proxy measures, observational ratings) are often employed in those grades and subjects to implement VAM. Such alternative assessments should not be used unless they are accompanied by evidence of reliability and validity as required by the AERA, APA, and NCME Standards for Educational and Psychological Testing” (p. 3).
  6. “VAM scores must never be used alone or in isolation in educator or program evaluation systems…Other measures of practice and student outcomes should always be integrated into judgments about overall teacher effectiveness” (p. 3).
  7. “Evaluation systems using VAM must include ongoing monitoring for technical quality and validity of use…Ongoing monitoring is essential to any educator evaluation program and especially important for those incorporating indicators based on VAM that have only recently been employed widely. If authorizing bodies mandate the use of VAM, they, together with the organizations that implement and report results, are responsible for conducting the ongoing evaluation of both intended and unintended consequences. The monitoring should be of sufficient scope and extent to provide evidence to document the technical quality of the VAM application and the validity of its use within a given evaluation system” (AERA Council, 2015, p. 3).
  8. “Evaluation reports and determinations based on VAM must include statistical estimates of error associated with student growth measures and any ratings or measures derived from them…There should be transparency with respect to VAM uses and the overall evaluation systems in which they are embedded. Reporting should include the rationale and methods used to estimate error and the precision associated with different VAM scores. Also, their reliability from year to year and course to course should be reported. Additionally, when cut scores or performance levels are established for the purpose of evaluative decisions, the methods used, as well as estimates of classification accuracy, should be documented and reported. Justification should [also] be provided for the inclusion of each indicator and the weight accorded to it in the evaluation process…Dissemination should [also] include accessible formats that are widely available to the public, as well as to professionals” ( p. 3-4).

The bottom line:  Tennessee’s use of TVAAS in teacher evaluations is highly problematic.

More on TVAAS:

Not Yet TNReady

The Worst Teachers

Validating the Invalid

More on Peer Assistance and Review:

Is PAR a Worthy Investment?

For more on education politics and policy in Tennessee, follow @TNEdReport