Category Archives: Teacher Evaluations

Posted on by

Waiver Wave

The MNPS School Board unanimously approved a resolution calling for a one-year waiver of the use of TNReady/TCAP scores in both student grades and teacher evaluation. The request follows Knox County’s passage of a similar resolution earlier this month.

Here’s what I wrote about why that was the right move:

Right now, we don’t know if we have a good standardized test. Taking a year to get it right is important, especially in light of the frustrations of last year’s TNReady experience.

Of course, there’s no need for pro-achievement and pro-teacher folks to be divided into two camps, either. Tennessee can have a good, solid test that is an accurate measure of student achievement and also treat teachers fairly in the evaluation process.

To be clear, teachers aren’t asking for a waiver from all evaluation. They are asking for a fair, transparent evaluation system. TVAAS has long been criticized as neither. Even under the best of circumstances, TVAAS provides a minimal levelof useful information about teacher performance.

Now, we’re shifting to a new test. That shift alone makes it impossible to achieve a valid value-added score.

Now, two large Tennessee school districts are calling for a waiver from using test data in student grades and teacher evaluations. Will other districts follow suit? Will the General Assembly pay attention?

Here’s the text of the Nashville resolution:

WHEREAS, the Metropolitan Nashville Public Schools Board of Education is responsible for providing a local system of public education; and
WHEREAS, the State of Tennessee, through the work of the Tennessee General Assembly, the Tennessee Department of Education, the State Board of Education and local school boards, has established nationally recognized standards and measures for accountability in public education; and
WHEREAS, the rollout of the TNReady assessment in School Year 2015-2016 was a failure resulting in lost instructional time for students and undue stress for stakeholders; and
WHEREAS, due to the TNReady failure a waiver was provided for School Year 2015-2016
WHEREAS, a new assessment vendor, Questar, was not selected until July 6, 2016, yet high school students are set to take EOC exams from November 28-December 16; and
WHEREAS, there are documented errors on the part of Questar to administer similar assessments in New York and Mississippi; and
WHEREAS, score reports will be unavailable until Fall 2017; and
WHEREAS, Tennessee teachers will not be involved in writing test items for the assessment in School Year 2016-2017; and
WHEREAS, there is a reliance on using test items from other states, which may not align with Tennessee standards; and
WHEREAS, more than seventy percent of Metro Nashville Public School teachers do not produce individual TVAAS data; and
WHEREAS, the American Educational Research Association released a statement cautioning against the use of value added models, like TVAAS, for evaluating educators and using such data for high-stakes educational decisions;

NOW THEREFORE BE IT RESOLVED BY THE METRO NASHVILLE BOARD OF EDUCATION AS FOLLOWS:

The METRO NASHVILLE Board of Education opposes the use of TCAP data for any percentage of teacher and principal evaluations and student grades for school year 2016-2017 and urges Governor Haslam, Commissioner of Education Candice McQueen, the General Assembly and the State Board of Education to provide a one-year waiver.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

 

Posted on by

Knox County Takes a Stand

Last night, the Knox County School Board voted 6-3 in favor of a resolution calling on the General Assembly and State Board of Education to waive the use of TCAP/TNReady data in student grades and teacher evaluations this year.

The move comes as the state prepares to administer the tests this year with a new vendor following last year’s TNReady disaster. The lack of a complete testing cycle last year plus the addition of a new vendor means this year is the first year of the new test.

The Board passed the resolution in spite of Governor Haslam warning against taking such a step.

In his warning, Haslam said:

“The results we’ve seen are not by accident in Tennessee, and I think you have to be really careful about doing anything that could cause that to back up,” Haslam said.

He added:

Haslam attributed that progress to three things, including tying standardized tests to teacher evaluations.

“It’s about raising our standards and expectations, it’s about having year-end assessments that match those standards and then I think it’s about having assessments that are part of teachers’ evaluations,” Haslam said. “I think that you have to have all of those for a recipe for success.”

Haslam can present no evidence for his claim about the use of student assessment in teacher evaluation. In fact, it’s worth noting that prior to 2008, Tennessee students achieved at a high level according to what were then the state standards. While the standards themselves were determined to need improvement, the point is teachers were helping students hit the designated mark.

Teachers were moving students forward at this time without evaluations tied to student test results. Policymakers set a mark for student performance, teachers worked to hit that mark and succeeded. Standards were raised in 2008, and since then, Tennessee has seen detectable growth in overall results, including some exciting news when NAEP results are released.

To suggest that a year without the use of TVAAS scores in teacher evaluations will cause a setback is to insult Tennessee’s teachers. As if they’ll just relax and not teach as hard.

Another argument raised against the resolution is that it will somehow absolve teachers and students of accountability.

Joe Sullivan reports in the Knoxville Mercury:

In an email to board members, [Interim Director of Schools Buzz] Thomas asserted that, “We need a good standardized test each year to tell us how we are doing compared to others across the state and the nation. We will achieve greatness not by shying away from this accountability but by embracing it.” And he fretted that, “This resolution puts that at risk. In short, it will divide us. Once again we could find ourselves in two disputing camps. The pro-achievement folks on the one side and the pro-teacher folks on the other.”

Right now, we don’t know if we have a good standardized test. Taking a year to get it right is important, especially in light of the frustrations of last year’s TNReady experience.

Of course, there’s no need for pro-achievement and pro-teacher folks to be divided into two camps, either. Tennessee can have a good, solid test that is an accurate measure of student achievement and also treat teachers fairly in the evaluation process.

To be clear, teachers aren’t asking for a waiver from all evaluation. They are asking for a fair, transparent evaluation system. TVAAS has long been criticized as neither. Even under the best of circumstances, TVAAS provides a minimal level of useful information about teacher performance.

Now, we’re shifting to a new test. That shift alone makes it impossible to achieve a valid value-added score. In fact, researchers in the Journal of Educational Measurement have said:

We find that the variation in estimated effects resulting from the different mathematics achievement measures is large relative to variation resulting from choices about model specification, and that the variation within teachers across achievement measures is larger than the variation across teachers. These results suggest that conclusions about individual teachers’ performance based on value-added models can be sensitive to the ways in which student achievement is measured.
These findings align with similar findings by Martineau (2006) and Schmidt et al (2005)
You get different results depending on the type of question you’re measuring.

The researchers tested various VAM models (including the type used in TVAAS) and found that teacher effect estimates changed significantly based on both what was being measured AND how it was measured.

Changing to a new type of test creates value-added uncertainty. That means results attributed to teachers based on a comparison of this year’s tests and the old tests will not yield valid results.

While insisting that districts use TVAAS in teacher evaluations this year, the state is also admitting it’s not quite sure how that will work.

From Sullivan’s story:

When asked how these determinations will be made, a spokesperson for the state Department of Education acknowledges that a different methodology will have to be employed and says that, “we are still working with various statisticians and experts to determine the exact methodology we will use this year.”

Why not at take at least a year, be sure there’s a test that works, and then build a model based on that? What harm would come from giving teachers and students a year with a test that’s just a test? Moreover, the best education researchers have already warned that testing transitions create value-added bumps. Why not avoid the bumps and work to create an evaluation system that is fair and transparent?

Knox County has taken a stand. We’ll soon see if others follow suit. And if the state is listening.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

 

Posted on by

Breaking Down the 2016 Educator Survey Results

The Tennessee Department of Education released the results of their annual educator survey. The 2016 Educator Survey was taken by over 30,000 educators across the state, which is about half of the state’s educators. This large sample of teachers allows us to see what teachers are really feeling out in the trenches, and the vast majority of teachers feel appreciated.

Working Conditions

Throughout the country we hear that many teachers do not feel appreciated as a teacher. But Tennessee’s classroom climate is different. 78% of teachers say: “I feel appreciated for the job that I am doing.”

The graphic below shows that Tennessee’s teachers give high ratings to their working conditions and to their colleagues.

Screen Shot 2016-08-16 at 5.28.52 PM

It should be noted that “we still see about 10 percent of schools across the state where the majority of staff report that they are dissatisfied with their work environment.” I hope that those schools are aware of their teacher’s views on the work environment. In Nashville, the district uses the TELL survey data to get a glimpse of how teachers view their working environment and administration.

My middle school in Nashville reviews the TELL survey results each year, discusses those results with their teachers, and makes necessary adjustments based that feedback. It’s a process that I hope all schools are doing in Nashville.

Student Discipline

The next area of the Educator Survey was about student discipline. This was the area that teachers and administers really disagreed on, as you can see below. Teachers also believe that we need to be spending more professional development on how to address student’s non-academic needs.

Screen Shot 2016-08-16 at 5.46.41 PM

Screen Shot 2016-08-16 at 5.55.19 PM

As a teacher, I can really understand the disagreement between administrators and teachers on this issue. Chalkbeat easily breaks down the issue:

Tennessee teachers are more concerned than principals about discipline at their schools, according to a new survey that shows a similar disconnect over the amount of feedback that teachers get from their administrators.

About 69 percent of teachers surveyed say their schools effectively manage student behavioral problems, while 96 percent of administrators say their schools handle discipline just fine.

The gaps in perception suggest that school administrators may not be aware of their teachers’ concerns on discipline.

The findings come as high suspension rates for poor students and students of color are getting more national attention. They also indicate that Tennessee needs to start making discipline policies a bigger priority, says Education Commissioner Candice McQueen.

“This points to specific areas where we need to take more concrete actions,” McQueen said during a conference call with reporters. She added that teachers are asking for more support to meet their students’ non-academic needs.

Teacher Evaluation

More teachers than ever before say that the teacher evaluation system is improving teaching and student learning. That’s great to hear.

Screen Shot 2016-08-16 at 5.53.10 PM

 

The results show that 71% of teachers saw improvement in teaching thanks to the teacher evaluation process. Personally, I had a great evaluator last year and my teaching skills grew because of it. I have really grown as a teacher over the last two years thanks to the teacher evaluation system.

This year’s result is a huge increase from 2012.

Seventy-one percent of teachers report that the teacher evaluation process has led to improvements in their teaching, up from 38 percent in 2012. Similarly, two- thirds of all teachers report that the process has led to improvements in student learning, up from about one quarter in 2012.

What do teachers want more of? Collaboration, of course! I work at a school with a really collaborative nature, and it shows both in the teachers and in the students. 

Change Over Time

I really enjoyed looking at the chart below to see how the teacher’s responses have changed over time on the evaluation process. This chart shows that a over two-thirds of teachers believe that the teacher evaluation improves their teaching and student learning.

Screen Shot 2016-08-16 at 6.00.52 PM

 

Tennessee is on the right course toward making teachers feel appreciated, and it’s great to see the teacher evaluation process improving teaching performance. Let’s not stop now. I hope the Department of Education will use these results to continue to improve the teaching environment for Tennessee’s teachers.

 

You can read the full report here.

For more on education politics and policy in Tennessee, follow @TNEdReport. 


 

Posted on by

Candice is Listening

Or, she will be. The Commissioner of Education is going on a statewide tour to talk about testing in light of new flexibility offered to the states under the federal ESSA law, which replaced No Child Left Behind.

From the DOE’s press release:

Commissioner Candice McQueen and senior department leaders are launching a statewide listening tour to gather input from educators, key advocates, parents, students, and the public to determine how to implement specific components of the nation’s new federal education law: the Every Student Succeeds Act (ESSA). The feedback will inform a Tennessee-specific ESSA plan that will guide the department’s work over the coming years and help the state capitalize on the new law’s empowerment of local leadership. These conversations will also build off feedback the commissioner has received on her Classroom Chronicles tour, during which she has met with more than 10,000 Tennessee teachers to learn how policies impact the classroom.

 

“We need to continue to elevate educators’ ideas to strengthen our education system, and the new federal law provides an opportunity to do that,” said Education Commissioner Candice McQueen. “We look forward to hearing from a variety of educators – from classroom teachers to directors of schools – as well as advocates, parents, and students as we craft a plan for Tennessee to transition to ESSA.”

The release notes that some policy changes might be in order:

Over the summer and fall, department leadership will draft a plan for transitioning to ESSA based on stakeholder and public feedback. Stakeholders and the general public will have another opportunity to provide input on the draft plan later this fall. In spring 2017, the department will work with stakeholder groups, the State Board of Education, and the Tennessee General Assembly as needed to recommend changes to state law and policy, as well as develop further guidance for school districts.

 

In addition to the various feedback loops and meetings across the state, the department will also be guided by its strategic plan, Tennessee Succeeds, which was developed with input from thousands of stakeholders over the course of several months to establish a clear vision for the future of Tennessee’s schools. It also has established a solid foundation in preparing to transition to ESSA.

Interestingly, the strategic plan referenced includes this under the category of Accountability:

Pilot first grade and career and technical education portfolio models in 2016, and continue to develop additional portfolio options for teachers in non-tested grades and subjects

Develop additional valid and reliable student growth measures for those areas that do not currently have them

Perhaps one improvement that will be suggested is that in addition to developing portfolio models for teacher evaluation (they already exist for related-arts teachers), the state should also provide funding to districts to support their implementation. Few districts use the state’s approved portfolio model for non-tested related arts teachers, likely because the cost of doing so is not covered by the state. Assessment includes both additional staff time and compensation for those performing the portfolio assessments.

The second item of note is: Develop additional valid and reliable student growth measures for those areas that do not currently have them.

This statement assumes that current methods of evaluating student growth (TVAAS) are valid and reliable. To put it simply, they’re not. Additionally, the most common method of assessing student growth is through standardized testing. This raises the possibility that additional tests will be provided for subjects not currently tested. After this year’s TNReady failure, it seems to me we should be exploring other options.

Nevertheless, I’m hopeful that this summer’s listening tour will lead to a new dialogue about Tennessee’s direction in education in light of ESSA. States like Hawaii are already taking student test scores out of the teacher evaluation process and moving toward new measures of evaluation.

Out of the chaos of TNReady, there is opportunity. Educators, parents, and students should attend these summer meetings and share their views on a new path forward for our state’s schools.

For more on education politics and policy in Tennessee, follow @TNEdReport

 

 

Posted on by

Bias Confirmed

Last year, I wrote about a study of Tennessee TVAAS scores conducted by Jessica Holloway-Libell. She examined 10 Tennessee school districts and their TVAAS score distribution. Her findings suggest that ELA teachers are less likely than Math teachers to receive positive TVAAS scores, and that middle school teachers generally, and middle school ELA teachers in particular, are more likely to receive lower TVAAS scores.

The findings, based on a sampling of districts, suggest one of two things:

1) Tennessee’s ELA teachers are NOT as effective as Tennessee’s Math teachers and the middle school teachers are less effective than the high school teachers

OR

2) TVAAS scores are biased against ELA teachers (or in favor of Math teachers) due to the nature of the subjects being tested.

The second option actually has support from data analysis, as I indicated at the time and repeat here:

Holloway-Libell’s findings are consistent with those of Lockwood and McCaffrey (2007) published in the Journal of Educational Measurement:

The researchers tested various VAM models and found that teacher effect estimates changed significantly based on both what was being measured AND how it was measured.

That is, it’s totally consistent with VAM to have different estimates for math and ELA teachers, for example. Math questions are often asked in a different manner than ELA questions and the assessment is covering different subject matter.

Now, there’s even more evidence to suggest that TVAAS scores vary based on subject matter and grade level – which would minimize their ability to provide meaningful information about teacher effectiveness.

A recently released study about effective teaching in Tennessee includes the following information:

The study used TVAAS scores alone to determine a student’s access to “effective teaching.” A teacher receiving a TVAAS score of a 4 or 5 was determined to be “highly effective” for the purposes of the study. The findings indicate that Math teachers are more likely to be rated effective by TVAAS than ELA teachers and that ELA teachers in grades 4-8 (mostly middle school grades) were the least likely to be rated effective. These findings offer support for the similar findings made by Holloway-Libell in a sample of districts. They are particularly noteworthy because they are more comprehensive, including most districts in the state.

Here’s a breakdown of the findings by percentage of teachers rated effective and including the number of districts used to determine the average.

4-8 Math           47.5% effective                        126 districts

HS Math            38.9% effective                          94 districts

4-8 ELA              24.2% effective                      131 districts

HS ELA               31.1% effective                       100 districts

So, TVAAS scores are more likely to result in math teachers being rated effective and middle school ELA teachers are the least likely to receive effective ratings.

Again, the question is: Are Tennessee’s ELA teachers really worse than our Math teachers? And, are middle school ELA teachers the worst teachers in Tennessee?

Alternatively, one might suppose that TVAAS, as data from other value-added models suggests, is susceptible to subject matter bias, and to a lesser extent, grade level bias.

That is, the data generated by TVAAS is not a reliable predictor of teacher performance.

For more on education politics and policy in Tennessee, follow @TNEdReport

 

Posted on by

McQueen: We Are Listening

Education Commissioner Candice McQueen published a letter to parents and families about the TNReady roll out. The letter discusses how the Department of Education is also disappointed in the roll out. I’m going to break down her letter with my thoughts. The letter was posted with the attached bolded sentences.

You have probably heard a lot about testing recently as schools have started the annual TCAP assessments, including the new TNReady in math and English. I want to thank you for your patience and support during this transition. As we always see in education, parents and teachers have gone the extra mile to put students first.

As you know, our goal was to administer TNReady online this year. However, due to unexpected issues with our test vendor, students are instead taking the exam on paper. While this is not how we had hoped students would first take TNReady, the paper version of TNReady was created alongside the online version, so it is reliable with questions that have been reviewed and approved by Tennessee teachers. 

As you can see, Commissioner McQueen is using this letter to literally highlight the talking points on TNReady. It is a good reminder that all TNReady questions were reviewed and approved by Tennessee teachers.

We know the shift has brought challenges for our schools. We too are frustrated and disappointed by our inability to provide students with an online test this year and by the logistical difficulties. We have been working tirelessly to provide a positive testing experience as much as is within our control and to reduce anxiety. Districts already have the option to exclude TNReady and TCAP scores from students’ grades. In addition, the governor proposed to give teachers the flexibility to only include scores from this year’s TNReady and TCAP tests within their evaluation if it benefits them. If you want to learn more about the paper test transition, please visit our website and our blog.

We fully believe that our students are more than test scores. TNReady provides one – but just one – way to help parents and teachers make sure students are ready for the next step by showing how they are progressing. It will give you better information about what your student is learning and retaining because it includes more complex questions that look for how students think and analyze problems.

Yes, the rollout of TNReady has caused a lot of challenges. It was a nightmare for many schools to have to keep updating their testing schedule to prepare for TNReady (plus everything the schools did up until that point to get ready for a computer assessment). Our school had to change the schedule multiple times before testing began. While our testing went very smoothly, there were times when we did not have enough answer sheets for our students. We also had to postpone one grade level’s test because we lacked testing materials.

I know teachers across the state cheered when they heard that Governor Haslam is offering flexibility in regards to using scores in our evaluations. MNPS has already emailed all teachers about this proposed changed to keep the teachers updated. TNEdReport will keep you updated on this proposed legislation.

As we all know and agree with, students are not just data points. But the data provided can be helpful.

Parents should be able to clearly understand what their students know, how they are meeting grade-level expectations, and how they are performing compared to their peers. In the past, parent reports were often difficult to interpret and offered little guidance on how you could support your child, but TNReady allows us to provide parents with more specific and thorough information.

To assure we are creating parent reports that will best inform you, we ask for your feedback as we finalize the design of these reports. You can provide your thoughts on specific pieces of the proposed parent reports through this online form.

While we have not see the scores for TNReady, I am excited to hear from parents once they receive this information. I am cautiously optimistic that the state will provide better information for our parents and teachers. We have been let down before, and I hope it doesn’t happen with the scores.

We are fortunate to have incredible leaders in our communities: parents, principals, and teachers who face challenges every day while leading remarkable work on behalf of kids. Over the past few weeks, I have witnessed firsthand the character, focus, and teamwork in so many communities across the state. Thank you again for leading the team in your own household and working in partnership with our schools to seek continuous improvement even in the midst of challenges.

I think the best thing Commissioner McQueen can do is to communicate with teachers, parents, and the public as often as she can. Teachers need to know that the state cares about what is happening in schools across the state. I like how the state has provided a way for citizens to ask questions of the state. I have submitted a question to the state, and I hope there is follow through from the state.

What are your thoughts on McQueen’s letter? Have you submitted a question to the state? If so, have you heard back? Tell us below in the comments.


 

Posted on by

Flexible Validity

Commissioner of Education Candice McQueen today provided additional information on how teacher evaluations would be handled in light of the flexibility the department is granting educators in light of TNReady troubles.

First, the email from McQueen, then some thoughts:

Dear educators,

Thank you for all of your thoughtful questions in response to Gov. Haslam’s proposal to create evaluation flexibility during our transition to TNReady. Last month, we shared an overview of the governor’s proposal (here). Earlier this week, the legislation began moving through the legislative process, so I’m writing to share more detailed information regarding the proposal, specifically how it is designed to create evaluation flexibility for you.

The department has developed an FAQ document on Evaluation Flexibility for Teachers (here) which provides detailed information regarding how this flexibility will affect teachers in different subjects and grades. I encourage you to closely read this document to learn how the flexibility applies to your unique situation.

Meanwhile, I wanted to share a few highlights. The governor’s proposal would provide you the option to include or not include results from the 2015-16 TNReady and TCAP tests within the student growth component of your evaluation, depending on which scenario benefits you the most. In other words, if student growth scores from this year help you earn a higher evaluation score, they will be used. If they do not help you earn a higher score, they will not be used. The option that helps your score the most will automatically be incorporated into your evaluation. This applies to all grades and subjects, including science and social studies.

Because Tennessee teachers will meet over this spring and summer to establish scoring guidelines and cut scores for the new assessment, achievement scores will not be available until the fall. TVAAS scores, however, will be available this summer because cut scores for proficiency levels are not required to calculate growth scores.

You can follow the progress of the governor’s proposal as it moves through the legislative process at the Tennessee General Assembly website (here). If you have additional questions about how this may apply to you, please contact TEAM.Questions@tn.gov.

We hope this evaluation flexibility eases concerns as we transition to a new, more rigorous assessment that is fully aligned to our Tennessee Academic Standards, as well as navigate the challenge of moving to a paper-based test this year. Thank you for your ongoing commitment to Tennessee students, as well as your continued flexibility as we transition to an assessment that will provide us with better information about our students’ progress on the path to college and career readiness.

My thoughts:

While flexibility is good, and the TVAAS waiver is needed, this sentence is troubling:

TVAAS scores, however, will be available this summer because cut scores for proficiency levels are not required to calculate growth scores.

The plan is to allow teachers to include TNReady TVAAS scores if they improve the teacher’s overall 1-5 TEAM rating. That’s all well and good, except that there can be no valid TVAAS score generated from this year’s TNReady data. This fact seems to have escaped the data gurus at the Department of Education.

Here’s what I wrote after analyzing studies of value-added data and teacher performance when using different types of assessments:

If you measure different skills, you get different results. That decreases (or eliminates) the reliability of those results. TNReady is measuring different skills in a different format than TCAP. It’s BOTH a different type of test AND a test on different standards. Any value-added comparison between the two tests is statistically suspect, at best. In the first year, such a comparison is invalid and unreliable. As more years of data become available, it may be possible to make some correlation between past TCAP results and TNReady scores.

This year’s TNReady-based TVAAS scores will be invalid. So will next year’s, for that matter. There’s not enough comparative data to make a predictive inference regarding past TCAP performance as it relates to current TNReady performance. In other words, it’s like comparing apples to oranges. Or, pulling a number out of your ass.

IT’S WRONG!

But, there’s also the fact that in states with both paper-based and online testing, students score significantly higher on the paper tests. No one is talking about how this year’s mixed approach (some 20,000 students completed a portion of the test online on day one) will impact any supposed TVAAS number.

How about we simply don’t count test scores in teacher evaluations at all this year? Or for the next three years? We don’t even have a valid administration of TNReady – there have been errors, delays, and there still are graders hired from Craigslist.

Let’s take a step back and get it right – even if that means not counting TNReady at all this year — not for teachers, not for students, not for schools or districts. If this 11 hour test is really the best thing since sliced bread, let’s take the time to get it right. Or, here’s an idea, let’s stop TNReady for this year and allow students and teachers to go about the business of teaching and learning.

Posted on by

Ready to Waive

Governor Bill Haslam and Commissioner of Education Candice McQueen announced today that in light of difficulties with the administration of the TNReady test, they are proposing that TNReady data NOT be included in this year’s round of teacher evaluations.

The statement comes after the Knox County Board of Education made a similar request by way of resolution in December. That resolution was followed by a statewide call for a waiver by a coalition of education advocacy groups. More recently, principals in Hamilton County weighed in on the issue.

Here’s Governor Haslam’s press release on the waiver:
Tennessee Gov. Bill Haslam today announced he would seek additional flexibility for teachers as the state continues its transition to the TNReady student assessment.

Under the proposal, teachers would have the choice to include or not to include student results from the 2015-2016 TNReady assessment in his or her evaluation score, which typically consists of multiple years of data. The proposal keeps student learning and accountability as factors in an educator’s evaluation while giving teachers the option to include this year’s results if the results benefit them. The governor will work with the General Assembly on specific language and a plan to move the proposal through the legislative process.

“Tennessee students are showing historic progress. The state made adjustments to teacher evaluation and accountability last year to account for the transition to an improved assessment fully aligned with Tennessee standards, which we know has involved a tremendous amount of work on the part of our educators,” Haslam said. “Given recent, unexpected changes in the administration of the new assessment, we want to provide teachers with additional flexibility for this first year’s data.”

Tennessee has led the nation with a teacher evaluation model that has played a vital role in the state’s unprecedented progress in education. Tennessee students are the fastest improving students in the country since 2011. The state’s graduation rate has increased three years in a row, standing at 88 percent. Since 2011, 131,000 more students are on grade-level in math and nearly 60,000 more on grade-level in science.  The plan builds upon the Teaching Evaluation Enhancement Act proposed by the governor and approved by the General Assembly last year. This year is the first administration of TNReady, which is fully aligned with the state’s college and career readiness benchmarks.

“Providing teachers with the flexibility to exclude first-year TNReady data from their growth score over the course of this transition will both directly address many concerns we have heard and strengthen our partnership with educators while we move forward with a new assessment,” Department of Education Commissioner Candice McQueen said. “Regardless of the test medium, TNReady will measure skills that the real world will require of our students.”

Most educator evaluations have three main components: qualitative data, which includes principal observations and always counts for at least half of an educator’s evaluation; a student achievement measure that the educator chooses; and a student growth score, which usually comprises 35 percent of the overall evaluation

 

While the release mentions last year’s changes to teacher evaluation to account for TNReady, it fails to note the validity problems created by an evaluation system moving from a multiple choice (TCAP) to a constructed-response test (TNReady).

Here’s the Tennessee Education Association on the announcement:

“TEA applauds Gov. Haslam on his proposal to give teachers the flexibility to not use TNReady test data in their 2015-16 evaluations. It is encouraging to see the governor listen to the widespread calls from educators, parents and local school boards for a one-year moratorium for TNReady data in teacher evaluations.”

 

“It is important that schools are given the same leniency as students and teachers during the transition to TNReady. These test scores that Gov. Haslam is acknowledging are too unreliable for use in teacher evaluations, are the same scores that can place a school on the priority list and make it eligible for state takeover. All high-stakes decisions tied to TNReady test data need to be waived for the 2015-16 school year.”

 

“While the governor’s proposal is a step in the right direction toward decoupling standardized test scores with high-stakes decisions, these measurements have proven to be unreliable statistical estimates that are inappropriate for use in teacher evaluations at all. TEA will continue its push to eliminate all standardized test scores from annual teacher evaluations.”

For more on education politics and policy in Tennessee, follow @TNEdReport

Posted on by

Hamilton Principals Call for TNReady Waiver

A group of school principals in Hamilton County is joining the call for a waiver of the use of TNReady scores in teacher evaluations and accountability data in light of day one problems with the administration of the online assessment.

Here’s the resolution:

 

 

HCPA Resolution Regarding State Assessments

 

Posted on by

(NOT) Ready on Day One

It’s campaign season and candidate after candidate is telling voters they are the clear choice because they will be “ready on day one.”

Likewise, it’s the beginning of statewide testing season in Tennessee and districts have been told the state’s new system would be ready on day one.

Except it wasn’t.

Brian Wilson at the Murfreesboro Daily News Journal reports:

A technology failure from a state vendor halted standardized testing across Tennessee on the first day that TNReady, the state’s new online exam program, was set to be administered on a widespread basis.

The state’s testing platform “experienced major outages across the state” Monday morning because of network issues with Measurement, Inc., who is contracted to administer the standardized exams, according to a memo Commissioner of Education Candice McQueen sent to schools directors across the state.

Don’t call us, we’ll call you …

As problems began this morning, the Department of Education sent the following notice to school districts:

At 8:25 a.m. CST the MIST platform experienced major outages across the state. These outages were caused because the network utilized by Measurement Inc. experienced a failure. We are urgently working with Measurement Inc. to identify the causes and correct the problem. At this time, we are advising that schools experiencing problems with the test discontinue testing, and return to their normal classes. Please do not begin any new additional testing you had planned for today until the department provides further information. However, if you have students that are successfully testing, please allow them to complete the current session.

Note, this problem affects both the MICA and MIST platforms. 

The MIST Help Desk is aware of the problem and will be not accepting additional phone calls on this issue. Please encourage your technology directors to call the department’s TNReady Focus Room.

We will provide frequent updates as information becomes available. Thank you for your patience.

It’s not clear how today’s delay will impact testing schedules across the state or whether the TNReady platforms will be ready tomorrow.

Williamson County Schools had already pushed the start of their TNReady testing back to Wednesday as a precaution against the sort of testing glitches that occurred today.

A Call for Fairness

The Tennessee Education Association issued a statement from their President, Barbara Gray, calling for fair treatment of teachers in light of the TNReady problems:

TEA has long had concerns about this transition to a statewide online  assessment. We have seen problems with pilot assessments and practice tests in the past, and unfortunately the first day of TNReady resulted in more issues and frustrations for our students and teachers.

 

Leading up to today’s testing, we have heard from educators and parents statewide about concerns with the state’s capacity to handle so many students on the server at one time, as well as concerns about local districts having enough resources to complete the testing with so little funding from the state.

 

It is unacceptable to have this kind of statewide failure when the state has tied so many high-stakes decisions to  the results of this assessment. Our students and teachers have enough stress and anxiety around these assessments without adding additional worries about technical issues.

 

The state must grant a one-year waiver – at a minimum – from including TNReady scores in teacher evaluations. It is unfair and inappropriate to stake our teachers’ professional standing on flawed, unreliable test scores in any year, but there are even greater implications and uncertainty while implementing a new assessment.

School Boards Expressing Concern

Ahead of the TNReady tests, several school boards have expressed concern about the use of the results in teacher evaluations this year.

MNPS and Knox County are among those asking the state to waive the results this year.

No word on whether state officials are still perplexed about why teachers are wary having TNReady count toward this year’s evaluations.

Again, it’s not clear when we’ll actually be TNReady, just that it wasn’t on day one.

For more on education politics and policy in Tennessee, follow @TNEdReport