It Wasn’t Me

TNReady results may or may not be included in your student’s report card, though we do know that more than 75% of districts won’t get scores back before the end of May. Don’t worry, though, it’s nobody’s fault.

Certainly, it’s not the responsibility of the Department of Education or Commissioner Candice McQueen to ensure that results are back in a timely fashion.

Today, Commissioner McQueen sent out an update to educators about assessments. There was some interesting information about TNReady going forward and about the timeline for scores for this year’s tests.

Not included? Any sort of apology about the TNReady quick score issue.

Instead, here’s what McQueen had to say:

Finally, I want to share an update on the delivery of raw scores for the 2016-17 assessment. We have received raw score data for nearly all EOC subjects, and grades 3–8 data continues to come in daily. We are in communication with your district leaders regarding the delivery of raw score data. State law and state board rule provides district choice on whether to include TNReady in grades if scores are not received within five days of the end of the school year. If you have questions about your particular district’s timeline or any decisions about including TNReady data in grades, I encourage you to reach out to your local leaders.

Got a problem or question about TNReady data and your student’s scores? Don’t ask Candice McQueen or the Department of Education. Ask your local leaders. Because, after all, we’ve been giving them all the relevant information in the most timely fashion.

I would suggest that leaders at TDOE just apologize and say it won’t happen again. But, as I mentioned, we’ve had testing challenges for four consecutive years now.

Here’s one word of advice to district leaders and teachers: Next year, when the Department of Education says everything is fine, it just might not be. Here’s something you can count on, though: It won’t be the responsibility of anyone at TDOE.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

Not Exactly Helpful

In a story yesterday about TNReady scores not being ready in time to be counted in student final grades, I noted a statement published in the Clarksville Leaf-Chronicle and attributed to Tennessee Department of Education spokesperson Sara Gast. Here’s that statement again:

But Sara Gast, spokeswoman for the state Department of Education, said school districts would receive their scores based on how quickly they returned their materials.

This was the first week school districts could receive data back, and districts across the state will get their scores on a rolling basis over the next couple of week through the week of June 5, she said.

She said some districts will not get their scores in time to be counted in final grades “because they did not meet the deadlines.”

Since then, Clarksville-Montgomery County Schools has posted an update on their Facebook page:

The state department of Education has clarified that CMCSS did NOT miss any deadlines. According to Sara Gast from the Tennessee Department of Education, “We provide three different timelines for a reason, and all are equally fine and acceptable for districts to be on. We are neutral on which deadlines districts meet, and it is reasonable that larger districts would need additional time to ship materials back and may use the entire window to do so. We have always fully expected that we will have districts on all three tracks based on their local decisions.” Assistant Education Commissioner Nakia Towns confirmed that with this comment: “We emphasized that there was no “miss” of deadlines. We just provided three timelines.”

What’s not clear from this statement is whether it was anticipated that scores would not be ready by the end of school depending on the track chosen by districts.

It’s also interesting how the DOE’s explanation has shifted from blaming districts for missing deadlines to now saying that having more than 75% of districts not getting scores back before the end of the year was the plan all along.

I offered a solution yesterday. It’s simple, really.

Stop using this single test as the primary indicator of student performance, teacher effectiveness, and school accountability.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

 

The Buck Stops Nowhere

By now it is clear that TNReady simply didn’t go as planned this year. Sure, the tests were administered and students completed them — largely on pencil and paper. But, the raw data from the tests used to generate the “quick scores” for student grades isn’t getting back to districts on time. At least not in time to include it in report cards.

The Department of Education says that’s the fault of districts. Here’s how a TN DOE spokesperson explained it to the Clarksville Leaf-Chronicle:

But Sara Gast, spokeswoman for the state Department of Education, said school districts would receive their scores based on how quickly they returned their materials.

This was the first week school districts could receive data back, and districts across the state will get their scores on a rolling basis over the next couple of week through the week of June 5, she said.

She said some districts will not get their scores in time to be counted in final grades “because they did not meet the deadlines.”

The district says that’s simply not the case and that they met the established timeline:

Shelton said tests from all Clarksville-Montgomery County schools were definitely turned in according to the state’s timeline to have them back before schools let out Wednesday, and the school district was not at fault.

All of this may sound a bit familiar to those who watched the blame game play out last year during the total meltdown of TNReady.

Then, neither testing vendor Measurement, Inc. nor the Department of Education took responsibility for a test that clearly failed.

Here’s what’s interesting this year. The state admits that more than 75% of districts will not get scores back on time. This, they claim, is because of missed deadlines. Districts dispute that claim.

Educators will tell you that if more than 75% of students miss a test question or fail a test, there’s a problem – and the problem is with the question or the test, not the students. More than 75% of districts supposedly missed established deadlines. It seems clear the Department of Education has a problem. It’s also clear that adults are failing kids.

Students are told the tests matter. They are told the tests factor into grades. Schools are held accountable based on results. Despite statistical validity issues, the test is used to evaluate teachers — so, those teachers reinforce the importance of the test to their students.

Then, after the answer sheets have been bubbled in and the test booklets sent to the vendor for grading, students are told the tests won’t count. Or, they may count, but report cards will be late. But it’s okay. The adults got it wrong. Just keep showing up and taking the test seriously. No big deal.

If you want the students to take testing seriously, you should take your job seriously. This is the fourth year in a row that there have been challenges with testing and/or returning results. When district leaders have stood up and spoken out, Commissioner McQueen has threatened to withhold funding.

Here’s a crazy idea: Stop using this single test as the primary indicator of student performance, teacher effectiveness, and school accountability.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

 

Rhetoric vs. Reality: TNReady 2017 Edition

Here’s what Commissioner of Education Candice McQueen had to say about this year’s TNReady tests in an email sent to educators on May 16th:

This year’s administration of TNReady was a success, both online and on paper, in schools across Tennessee. Thank you for you partnership and for preparing students with strong instruction every day. Stay tuned as we continue to share updates and resources.

Since then, it’s become clear that TNReady results won’t actually be ready for most districts in a timely fashion — meaning they’ll either be excluded from student grades or report cards will be held until results are available.

WPLN’s Blake Farmer reports on the scope of the problem:

The state department of education says less than a quarter of districts finished testing in time to get the results by the end of May. For those that did wrap up early, they started getting results back this week.

Yes, that’s right. More than 75% of districts won’t have results back before the end of May.

That’s an odd definition of success.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

McQueen Joins Chiefs for Change

Education Week reports that Tennessee’s Education Commissioner, Candice McQueen, has joined education reform group Chiefs for Change. Her predecessor, Kevin Huffman, was also a member of the group that has advocated for expanding charter schools and using value-added data in teacher evaluations.

Here’s more:

Chiefs for Change, once part of the former Florida Gov. Jeb Bush’s Foundation for Excellence in Education and comprised solely of state education chiefs, has spun off as an independent organization.

And on the addition of McQueen among the group’s four new members:

The lone state chief in the group is Candice McQueen, Tennessee’s commissioner of education.

While McQueen has been Tennessee’s Education Commissioner for three years now, she is new to Chiefs for Change.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

Opportunity to Learn

Natalie Coleman, Sumner County Teacher and HSG Tennessee Teacher Fellow

originally posted on TNTeacherTalk

 

Any teacher can tell you that students who miss too much school are at a disadvantage compared to their peers. Regardless of whether absences are a result of illness, personal reasons, or suspensions, missed time in school is detrimental to the individual student’s learning. The Tennessee Department of Education hopes to improve students’ opportunity to learn by reducing absenteeism. In Tennessee’s Every Student Succeeds Act (ESSA) plan, one nonacademic indicator for school and district accountability is the “chronically out of school” metric, which will evaluate progress in reducing the number of students who miss ten percent or more of the school year.

Before finalizing the state’s ESSA plan, the TDOE tasked the Hope Street Group Tennessee Teacher Fellows with collecting feedback from teachers across the state of Tennessee about their experiences with chronic absenteeism and with student discipline. This spring, the Fellows released a report based on the valuable input of over 2,000 teachers who participated in an online survey and nearly 400 who provided their insights in focus groups. The report includes six recommendations that the Fellows presented to Commissioner McQueen and the TDOE and is now available for the benefit of all stakeholders in Tennessee education.

The report details the results of the survey and summarizes the trends of teachers’ comments in focus groups, and a look through the report shows many connections between teachers’ experiences and the recommendations made to the Department of Education.

Recommendation 1 focuses on helping schools and teachers address the problem of students chronically missing school. Based on the survey data, even though 95% of teachers affirmed that chronic absenteeism affects student achievement, many teachers also reported that they have received little or no training in how to reduce student absences. 90% of teachers reported that they had not received training on strategies for reducing chronic absenteeism, and 92% reported that they were unfamiliar or only somewhat familiar with the state’s initiatives in addressing this issue. In response to this feedback, the Fellows recommend, “To ensure that teachers are fully aware of TDOE efforts, CORE offices could build teacher awareness of the draft ESSA plan (2016) through trainings that highlight key plan features that are designed to reduce chronic absenteeism.”   

Recommendation 2 seeks to provide schools and teachers with more resources to address this issue. On the Fall 2016 survey, 69% of teachers reported that they believe problems at home are the most significant barrier to student attendance, but only 30% report that they are aware that Family Resource Centers are available to help families and students who struggle with absenteeism. In fact, teachers who chose to write in their own answers about the family support services offered by their schools overwhelmingly responded with none. As a result, the second recommendation says, “To alleviate teacher concerns about this issue, TDOE could build awareness of an increased TDOE focus in 2017 on reducing chronic absenteeism through Family Resource Centers. Additionally, TDOE could remind teachers of the 103 Family Resource Centers in 78 districts and highlight the various needs-based services and training provided to parents and families through these centers.”

Recommendations 3 and 4 focus on student behavior and discipline. In focus groups, teachers shared various obstacles they encounter in implementing effective discipline policies. The third recommendation connects these teacher concerns to resources the TDOE could provide in conjunction with Response to Instruction and Intervention for Behavior (RTI2-B): “Because TDOE focuses on RTI2-B in the draft ESSA plan (2016), TDOE could expand the RTI2-B framework to reach more districts and schools through CORE offices or Tennessee Behavior Supports Project (TBSP), thereby providing additional targeted support in areas highlighted as obstacles by teachers.” The fourth highlights strategies for improving student behavior that are both research-based and frequently cited by teachers themselves in their focus group responses: “Through CORE offices or Tennessee Behavior Supports Project (TBSP), TDOE could emphasize how the following teacher suggestions for improving student behavior are research-based and addressed in RTI2-B: promoting positive behavior and prevention efforts and encouraging restorative behavior practices; involving parents in student behavior efforts; nurturing positive student-teacher relationships; and providing appropriate consequences in response to student behavior issues.” This recommendation encourages the TDOE to promote these research-based practices which teachers also know to be effective.

Recommendation 5 addresses the all-too-familiar concern of bullying in school. 14% of teachers report they feel unprepared or very unprepared to handle incidents of bullying in their classrooms, and 20% rate the effectiveness of their schools’ response to bullying as ineffective or very ineffective. These numbers show that many schools and teachers need additional support in addressing the issue of bullying and validate the fifth recommendation: “Because 20 percent of teachers shared that their schools’ response to bullying is ineffective, TDOE could provide resources to CORE offices for dissemination to districts and schools.”

Recommendation 6 highlights previous Hope Street Group findings about RTI2 and urges using prior teacher feedback to inform implementation of RTI2-B, Response to Instruction and Intervention for Behavior, which features in the state’s draft ESSA plan. This recommendation reads: “TDOE could revisit the recommendations provided in the Spring 2016 Hope Street Group Report on RTI2, including those related to scheduling and structuring RTI2; promoting whole school support and reducing negative perceptions of RTI2 effectiveness; and providing funding for additional RTI2 resources (e.g., professional development) and staffing.” This previous report, detailing teacher feedback regarding RTI2, is also available on the Hope Street Group website.

To learn more, visit the Hope Street Group Tennessee Teacher Fellows website and download the full 2016-17 report. You can also stay connected by liking and following the Tennessee Teacher Fellows’ Facebook page, Tennessee Teacher Voice.

 

For more on education politics and policy in Tennessee, follow @TNEdReport


 

It May Be Ready, But is it Valid?

In today’s edition of Commissioner Candice McQueen’s Educator Update, she talks about pending legislation addressing teacher evaluation and TNReady.

Here’s what McQueen has to say about the issue:

As we continue to support students and educators in the transition to TNReady, the department has proposed legislation (HB 309) that lessens the impact of state test results on students’ grades and teachers’ evaluations this year.

In 2015, the Tennessee Teaching Evaluation Enhancement Act created a phase-in of TNReady in evaluation to acknowledge the state’s move to a new assessment that is fully aligned to Tennessee state standards with new types of test questions. Under the current law, TNReady data would be weighted at 20 percent for the 2016-17 year.

However, in the spirit of the original bill, the department’s new legislation resets the phase-in of growth scores from TNReady assessments as was originally proposed in the Tennessee Teaching Evaluation Enhancement Act. Additionally, moving forward, the most recent year’s growth score will be used for a teacher’s entire growth component if such use results in a higher evaluation score for the teacher.

We will update you as this bill moves through the legislative process, and if signed into law, we will share detailed guidance that includes the specific options available for educators this year. As we announced last year, if a teacher’s 2015-16 individual growth data ever negatively impacts his or her overall evaluation, it will be excluded. Additionally, as noted above, teachers will be able to use 2016-17 growth data as 35 percent of their evaluation if it results in a higher overall level of effectiveness.

And here’s a handy graphic that describes the change:

TNReady Graphic

 

 

Of course, there’s a problem with all of this: There’s not going to be valid data to use for TVAAS. Not this year. It’s bad enough that the state is transitioning from one type of test to another. That alone would call into question the validity of any comparison used to generate a value-added score. Now, there’s a gap in the data. As you might recall, there wasn’t a complete TNReady test last year. So, to generate a TVAAS score, the state will have to compare 2014-15 data from the old TCAP tests to 2016-17 data from what we hope is a sound administration of TNReady.

We really need at least three years of data from the new test to make anything approaching a valid comparison. Or, we should start over building a data-set with this year as the baseline. Better yet, we could go the way of Hawaii and Oklahoma and just scrap the use of value-added scores altogether.

Even in the best of scenarios — a smooth transition from TCAP to TNReady — data validity was going to be challenge.

As I noted when the issue of testing transition first came up:

Here’s what Lockwood and McCaffrey (2007) had to say in the Journal of Educational Measurement:

We find that the variation in estimated effects resulting from the different mathematics achievement measures is large relative to variation resulting from choices about model specification, and that the variation within teachers across achievement measures is larger than the variation across teachers. These results suggest that conclusions about individual teachers’ performance based on value-added models can be sensitive to the ways in which student achievement is measured.
These findings align with similar findings by Martineau (2006) and Schmidt et al (2005)
You get different results depending on the type of question you’re measuring.

The researchers tested various VAM models (including the type used in TVAAS) and found that teacher effect estimates changed significantly based on both what was being measured AND how it was measured.

And they concluded:

Our results provide a clear example that caution is needed when interpreting estimated teacher effects because there is the potential for teacher performance to depend on the skills that are measured by the achievement tests.

If you measure different skills, you get different results. That decreases (or eliminates) the reliability of those results. TNReady is measuring different skills in a different format than TCAP. It’s BOTH a different type of test AND a test on different standards. Any value-added comparison between the two tests is statistically suspect, at best. In the first year, such a comparison is invalid and unreliable.

So, we’re transitioning from TCAP to TNReady AND we have a gap in years of data. That’s especially problematic — but, not problematic enough to keep the Department of Education from plowing ahead (and patting themselves on the back) with a scheme that validates a result sure to be invalid.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

Vouchers: The Ultimate Non-Solution

Education Commissioner Candice McQueen expressed frustration recently at years of ineffective education reform efforts. Specifically, she said:

“We can’t keep throwing $10 million, $11 million, $12 million, $15 million at solutions that are not solutions,” she told legislators on House education committees.

McQueen was lamenting the lack of progress made in school turnaround efforts and pointing lawmakers toward proven solutions. In fact, she noted the state’s ESSA plan focuses on strategies that have gotten results:

While McQueen didn’t single out specific turnaround initiatives, she stressed that Tennessee needs to focus on what has worked — specifically, at 10 schools that have been moved off the state’s priority list so far and have undergone case studies. McQueen named common themes: strong school leaders, quality instruction, and community and wraparound supports, such as mental health care services.

Candice McQueen is frustrated, and rightly so. As a result, her Department of Education is using ESSA to focus Tennessee’s school improvement efforts and even rein-in the Achievement School District (ASD).

What’s interesting in all of this, then, is that some state lawmakers seem intent on pushing through a voucher program for Shelby County.

McQueen told lawmakers they can’t keep throwing millions of dollars at solutions that are not solutions. But, according to the Fiscal Note on SB 161/HB 126, the bill will result in spending nearly $9 million on the voucher “solution” next year and more than $18 million per year once fully implemented. Of course, those estimates assume the program doesn’t expand beyond Shelby County.

A voucher program that started small in Indiana just five years ago now costs that state $131 million per year.

Talk about an expensive non-solution. In fact, the most recent research indicates that vouchers actually can have a negative impact on student academic achievement.

Kevin Carey summarizes:

The first results came in late 2015. Researchers examined an Indiana voucher program that had quickly grown to serve tens of thousands of students under Mike Pence, then the state’s governor. “In mathematics,” they found, “voucher students who transfer to private schools experienced significant losses in achievement.” They also saw no improvement in reading.

The next results came a few months later, in February, when researchers published a major study of Louisiana’s voucher program. Students in the program were predominantly black and from low-income families, and they came from public schools that had received poor ratings from the state department of education, based on test scores. For private schools receiving more applicants than they could enroll, the law required that they admit students via lottery, which allowed the researchers to compare lottery winners with those who stayed in public school.

They found large negative results in both reading and math. Public elementary school students who started at the 50th percentile in math and then used a voucher to transfer to a private school dropped to the 26th percentile in a single year. Results were somewhat better in the second year, but were still well below the starting point.

In June, a third voucher study was released by the Thomas B. Fordham Institute, a conservative think tank and proponent of school choice. The study, which was financed by the pro-voucher Walton Family Foundation, focused on a large voucher program in Ohio. “Students who use vouchers to attend private schools have fared worse academically compared to their closely matched peers attending public schools,” the researchers found. Once again, results were worse in math.

So, we have an Education Commissioner pleading with the General Assembly to focus on what works AND we have evidence from other states telling us vouchers don’t get the job done. At the same time, we have evidence from schools right here in Tennessee that tells us what IS working.

It’s time for the Tennessee General Assembly to heed the advice of Candice McQueen and stop attempting to throw millions of dollars at “solutions that are not solutions.”

pile-of-cash-1024x576

For more on education politics and policy in Tennessee, follow @TNEdReport


 

Assessment Update: Eliminating Part I, Reducing Testing Time, and Online Assessment Rollout

In an email to all Tennessee teachers, Commissioner Candice McQueen had the following updates to give regarding the upcoming year’s assessment, which includes eliminating Part I, reducing testing time, and a rollout of online assessments:

This summer we announced how we’re streamlining our assessments to provide a better testing experience for you and your students. Below are several changes to our assessment structure for the coming year.:

  • We’ve eliminated Part I. All TCAP tests will be administered in one assessment window at the end of the year, which will be April 17–May 5, 2017. High school students on block schedule will take fall EOCs November 28–December 16.
  • We’ve reduced testing time. In grades 3–8, students will have tests that are 200–210 minutes shorter than last year; in high school, most individual End of Course assessments have been shortened by 40-120 minutes.
  • We will phase in online tests over multiple years. For the upcoming school year, the state assessments for grades 3–8 will be administered via paper and pencil. However, the department will work closely with Questar, our new testing vendor, to provide an online option for high school math, ELA, and U.S. history & geography exams if both schools and the testing platform demonstrate early proof of successful online administration. Even if schools demonstrate readiness for online administration, districts will still have the option to choose paper and pencil assessments for high school students this year. Biology and chemistry End of Course exams will be administered via paper and pencil.
  • In the coming school year, the state will administer a social studies field test, rather than an operational assessment, for students in grades 3–8. This will take place during the operational testing window near the end of the year. Additionally, some students will participate in ELA and/or U.S. history field tests outside the operational testing window.

You can find more detailed information in our original email announcement (here) and in our updated FAQ (here). 

Breaking Down the 2016 Educator Survey Results

The Tennessee Department of Education released the results of their annual educator survey. The 2016 Educator Survey was taken by over 30,000 educators across the state, which is about half of the state’s educators. This large sample of teachers allows us to see what teachers are really feeling out in the trenches, and the vast majority of teachers feel appreciated.

Working Conditions

Throughout the country we hear that many teachers do not feel appreciated as a teacher. But Tennessee’s classroom climate is different. 78% of teachers say: “I feel appreciated for the job that I am doing.”

The graphic below shows that Tennessee’s teachers give high ratings to their working conditions and to their colleagues.

Screen Shot 2016-08-16 at 5.28.52 PM

It should be noted that “we still see about 10 percent of schools across the state where the majority of staff report that they are dissatisfied with their work environment.” I hope that those schools are aware of their teacher’s views on the work environment. In Nashville, the district uses the TELL survey data to get a glimpse of how teachers view their working environment and administration.

My middle school in Nashville reviews the TELL survey results each year, discusses those results with their teachers, and makes necessary adjustments based that feedback. It’s a process that I hope all schools are doing in Nashville.

Student Discipline

The next area of the Educator Survey was about student discipline. This was the area that teachers and administers really disagreed on, as you can see below. Teachers also believe that we need to be spending more professional development on how to address student’s non-academic needs.

Screen Shot 2016-08-16 at 5.46.41 PM

Screen Shot 2016-08-16 at 5.55.19 PM

As a teacher, I can really understand the disagreement between administrators and teachers on this issue. Chalkbeat easily breaks down the issue:

Tennessee teachers are more concerned than principals about discipline at their schools, according to a new survey that shows a similar disconnect over the amount of feedback that teachers get from their administrators.

About 69 percent of teachers surveyed say their schools effectively manage student behavioral problems, while 96 percent of administrators say their schools handle discipline just fine.

The gaps in perception suggest that school administrators may not be aware of their teachers’ concerns on discipline.

The findings come as high suspension rates for poor students and students of color are getting more national attention. They also indicate that Tennessee needs to start making discipline policies a bigger priority, says Education Commissioner Candice McQueen.

“This points to specific areas where we need to take more concrete actions,” McQueen said during a conference call with reporters. She added that teachers are asking for more support to meet their students’ non-academic needs.

Teacher Evaluation

More teachers than ever before say that the teacher evaluation system is improving teaching and student learning. That’s great to hear.

Screen Shot 2016-08-16 at 5.53.10 PM

 

The results show that 71% of teachers saw improvement in teaching thanks to the teacher evaluation process. Personally, I had a great evaluator last year and my teaching skills grew because of it. I have really grown as a teacher over the last two years thanks to the teacher evaluation system.

This year’s result is a huge increase from 2012.

Seventy-one percent of teachers report that the teacher evaluation process has led to improvements in their teaching, up from 38 percent in 2012. Similarly, two- thirds of all teachers report that the process has led to improvements in student learning, up from about one quarter in 2012.

What do teachers want more of? Collaboration, of course! I work at a school with a really collaborative nature, and it shows both in the teachers and in the students. 

Change Over Time

I really enjoyed looking at the chart below to see how the teacher’s responses have changed over time on the evaluation process. This chart shows that a over two-thirds of teachers believe that the teacher evaluation improves their teaching and student learning.

Screen Shot 2016-08-16 at 6.00.52 PM

 

Tennessee is on the right course toward making teachers feel appreciated, and it’s great to see the teacher evaluation process improving teaching performance. Let’s not stop now. I hope the Department of Education will use these results to continue to improve the teaching environment for Tennessee’s teachers.

 

You can read the full report here.

For more on education politics and policy in Tennessee, follow @TNEdReport