TNReady Again

TNReady is back again with online testing being phased-in this time.

Grace Tatter at Chalkbeat reports:

The Department of Education is staggering its transition to online testing — a lesson learned last year when most of the state tried to do it all at once and the online platform buckled on the first day. As a result, the department fired its testing company, derailing the state’s assessment program, and later hired  Questar as its new test maker.

Here are the districts opting to test high school students online this year:

  • Alvin C. York Institute
  • Bedford County
  • Bledsoe County
  • Blount County
  • Bristol City
  • Campbell County
  • Cannon County
  • Cheatham County
  • Clay County
  • Cocke County
  • Coffee County
  • Cumberland County
  • Grundy County
  • Hamilton County
  • Hancock County
  • Knox County
  • Jackson-Madison County
  • Moore County
  • Morgan County
  • Putnam County
  • Scott County
  • Sullivan County
  • Trousdale County
  • Washington County
  • Williamson County

For more on education politics and policy in Tennessee, follow @TNEdReport


 

 

Russo on Tennessee’s Alternative Graduation Facts

Much has been made about a state report seeming to indicate that one third of Tennessee’s high school graduates finished school without meeting state minimum requirements.

The initial release of the report caused alarm, of course. Then, the state walked back the numbers after admitting a data error.

Alexander Russo takes a look at the report and the surrounding news coverage and comes to this conclusion:

The state issued  a bad number without carefully considering its flaws or making them clear to reporters and board members, then belatedly realized its mistake and walked the initial figure back. But news outlets contributed to the problem by rushing to report the initial figure without questioning just how iffy it might be, unintentionally delivering inaccurate information to the public. The end result has been widespread confusion that will take a long time to clear up – if it ever is.

While Russo suggests media outlets should have done a better job of both raising questions and seeking clarifying information, he notes the state bears the brunt of the responsibility:

To be clear, the state department should have checked with the districts before presenting this information to the board and to the public. The state should also have anticipated that the graduation rate number would attract enormous amounts of attention and include additional warnings and caveats about the preliminary nature of the number. The primary responsibility was theirs.

The Tennessee Education Association pointed to the state’s responsibility to release accurate data and noted that the initial claims may have helped advance the arguments of school privatization advocates.

From a TEA press release:

Organizations backing privatization schemes like private school vouchers, rapid charter expansion and high-stakes testing, need people to believe that public schools are failing. Undermining confidence in public schools is an important step to build support for radical and dangerous proposals to destroy public education.

“As a state that consistently ranks at the bottom in student investment, we are consistently in the top 10 for graduation rate because of the commitment of Tennessee educators. Our students and teachers already often have the odds stacked against them, they don’t need damaging misinformation piling anything else on,” [TEA Executive Director] Crowder said.

To be sure, both the initial data release and the subsequent reporting created a sense of alarm in the state’s education policy community. Taking just a few extra steps could have prevented what turned into a rather messy scene.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

 

Joey Hassell’s Tweetstorm of Truth

Ripley High School Principal Joey Hassell has been tweeting this weekend about the state’s move to an A-F grading system for schools. The new system came about because of a legislative mandate. Hassell’s not happy about it. Interestingly, Hassell was formerly an Assistant Commissioner at the Tennessee Department of Education.

Here are a few of his tweets about the A-F grading system for schools:

 

As you can see, Hassell is quite unhappy with the move to the new grading system. His opinion seems to be supported by at least some district-level leaders based on likes and retweets he’s received.

The A-F system is set to start next school year, based on results from this year’s battery of tests and other data.

The legislature could make changes to the proposal in the upcoming legislative session, which starts on Tuesday, January 10th.

 

For more on education politics and policy in Tennessee, follow @TNEdReport


 

Washington Co. Joins Waiver Wave

Last night, the Washington County School Board voted 6-3 in favor of a resolution asking the State of Tennessee to grant a 1-year waiver from the use of TNReady scores in teacher evaluations and student grades. The resolution is similar to those passed in Nashville and Knox County and comes after the State Board of Education voted to change the way End of Course tests are counted in student grades.

The Washington County resolution comes just days before the Tennessee General Assembly returns to action (January 10th). Barring action by the State Board to grant a waiver, the only way it will happen is if lawmakers force the issue.

Similar resolutions were passed last year ahead of TNReady testing that ultimately failed. That makes this year the first year of new tests, now administered by Questar.

Tune in next week and beyond to see if more school boards pass resolutions asking for a waiver or if the State Board or legislature take action.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

A Late Call

Yesterday, the State Board of Education met and amended the state’s high school policy, including how End of Course exams factor into a student’s final grades.

As I reported earlier, this meeting happened just days before the semester ended for many students.

Here’s a note from Commissioner McQueen’s latest message to educators on the topic:

Yesterday, the State Board of Education voted on final reading to approve the department’s proposal to phase in EOC scores into high school students’ grades beginning this school year and continuing during the next few years. Also in the proposal, the department recommended to provide districts with students’ raw score points earned out of the total available instead of the conversion score that the department provided previously, commonly called quick scores. Please reference this memo (here) and FAQ document (here) for additional context. This policy becomes effective immediately for all 2016 fall block courses taking EOCs. The exams will account for 10 percent of students’ course grades this year.

Remarkably, the memo McQueen cites notes that the first reading of this policy change was in October. However, the special called meeting on adopting the change and making it official didn’t happen until yesterday. While the October meeting may have signaled the Board’s intent, there was no official policy change until just days before the semester ended.

Between October and now, of course, two large school districts have seen their boards pass resolutions asking the State Board and General Assembly to not count these tests in either student grades or teacher evaluations as we transition to a new test with a new vendor. Those concerns were apparently ignored at yesterday’s meeting.

The legislature could take action on the issue in 2017, but doing so may create confusion since students on block scheduling will have completed courses and received grades.

One provision of the change that is worth noting is that if EOC scores are not available to districts at least five instructional days before a course ends, the district may elect NOT to use those scores in a student’s final grade. For many districts, that day was yesterday.

If districts do decide to use the scores for this semester and next, they may only count for 10% of a student’s final grade.

I’d suggest that the more prudent course is for districts to not count the scores at all this year as we are in a transition year.

The late call (why not a special meeting a few weeks after the first meeting?) raises questions about the State Board’s responsiveness to the concerns of those officials doing the day-t0-day work of running a school district.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

 

Conflict Call

The Tennessee State Board of Education meets on Thursday, December 15th via conference call to discuss the A-F school grading system and to take action on high school policy, specifically as it relates to grading.

The high school policy includes a proposed change to the way End of Course tests are factored in to student grades — which is pretty important, since the semester is ending very soon and high school students on block schedules will be finishing courses in the next few days.

The EOC grade policy is noteworthy as two of the largest school districts in the state (Nashville and Knox County) have passed resolutions asking the state NOT to count any TNReady test in student grades or teacher evaluations for the 2016-17 academic year.

Here’s the language of the proposed policy change as it relates to EOC tests:

Results of individual student performance from all administered End of Course examinations will be provided in a timely fashion to facilitate the inclusion of these results as part of the student’s grade. Each LEA must establish a local board policy that details the methodology used and the required weighting for incorporating student scores on EOC examinations into final course grades. If an LEA does not receive its students’ End of Course examination scores at least five (5) instructional days before the scheduled end of the course, then the LEA may choose not to include its students’ End of Course examination scores in the students’ final course grade. The weight of the EOC examination on the student’s final average shall be ten percent (10%) in the 2016-2017 school year, fifteen percent (15%) in the 2017-2018 school year; and shall be determined by the local board from a range of no less than fifteen (15%) and no more than twenty-five (25%) in the 2018-2019 school year and thereafter.

 

Note, the 2016-17 academic year is happening right now. Students have already taken these EOC exams and their semesters will be ending soon. But, the policy change won’t happen until Thursday, assuming it passes. Alternatively, the State Board of Education could be responsive to the concerns expressed by the school boards in Nashville and Knoxville and prevent this year’s EOC exams from impacting student grades.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

 

Test Scores Are In! How Did Our Nashville Students Do?

Today, the Tennessee Department of Education released TNReady results for individual districts. The data only show results for high schools because elementary and middle schools did not take the full assessment last school year.

For those of you who just want the gist of it, Nashville’s public high schools are struggling to get kids to proficiency, and they’re particularly struggling with math.

Let’s dig a little deeper, using some screenshots from the state’s Report Card website.

ACT Achievement

screen-shot-2016-12-13-at-10-19-14-am

I have written previously about the ACT scores of the district. TNReady is trying to be more aligned with the ACT.

Math and ELA Achievement 

screen-shot-2016-12-13-at-10-21-30-am screen-shot-2016-12-13-at-10-21-34-am

The data show that our high schools are struggling more with math than English language arts (ELA), though each section has only a small percentage of students who are scoring within the top two tiers of TNReady.

Here’s the more in-depth breakdown of the data, including individual subjects. As we see from the graph below, we have new terminology to use when discussing the data.

screen-shot-2016-12-13-at-10-24-19-am

The data clearly show that too many high school students are not “on track” nor have achieved mastery of the subjects. We have given our high schools a makeover, but has that makeover really improved the achievement of our students? That will be hard to tell because this is a brand new assessment.

The achievement of high school students are more than just a problem with high schools. We need more support in lower grades to give students the skills they need to achieve in high school so that they can graduate and move on to college or a career.

Growth

screen-shot-2016-12-13-at-10-28-09-am

screen-shot-2016-12-13-at-10-28-59-am

It’s great to see that we are showing growth in literacy, but we have to do better in math.

We Have to Do Better

Our district has to do better. We have too many students not achieving at the level they should be. I hope our school board will really delve into this issue, instead of spending so much time on petty resolutions that will only hurt the district in the long run.

Turning around our district is not something that will make the newspaper tomorrow. It’s not something that you can brag about in your monthly email in a few weeks. Turning around our district takes time, resources, and a vision to help all students achieve. It means that everyone involved in the education system must work together, which can be hard for some.

It’s results like this that draw people away from Davidson county and into the suburbs and private schools. We can’t let it continue.

Let’s get to work!

For more on education politics and policy in Tennessee, follow @TNEdReport.


 

Doing the Right Thing

Shelby County’s Director of Schools Dorsey Hopson announced that all teachers will receive a three percent raise this year, not just those who meet certain scores on the state’s flawed value-added evaluation system.

More from Chalkbeat:

Hopson told the district’s educators in an email Thursday that they’ll see the raise reflected in their Nov. 18 paychecks. The pay hikes will be retroactive and will also go to librarians, counselors, instructional facilitators, coaches, social workers, physical/speech therapists and psychologists.

The decision came after Hopson learned that the district won’t receive the state’s testing data until December.

The decision by Hopson came about as a result of last year’s TNReady debacle. It also came in the same week that Knox County’s School Board asked the state for a waiver from included this year’s TNReady test results in student grades and teacher evaluations.

Hopson made the right decision — it is unfair to ask teachers to wait to receive pay raises because of the state’s mistakes with TNReady. It’s also unfair to use data from last year’s mess of a test administration to evaluate teachers. While I’ve expressed doubts about the usefulness of value-added data in evaluating teachers, even those who haven’t should acknowledge that using data from last year (or this year) is problematic.

Shelby County educators will all see a raise this year. The next question: Will the school board there join Knox County in requesting a waiver from using test data for students and teachers this year?

For more on education politics and policy in Tennessee, follow @TNEdReport


 

PET Talks TNReady

JC Bowman is the Executive Director of Professional Educators of Tennessee 

Tennessee has made a decade long effort to raise ours standards in public education, with mixed results and contentious debate among stakeholders and policymakers. We have high expectations for our students and our schools, which is a point all can agree upon. The appropriate role of assessment is still being debated. Getting it right is important. We need an accurate measure of student achievement and we must treat LEA’s and our educators fairly in this process.

We agree with the Tennessee Department of Education’s opinion that in previous transitions to more rigorous expectations, while scores dropped initially, they rose over the long term. We believe policymakers should continue to see Tennessee students perform better on national assessments.

One thing is certain: “This year’s scores cannot be compared to last year’s TCAP. And it is not practical to judge schools, students or educators by these results as we establish a new baseline with first year TNReady results” according to JC Bowman, executive director of Professional Educators of Tennessee.

Professional Educators of Tennessee would caution policymakers to be less concerned with these test scores, especially with the frustrations of last year’s TNReady experience. We should put more emphasis on the immeasurable impact that teachers may make on a child’s life. To that end we continue to work with the department to reduce the amount of standardized testing in our classrooms. And we are pleased that they have been proactive in that arena with us. TNReady is apparently on track to run smoothly this school year, and a lot of work is currently underway to ensure success. It is also important to know that the new testing vendor Questar, as well as the TNDOE, is making a genuine effort to work with classroom educators across the state to provide responsive customer service and high quality assessments.

In Tennessee, Questar is responsible for developing, administering, scoring and providing reports for the TNReady assessment program, including grades 3 through 8 State Summative Assessment in ELA and Math as well as State End-of-Course Assessments in ELA I, II, III; Algebra I and II; Geometry; and Integrated Math I, II, and III.

It has long been acknowledged that a strong public educational system is essential not only to the successful functioning of a democracy, but also to its future. That system must provide all children with an equitable and exceptional education that prepares them for college, career and life.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

Knox County Takes a Stand

Last night, the Knox County School Board voted 6-3 in favor of a resolution calling on the General Assembly and State Board of Education to waive the use of TCAP/TNReady data in student grades and teacher evaluations this year.

The move comes as the state prepares to administer the tests this year with a new vendor following last year’s TNReady disaster. The lack of a complete testing cycle last year plus the addition of a new vendor means this year is the first year of the new test.

The Board passed the resolution in spite of Governor Haslam warning against taking such a step.

In his warning, Haslam said:

“The results we’ve seen are not by accident in Tennessee, and I think you have to be really careful about doing anything that could cause that to back up,” Haslam said.

He added:

Haslam attributed that progress to three things, including tying standardized tests to teacher evaluations.

“It’s about raising our standards and expectations, it’s about having year-end assessments that match those standards and then I think it’s about having assessments that are part of teachers’ evaluations,” Haslam said. “I think that you have to have all of those for a recipe for success.”

Haslam can present no evidence for his claim about the use of student assessment in teacher evaluation. In fact, it’s worth noting that prior to 2008, Tennessee students achieved at a high level according to what were then the state standards. While the standards themselves were determined to need improvement, the point is teachers were helping students hit the designated mark.

Teachers were moving students forward at this time without evaluations tied to student test results. Policymakers set a mark for student performance, teachers worked to hit that mark and succeeded. Standards were raised in 2008, and since then, Tennessee has seen detectable growth in overall results, including some exciting news when NAEP results are released.

To suggest that a year without the use of TVAAS scores in teacher evaluations will cause a setback is to insult Tennessee’s teachers. As if they’ll just relax and not teach as hard.

Another argument raised against the resolution is that it will somehow absolve teachers and students of accountability.

Joe Sullivan reports in the Knoxville Mercury:

In an email to board members, [Interim Director of Schools Buzz] Thomas asserted that, “We need a good standardized test each year to tell us how we are doing compared to others across the state and the nation. We will achieve greatness not by shying away from this accountability but by embracing it.” And he fretted that, “This resolution puts that at risk. In short, it will divide us. Once again we could find ourselves in two disputing camps. The pro-achievement folks on the one side and the pro-teacher folks on the other.”

Right now, we don’t know if we have a good standardized test. Taking a year to get it right is important, especially in light of the frustrations of last year’s TNReady experience.

Of course, there’s no need for pro-achievement and pro-teacher folks to be divided into two camps, either. Tennessee can have a good, solid test that is an accurate measure of student achievement and also treat teachers fairly in the evaluation process.

To be clear, teachers aren’t asking for a waiver from all evaluation. They are asking for a fair, transparent evaluation system. TVAAS has long been criticized as neither. Even under the best of circumstances, TVAAS provides a minimal level of useful information about teacher performance.

Now, we’re shifting to a new test. That shift alone makes it impossible to achieve a valid value-added score. In fact, researchers in the Journal of Educational Measurement have said:

We find that the variation in estimated effects resulting from the different mathematics achievement measures is large relative to variation resulting from choices about model specification, and that the variation within teachers across achievement measures is larger than the variation across teachers. These results suggest that conclusions about individual teachers’ performance based on value-added models can be sensitive to the ways in which student achievement is measured.
These findings align with similar findings by Martineau (2006) and Schmidt et al (2005)
You get different results depending on the type of question you’re measuring.

The researchers tested various VAM models (including the type used in TVAAS) and found that teacher effect estimates changed significantly based on both what was being measured AND how it was measured.

Changing to a new type of test creates value-added uncertainty. That means results attributed to teachers based on a comparison of this year’s tests and the old tests will not yield valid results.

While insisting that districts use TVAAS in teacher evaluations this year, the state is also admitting it’s not quite sure how that will work.

From Sullivan’s story:

When asked how these determinations will be made, a spokesperson for the state Department of Education acknowledges that a different methodology will have to be employed and says that, “we are still working with various statisticians and experts to determine the exact methodology we will use this year.”

Why not at take at least a year, be sure there’s a test that works, and then build a model based on that? What harm would come from giving teachers and students a year with a test that’s just a test? Moreover, the best education researchers have already warned that testing transitions create value-added bumps. Why not avoid the bumps and work to create an evaluation system that is fair and transparent?

Knox County has taken a stand. We’ll soon see if others follow suit. And if the state is listening.

For more on education politics and policy in Tennessee, follow @TNEdReport