EduShyster Visits Tennessee

Noted education blogger EduShyster has a post up today regarding the fun and excitement that is Tennessee education policy.

The post talks about data-driven results… the TCAP score release delay, the competing petitions regarding Commissioner Huffman and his continued employment.  And much more.

She notes that voters will be pleased to learn that if they re-elect Governor Bill Haslam, they’ll get more Kevin Huffman.  Or, maybe not.  Haslam is saying he’ll decide more about Huffman AFTER the election.

Also discussed: Secret meetings and the Koch Brothers.

Read it all!

 

 

 

Wonder if the State Charter Authorizer Will Approve?

Blake Farmer of WPLN notes that legislation creating a state charter authorizer is just one vote in the Senate away from becoming law.  The legislation would allow charter schools to apply directly to the state, or to apply to the state if denied by a local school board.  Some have speculated that out of state organizations (like Great Hearts) will simply go straight to the state authorizer rather than dealing with the sometimes contentious local boards.

Cari Gervin points out that Governor Bill Haslam is on the board (albeit in honorary fashion) of this organization which is seeking to open a charter school in Knoxville.

If, despite all the Knoxville luminaries on the board, the group gets turned down at the local level, one wonders how receptive a state charter authorizer with members appointed by honorary board member Bill Haslam would be?

NAEP in TN: The Rest of the Story

Today, leaders across Tennessee lauded the NAEP (National Assessment of Educational Progress) results.  And they should. Tennessee is first in an education statistic and it’s a good one.  The fastest growing state in the last 2 years in terms of growth in math and reading scores as measured by NAEP.

That’s good news. It’s very good news.  Despite some claims, though, it’s very difficult to say results on the 2013 NAEP are a direct result of reforms that took place in 2011 and 2012. States with more rigid teacher tenure and with collective bargaining for teachers scored higher overall than Tennessee (nevermind Ron Ramsey’s rant against both — they just don’t test out as significant indicators of student achievement in either a positive or negative way). And of course, it’s easier to grow when you have a long way to go — Tennessee has historically been among the lowest performing states on the NAEP.

Let’s take a look at the data on a deeper level, though, and see what’s been happening. For the sake of this comparison, I’m going to look at Tennessee and Kentucky — a similarly situated Southeastern state with a nearly identical level of students in poverty and/or on free/reduced lunch.  I’m going to look at 20 year trends to see what we can learn from the overall education work in both states. So, here goes:

4th Grade Math

1992      KY   215                        TN  211

2013     KY  241                          TN 240

Over the 20 year period, Kentucky increased by 16 points, Tennessee by 19 — and Kentucky still leads by 1 point.  To Tennessee’s credit, the gap in scores was narrowed by 3 points.

Let’s look at the percentage of students in each state who test at or above basic — this is short of the mastery demonstrated by the score of proficient, but still indicates a basic understanding of the concept — below basic is the lowest score and is frankly, unacceptable.

In 1992, 51% of Kentucky kids tested at or above basic and in Tennessee, it was 47%.  Now, 84% of Kentucky kids are at or above basic in 4th grade math while only 80% can say the same in Tennessee.  Both states posted 33 point gains in this important number over the last 20 years and Kentucky remains 4 points ahead of Tennessee.

Now, let’s look at the two states and how they are doing with their poorest students, those on free and reduced lunch.  One of the key goals of many involved in education is closing achievement gaps and moving the lowest performing kids forward quickly.

FREE/REDUCED LUNCH 4th GRADE MATH SCORES

KY  232  TN 228

Achievement gap

KY 19 points  TN 26 points

Not only do Tennessee’s students on free and reduced lunch score lower than Kentucky’s, Tennessee’s gap is wider — by a 7-point margin in the case of 4th grade math.  This begins a troubling pattern.

Before I go further with this analysis, I want to point out that Kentucky doesn’t use value-added data for teacher evaluations, has no charter schools, its teachers are awarded tenure after 4 years, and it hasn’t adopted any of the reforms Tennessee’s current leaders tell us are essential to improving scores.  In fact, their Commissioner has openly expressed skepticism of any evaluation system that bases any part of a teacher’s score on value-added data.  As the rest of the data will demonstrate, both Kentucky and Tennessee have posted gains over time on NAEP — in most categories, Kentucky started out tied or very slightly ahead of Tennessee and today, Kentucky remains ahead.  Kentucky posted some pretty big gains in the mid-90s and again from 2003-2009.  Since then, they’ve held fairly steady.  That’s an expected result, by the way — a big gain followed by steady maintenance of the new level.  For Tennessee, that won’t be enough, but celebrating the big gain is certainly warranted.  It’s also important to take care in assigning causality.

Ok, back to the data.

8th Grade Math

1992  KY 262   TN 259

2013  KY 281  TN 278

Over 20 years, both states made a 19-point gain in 8th grade math and Kentucky maintains a 3-point lead.  Looking at students at or above “basic,” Kentucky was at 51% in 1992 and is at 71% today while Tennessee was at 47% in 1992 and at 69% today.  Kentucky gained 20 points and Tennessee, 22.

FREE/REDUCED LUNCH 8th GRADE MATH SCORES

KY 268  TN 265

Achievement Gap

KY 25 points TN 27 points

 

4th Grade Reading

1992 KY 213   TN 212

2013 KY 224   TN 220

Here, Kentucky makes an 11-point gain and Tennessee makes an 8-point gain over the same time period.  Now, Kentucky has a solid 4-point lead in reading — while in 1992, it was just 1-point.  In terms of students at or above “basic,” Kentucky was at 58% in 1992 and stands at 71% today while Tennessee was at 57% in 1992 and is now at 67% — Kentucky gained 13 points over this time, while Tennessee gained 10.

FREE/REDUCED LUNCH 4th GRADE READING SCORES

KY 213  TN 205

Achievement Gap

KY 24 points TN 32 points

 

8th Grade Reading

1998  KY 262   TN 259

2013 KY 270  TN 265

Here, Kentucky gained 8 points and Tennessee only 6 — giving Kentucky students a 5-point edge over Tennessee’s in 8th grade reading. Both states posted 6-point gains in percentage of students at or above “basic,” with Kentucky maintaining a 3-point edge in that category.

FREE/REDUCED LUNCH 8th GRADE READING SCORES

KY 258  TN 256

Achievement Gap

KY 23  TN 20

As the data shows, Kentucky and Tennessee in many cases posted similar net gains over time, with Kentucky seeing big jumps in the mid-90s and again in the early part of the last decade.  In all categories, Kentucky’s students still outperform Tennessee, though in some cases that gap is narrowing.  Also, in all subjects, Kentucky’s students on free/reduced lunch outperform Tennessee’s students on free/reduced lunch.

ABOUT THAT FREE LUNCH

Possibly the most interesting (and troubling) finding in this data is the widening of the gap between free/reduced lunch students and those not eligible.  Tennessee has a significant population of students who qualify (as does Kentucky) and one of the key aims of reform is to ensure that gaps are closed and that those with the most challenges get more opportunity.  Here’s some data demonstrating that Tennessee’s achievement gap is widening when it comes to its poorest students.

FREE/REDUCED LUNCH ACHIEVEMENT GAPS

4th Grade Math 2011 — 20 points  2013 – 26 points

8th Grade Math 2011 — 25 points  2013 – 27 points

4th Grade Reading 2011 — 26 points  2013 – 32 points

8th Grade Reading 2011 — 20 points  2013 – 20 points

The 4th grade scores in particular present rapidly widening gaps.  That’s absolutely the wrong direction.  Moreover, students on free/reduced lunch saw their scores improve less than those not on free/reduced lunch 3 points vs. 9 points in 4th grade math, 3 points vs. 5 points in 8th grade math, 1 point vs. 7 points in 4th grade reading, and both groups saw a +6 in 8th grade reading.

While we’re told that “poverty is not an excuse” it certainly appears to be a factor (and one growing in importance) in terms of student achievement growth in Tennessee. While we have had significant reforms in some of our poorest urban communities (and even have an Achievement School District to address the most challenged schools), the gap between poor and better off students widened in the last two years.

Yes, Tennessee should celebrate its growth.  But policymakers should use caution when seeing the results from the last 2 years as a validation of any particular policy.  Long-term trends indicate that big gains are usually followed by steady maintenance. And, even with the improvement, Tennessee has a long way to go to be competitive with our peers. Additionally, education leaders should be concerned about the troubling widening of the rich/poor achievement gap  – an outcome at odds with stated policy goals and the fundamental principle of equal opportunity.

For more on education politics and policy in Tennessee, follow us @TNEdReport

 

 

 

20 Years of TVAAS has Told Us Almost Nothing

Valerie Strauss has an interesting piece over at the Washington Post dealing with Value-Added Modeling.  More specifically, the post analyzes what can be learned from 20 years of the Tennessee Value-Added Assessment System (TVAAS) implemented as a result of the Education Improvement Act — the Act that created the Basic Education Program (Tennessee’s school funding formula, also known as BEP).

The promise of Value-Added Assessment was that we could learn a lot about which schools were working and which weren’t.  We could learn a lot about kids and how they were progressing.  We could even learn about teachers and how they were doing with all their students and with specific groups of students.  With all this information, Tennessee would intervene and take action that would move schools forward.

Unfortunately, that promise has not been delivered.  At all.

Here, I highlight the key takeaways from the Strauss piece.  Tennessee parents and policymakers should take note – TVAAS is taking up tax dollars and impacting teacher evaluations and it doesn’t really work all that well.

1. Using TVAAS masked persistently low proficiency rates.

The Tennessee value-added assessment model basically identified the schools that were already making required annual proficiency targets, but it failed to distinguish between schools with rising or declining proficiency scores.

In short, the Sanders Model did little to address the essential unfairness perpetuated by NCLB proficiency requirements, which insisted that those student further behind and with fewer resources than those in economically privileged schools had to work harder to reach the same proficiency point.  More importantly, there was no evidence that the Sanders version of value-added testing did anything to help or even predict the future outcomes for those furthest behind.

 

2. TVAAS is unstable and inappropriate for high-stakes decisions — like hiring and firing teachers, renewing licenses, or determining pay.

And despite the National Research Council and the National Academies’ flagging of value-added assessment as too unstable for high-stakes decisions in education …

…states like Tennessee rushed to implement a federally recommended system whereby value-added growth scores would come to dominate teacher evaluation for educators who teach tested subjects.  And contrary to the most basic notions of accountability and fairness, two-thirds of Tennessee teachers who teach non-tested subjects are being evaluated based on school-wide scores in their schools, rather than their own.

3. Continued use of TVAAS as an indicator of “success” leaves the most vulnerable students further and further behind.

In a 2009 Carnegie-funded report, Charles Barone points out that focus on value-added gains, or growth in test scores, may downplay the need for interventions to address low proficiency rates:  “Due to the projection toward proficiency being recalculated annually [in the TVAAS model], there is not necessarily a significant progression, over time toward proficiency . . . causing a delay of needed intervention at appropriate developmental times” (p. 8). So while showing academic progress, gain scores or growth scores easily mask the fact that minority and poor children are far below their well-heeled peers in becoming intellectually prepared for life and careers. And in masking the actual academic progress of the poor and minority students, the state (and the nation) is let off the hook for maintaining and supporting an adequate and equally accessible system of public education for all students. At the same time, politicians and ideologues can celebrate higher “progress rates” for poor and minority students who are, in fact, left further and further behind.

4. Tennessee has actually lost ground in terms of student achievement relative to other states since the implementation of TVAAS.

Tennessee received a D on K-12 achievement when compared to other states based on NAEP achievement levels and gains, poverty gaps, graduation rates, and Advanced Placement test scores (Quality Counts 2011, p. 46).  Educational progress made in other states on NAEP [from 1992 to 2011] lowered Tennessee’s rankings:

• from 36th/42 to 46th/52 in the nation in fourth-grade math[2]

• from 29th/42 to 42nd/52 in fourth-grade reading[3]

• from 35th/42 to 46th/52 in eighth-grade math

• from 25th/38 (1998) to 42nd/52 in eighth-grade reading.

5. TVAAS tells us almost nothing about teacher effectiveness.

While other states are making gains, Tennessee has remained stagnant or lost ground since 1992 — despite an increasingly heavy use of TVAAS data.

So, if TVAAS isn’t helping kids, it must be because Tennessee hasn’t been using it right, right? Wrong. While education policy makers in Tennessee continue to push the use of TVAAS for items such as teacher evaluation, teacher pay, and teacher license renewal, there is little evidence that value-added data effectively differentiates between the most and least effective teachers.

In fact, this analysis demonstrates that the difference between a value-added identified “great” teacher and a value-added identified “average” teacher is about $300 in earnings per year per student.  So, not that much at all.  Statistically speaking, we’d call that insignificant.  That’s not to say that teachers don’t impact students.  It IS to say that TVAAS data tells us very little about HOW teachers impact students.

Surprisingly, Tennessee has spent roughly $326 million on TVAAS and attendant assessment over the past 20 years. That’s $16 million a year on a system that is not yielding much useful information. Instead, TVAAS data has been used to mask a persistent performance gap between middle to upper income students and their lower-income peers.  Overall student achievement in Tennessee remains stagnant (which means we’re falling behind our neighboring states) while politicians and policy makers tout TVAAS-approved gains as a sure sign of progress.

In spite of mounting evidence contradicting the utility of TVAAS, Commissioner Huffman and Governor Haslam announced last week they want to “improve” Tennessee teacher salaries along the lines of merit — and in their minds, TVAAS gains are a key determinant of teacher merit.

Perhaps 2014 will at least produce questions from the General Assembly about the state’s investment in an assessment system that has over 20 years yielded incredibly disappointing results.

For more on Tennessee education politics and policy, follow us @TNEdReport

 

 

Craig Fitzhugh Welcomes Back Tennessee’s Teachers

Last week Governor Bill Haslam released a video welcoming teachers back to the classroom. This week, House Democratic Leader Craig Fitzhugh makes his own video welcoming Tennessee’s teachers. I think teachers will really appreciate Fitzhugh’s message. Watch below.

Hi, I’m House Democratic Leader Craig Fitzhugh.

Last week, Governor Haslam sent a message to teachers welcoming them back to another year of school. I too would like to extend a welcome back and a thank you for your service to our children and our state.

In his message, Governor Haslam said he “could imagine how challenging it is to teach in an environment with a variety of factors beyond your control.”

Quite frankly, I could not agree more.

That is why I have been so deeply disappointed in this Governor and his Commissioner of Education, Kevin Huffman. I’m disappointed in their continued refusal to fix an evaluation system that is driving quality teachers out of the profession. I’m disappointed in their push to cut teacher salaries, while asking them to contribute more to a less secure retirement plan. I’m disappointed in their work with the State Board of Education to revamp the process for licensing teachers—all without consulting the elected leaders in the General Assembly.

Like my wife, my sister-in-law, my niece & my daughter, I know most of you became teachers to make a difference in the lives of the children you encounter. Unfortunately, outside so-called “reform” groups have used their mounds of out-of-state cash to lobby the General Assembly and make your job more difficult. These groups are more concerned with standardized testing & fundraising for their PACs than they are about the future of our children.

As teachers, you are responsible for molding Tennessee’s most precious resources. Unlike Commissioner Huffman who taught for two years and moved on to the lucrative world of education reform, many of you have foregone more lucrative careers because of your passion and dedication to our students.  That is why teachers must always be at the center of our education reform efforts—because you are on the front lines. You know what works, and you know what doesn’t.

Thank you again for another year invested in our education system. Times are tough, believe me I understand that. But always know that you have a friend in our caucus on whom you can call anytime. Thank you.