It May Be Ready, But is it Valid?

In today’s edition of Commissioner Candice McQueen’s Educator Update, she talks about pending legislation addressing teacher evaluation and TNReady.

Here’s what McQueen has to say about the issue:

As we continue to support students and educators in the transition to TNReady, the department has proposed legislation (HB 309) that lessens the impact of state test results on students’ grades and teachers’ evaluations this year.

In 2015, the Tennessee Teaching Evaluation Enhancement Act created a phase-in of TNReady in evaluation to acknowledge the state’s move to a new assessment that is fully aligned to Tennessee state standards with new types of test questions. Under the current law, TNReady data would be weighted at 20 percent for the 2016-17 year.

However, in the spirit of the original bill, the department’s new legislation resets the phase-in of growth scores from TNReady assessments as was originally proposed in the Tennessee Teaching Evaluation Enhancement Act. Additionally, moving forward, the most recent year’s growth score will be used for a teacher’s entire growth component if such use results in a higher evaluation score for the teacher.

We will update you as this bill moves through the legislative process, and if signed into law, we will share detailed guidance that includes the specific options available for educators this year. As we announced last year, if a teacher’s 2015-16 individual growth data ever negatively impacts his or her overall evaluation, it will be excluded. Additionally, as noted above, teachers will be able to use 2016-17 growth data as 35 percent of their evaluation if it results in a higher overall level of effectiveness.

And here’s a handy graphic that describes the change:

TNReady Graphic

 

 

Of course, there’s a problem with all of this: There’s not going to be valid data to use for TVAAS. Not this year. It’s bad enough that the state is transitioning from one type of test to another. That alone would call into question the validity of any comparison used to generate a value-added score. Now, there’s a gap in the data. As you might recall, there wasn’t a complete TNReady test last year. So, to generate a TVAAS score, the state will have to compare 2014-15 data from the old TCAP tests to 2016-17 data from what we hope is a sound administration of TNReady.

We really need at least three years of data from the new test to make anything approaching a valid comparison. Or, we should start over building a data-set with this year as the baseline. Better yet, we could go the way of Hawaii and Oklahoma and just scrap the use of value-added scores altogether.

Even in the best of scenarios — a smooth transition from TCAP to TNReady — data validity was going to be challenge.

As I noted when the issue of testing transition first came up:

Here’s what Lockwood and McCaffrey (2007) had to say in the Journal of Educational Measurement:

We find that the variation in estimated effects resulting from the different mathematics achievement measures is large relative to variation resulting from choices about model specification, and that the variation within teachers across achievement measures is larger than the variation across teachers. These results suggest that conclusions about individual teachers’ performance based on value-added models can be sensitive to the ways in which student achievement is measured.
These findings align with similar findings by Martineau (2006) and Schmidt et al (2005)
You get different results depending on the type of question you’re measuring.

The researchers tested various VAM models (including the type used in TVAAS) and found that teacher effect estimates changed significantly based on both what was being measured AND how it was measured.

And they concluded:

Our results provide a clear example that caution is needed when interpreting estimated teacher effects because there is the potential for teacher performance to depend on the skills that are measured by the achievement tests.

If you measure different skills, you get different results. That decreases (or eliminates) the reliability of those results. TNReady is measuring different skills in a different format than TCAP. It’s BOTH a different type of test AND a test on different standards. Any value-added comparison between the two tests is statistically suspect, at best. In the first year, such a comparison is invalid and unreliable.

So, we’re transitioning from TCAP to TNReady AND we have a gap in years of data. That’s especially problematic — but, not problematic enough to keep the Department of Education from plowing ahead (and patting themselves on the back) with a scheme that validates a result sure to be invalid.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

Pinkston: Charter Industry Unraveling

MNPS Board Member Will Pinkston argues in today’s Tennessean that Nashville’s charter school industry is unraveling.

To make his case, he cites a federal class action lawsuit against RePublic charter schools, a state finding that Rocketship isn’t following the law when it comes to serving students with disabilities and English language learners, and a significant financial deficit at LEAD Public Schools.

Of Rocketship, Pinkston notes:

Despite failing to serve its current students, Rocketship routinely makes end-runs around the local school board to seek state approval of more charters. That’s because Rocketship’s growth isn’t driven by what’s best for kids but rather by its real-estate deals with Turner-Agassi Charter School Facilities Fund, a for-profit investment fund co-managed by tennis star Andre Agassi.

Taken together, Pinkston says, the problems faced by these three charter operators show an industry not living up to its hype.

Add to that the expense of charters, and Pinkston says we should exercise caution. He previously noted based on the findings of an audit of MNPS:

Briefly: The new audit acknowledges that unabated growth of charter schools does, in fact, have a fiscal impact on existing MNPS schools. The operative language in the audit relative to charter fiscal impact can be found on Page 3-16, which states: “The key question for determining fiscal impacts is whether enrollment reductions allow a district to achieve expenditure reductions commensurate with revenue reductions. Fixed costs are incurred regardless of whether students attend traditional or charter schools. The problem is that some fixed costs, such as building maintenance, computer network infrastructure, and health services do not vary based on enrollment. Therefore, teachers and their salaries are a key cost driver tied to student enrollment … However, it is not always possible to reduce teacher costs proportionate to losses in revenue. For these costs to be reduced significantly, the school would need to close altogether.”

While some call it a distraction, the charter debate is alive and well in MNPS.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

That’s NOT a PAC

Melanie Balakit of the Tennessean reports that an Administrative Law Judge has ruled that Williamson Strong was not a political action committee (PAC) in the 2014 election cycle:

Williamson Strong was not a political action committee in a past school board election, according to an order released Thursday from an administrative law judge.

The order, written by Michael Begley, dissolves a fine that Williamson Strong had for failure to register as a PAC during a 2014 school board election.

The Tennessee Registry of Election Finance issued a $5000 fine, later reduced to $2,500, to Williamson Strong in 2015.

Williamson Strong posted this response on their Facebook page:

A former school board member filed a campaign finance against Williamson Strong in December 2014. 28 months later, we have been vindicated!

We’re still digesting the 19-page order from the Administrative Law Judge, but you can read it along with us.

“After consideration of this entire record in this matter, it is determined that the Respondents did not constitute a political campaign committee with respect to the 2014 election. It is therefore ORDERED that the Registry’s charges against the respondents are DISMISSED WITH PREJUDICE.”

The order from the ALJ indicates the Registry failed to meet the burden of establishing Williamson Strong constituted a PAC for three reasons: The “express advocacy” standard, the functional equivalency test, and the media exception.

To summarize, the judge found that Williamson Strong did not engage in any “express advocacy” — they didn’t encourage the public to vote for or against any specific candidate or candidates. The judge also found that Williamson Strong did not act as the “functional equivalent” of a PAC. Finally, the judge found that Williamson Strong’s activity may have fallen under the “media exception.” That is, Williamson Strong was providing information to the public via a website and Facebook page just as a media outlet may do during an election cycle.

This order becomes final unless the Registry appeals within 15 days.

The ruling in this case is clear: Williamson Strong is not a PAC and certainly was NOT a PAC in 2014, despite claims by Susan Curlee and others to the contrary.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

Vouchers: The Ultimate Non-Solution

Education Commissioner Candice McQueen expressed frustration recently at years of ineffective education reform efforts. Specifically, she said:

“We can’t keep throwing $10 million, $11 million, $12 million, $15 million at solutions that are not solutions,” she told legislators on House education committees.

McQueen was lamenting the lack of progress made in school turnaround efforts and pointing lawmakers toward proven solutions. In fact, she noted the state’s ESSA plan focuses on strategies that have gotten results:

While McQueen didn’t single out specific turnaround initiatives, she stressed that Tennessee needs to focus on what has worked — specifically, at 10 schools that have been moved off the state’s priority list so far and have undergone case studies. McQueen named common themes: strong school leaders, quality instruction, and community and wraparound supports, such as mental health care services.

Candice McQueen is frustrated, and rightly so. As a result, her Department of Education is using ESSA to focus Tennessee’s school improvement efforts and even rein-in the Achievement School District (ASD).

What’s interesting in all of this, then, is that some state lawmakers seem intent on pushing through a voucher program for Shelby County.

McQueen told lawmakers they can’t keep throwing millions of dollars at solutions that are not solutions. But, according to the Fiscal Note on SB 161/HB 126, the bill will result in spending nearly $9 million on the voucher “solution” next year and more than $18 million per year once fully implemented. Of course, those estimates assume the program doesn’t expand beyond Shelby County.

A voucher program that started small in Indiana just five years ago now costs that state $131 million per year.

Talk about an expensive non-solution. In fact, the most recent research indicates that vouchers actually can have a negative impact on student academic achievement.

Kevin Carey summarizes:

The first results came in late 2015. Researchers examined an Indiana voucher program that had quickly grown to serve tens of thousands of students under Mike Pence, then the state’s governor. “In mathematics,” they found, “voucher students who transfer to private schools experienced significant losses in achievement.” They also saw no improvement in reading.

The next results came a few months later, in February, when researchers published a major study of Louisiana’s voucher program. Students in the program were predominantly black and from low-income families, and they came from public schools that had received poor ratings from the state department of education, based on test scores. For private schools receiving more applicants than they could enroll, the law required that they admit students via lottery, which allowed the researchers to compare lottery winners with those who stayed in public school.

They found large negative results in both reading and math. Public elementary school students who started at the 50th percentile in math and then used a voucher to transfer to a private school dropped to the 26th percentile in a single year. Results were somewhat better in the second year, but were still well below the starting point.

In June, a third voucher study was released by the Thomas B. Fordham Institute, a conservative think tank and proponent of school choice. The study, which was financed by the pro-voucher Walton Family Foundation, focused on a large voucher program in Ohio. “Students who use vouchers to attend private schools have fared worse academically compared to their closely matched peers attending public schools,” the researchers found. Once again, results were worse in math.

So, we have an Education Commissioner pleading with the General Assembly to focus on what works AND we have evidence from other states telling us vouchers don’t get the job done. At the same time, we have evidence from schools right here in Tennessee that tells us what IS working.

It’s time for the Tennessee General Assembly to heed the advice of Candice McQueen and stop attempting to throw millions of dollars at “solutions that are not solutions.”

pile-of-cash-1024x576

For more on education politics and policy in Tennessee, follow @TNEdReport


 

MNPS Responds To Large Number Of Bus Driver Complaints

Jason Gonzales at the Tennessean has a report out today that shows that there have been almost 400 complaints on MNPS bus drivers from August to January. These complaints range from not picking up students at the correct bus stop to some very serious accusations.

One case in the six-month span included an allegation against a bus driver of inappropriate communication with a student.

“Mom wants to report what she thinks may be suspicious activity between her 17-year-old daughter and her bus driver ‘Mr. Q.’ Mom says the driver bought her daughter a cell phone. Mom has the phone and found text messages between the two saying: ‘I’m thinking about you’ and ‘what are you doing,'” the January complaint reads.

“Also, she says that the driver has given her daughter money.”

MNPS doesn’t track the resolutions to these complaints so there is no information on if theses accusations were dealt with. Another accusation seems to read like the bus driver was okay with students fighting.

“(Parent) states when her son was on the bus in the afternoon route … three male students told her son they were going to jump him. The driver told the students, ‘whatever you do off the bus is up to you.’ Parent states after students got off the bus they jumped her son and busted his head. She feels the driver encouraged the students to jump her son, and didn’t do anything to prevent the incident,” a parent complaint to Metro Schools file in September says.

The board and district must act quickly in finding a solution to this problem and investigate all complaints. If bus drivers are having inappropriate relationships with students and encouraging violence, the punishment should be swift and harsh.

Thousands of students ride the bus each and every day. Their safety should be the top priority. This will now be the district’s top priority thanks to the reporting of Jason Gonzales. It shouldn’t have taken this long.

Palacios said the request of records for bus driver complaints “has been enlightening and identified as a serious priority” by the district. The management tool to monitor how resolutions came about from complaints would also be able to monitor discipline trends and how many drivers were disciplined, she said.

You can read the full article here.

Update (10:20am)

School board member Will Pinkston responded to the story on twitter.

Uncharacteristically good reporting by . I’ve been complaining about stuff like this since 2014. I’m glad is under new management. The new team is fixing broken processes and creating new processes where none existed. Logical follow-up reporting would be: Jesse Register systematically cut wages and hours bus drivers, causing many of the most experienced drivers to go elsewhere and leaving the remaining drivers overworked and stressed out. He left behind a mess.

The blame Register excuse is getting old from the school board. Jesse Register left Metro Nashville Public Schools on June 30, 2015. MNPS has been without Register for 633 days. The fault from this falls squarely on MNPS and the school board. Acknowledge the issue, fix it, and move on to the next set of issues facing our school system. Don’t spend time blaming others when you have the power to make changes yourself but failed to do so.

Blaming the problems of now on a leader who left 633 days ago is poor leadership.

Update (11:55am)

Nashville school board member Pinkston has responded via twitter:

Sounds like the nitwits are coming unglued and trying to blame the bus driver stuff on me. Let’s be clear about who did what and when. Let’s not forget who attacked for meeting with bus drivers to discuss their poor working conditions.

 

For more on education politics and policy in Tennessee, follow @TNEdReport

 


 

 

Backpack Full of Cash Coming to Nashville

MNPS Board Member Amy Frogge today announced that Matt Damon’s documentary “Backpack Full of Cash” will be coming to Nashville in April. Frogge posted on Facebook:

I’m excited to announce that “Backpack Full of Cash” has been selected for the Nashville Film Festival!

My children, their teachers, and I participated in this documentary, and although I’ve not yet seen it, I believe it will provide an eye-opening view of the school privatization movement affecting Nashville (and our state as a whole), as well as other urban areas across the country. The film, narrated by Matt Damon, focuses on market-based education reform and its impact on public schools.

It will be screened at the Regal Hollywood 27 on:
Sunday, April 23, 2017 at 5:30 pm
and
Tuesday, April 25, 2017 at 5:30 pm.

Join me for a screening (and possibly a Q & A following the film). This should be a timely and informative film!

Valerie Strauss of the Washington Post says of the film:

Actually, it’s a 90-minute documentary about the real and ongoing movement to privatize public education and its effects on traditional public schools and the students they enroll. With actor and activist Matt Damon narrating, “Backpack” tells a scary but important story about corporate school reform policies that critics say are aimed at destroying the U.S. public education system, the country’s most important civic institution.

So, two dates in April offer a chance for those in and around Nashville to check out this important film that also features an MNPS Board member.

backpack

For more on education politics and policy in Tennessee, follow @TNEdReport


 

Voucher Opposition Growing

I reported last week on the Sumner County School Board passing a resolution opposing vouchers.

Here’s more from the Hendersonville Standard on that vote:

“We are just trying to keep it from ever getting implemented in the state to begin with because there’s no telling where it would go (from there),” board member Ted Wise said.

Board member Sarah Andrews agreed.

“I appreciate us looking at this,” she said. “I have been disappointed to see the number of bills coming up in the legislature concerning vouchers. To take money away from local schools is just very frustrating.”

The story noted that school systems impacted by the voucher proposal currently advancing in the General Assembly could stand to lose $37.2 million.

A program that started small in Indiana now costs $131 million, creating an education funding deficit of $54 million.

green-dollar-sign-clipart-green-dollar-sign-4

For more on education politics and policy in Tennessee, follow @TNEdReport


 

 

Senate Majority Leader Says Vouchers are “Problematic”

Senator Mark Norris, who has supported school voucher bills in the past, calls this year’s voucher plan “problematic.” The plan advancing this year is sponsored by Brian Kelsey — like Norris, from Shelby County — and it is a “pilot” program just for Shelby County.

The Nashville Ledger reports:

“It’s problematic,” Norris said when asked about the legislation in light of a Shelby County Commission vote opposing the voucher bill. The measure targets Shelby County because it has some 30 schools in the state’s lowest 5 percent for student performance.

But the measure is “problematic” for a combination of reasons, Norris said, mainly because of opposition by the Shelby County Commission and concerns about holding private schools “accountable” to the same standards as public schools.

Some opponents point out students who attend private schools as part of the program won’t be required to take the TNReady assessment, as public school students will.

School voucher advocates have failed in each of the last four legislative sessions to advance enabling legislation.

Now, they are trying to start their program only in Shelby County. Even before voucher proponents narrowed their focus to Shelby County in hopes of securing enough votes to advance the bill to the House floor, emerging research warned vouchers could actually be detrimental to student achievement. Those facts didn’t stop a House subcommittee from advancing the legislation, however.

Now, though, it seems the legislation is facing problems as lawmakers face the reality of a community not excited about Kelsey’s plan.

The Ledger notes:

Rep. Antonio Parkinson, a Memphis Democrat who opposes the legislation, commended Norris “for seeing” problems with the measure.

“There’s pressure building and people are sacrificing, taking off from work to be here, because they’re passionate against the fact that they targeted Shelby County, as if Shelby County caused all of the problems with regard to education,” Parkinson said. “It’s becoming personal for a Shelby County legislator to be carrying legislation like that.”

Parkinson pointed out Hamilton County has low-performing schools but is not included in the pilot program legislation, which he termed a “great experiment.”

A program in Indiana that started out six years ago as a small voucher plan has expanded rapidly and now costs $131 million. Research there suggests that while some advocates argued vouchers would save school systems money, they have actually created a $54 million funding deficit:

A report on the program released by the Department of Education shows the program costs $54 million.

“If the idea behind a voucher program is we’re going to have the money follow the student, if the student didn’t start in a public school, the money isn’t following them from a public school, it’s just appearing from another budget,” [Researcher Molly] Stewart said. “And we’re not exactly sure where that’s coming from.”

Vouchers, then, create $54 million in new expenditures — an education funding deficit — in Indiana.

Evidence says vouchers don’t work. Research shows they are expensive. The Senate Majority Leader calls them “problematic.” It’s time for vouchers to go.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

Mary Holden Takes the Hill

Former educator and current blogger Mary Holden tells the tale of her “Day on the Hill” in Nashville. Definitely worth a read. Here’s some of what she had to say about her experience advocating for public education at the Tennessee General Assembly:

There are many things that bother me about voucher legislation. But here are the two biggies:

  1. Vouchers haven’t worked anywhere they’ve been implemented. The evidence is clear. See also herehere, and here.
  2. Look who opposes vouchers: Teachers! You know, those people who actually do the work of educating our children! They know a thing or two about what is needed in public education, and we should be listening to them! (I should know…. I was a teacher, in case you didn’t know!)

But seriously, if the people we trust to educate our children believe vouchers would be harmful to our schools AND if there is plenty of evidence showing that vouchers aren’t successful, then why???? Why do they keep getting proposed?

Read more about Mary’s visit to our legislators and her encounter with state Senator Steve Dickerson.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

Sumner School Board Takes a Stand Against Vouchers

The Sumner County School Board tonight unanimously voted in favor of a resolution opposing school vouchers in Tennessee. The move comes as legislative debate over vouchers is heating up.

One member of Sumner County’s legislative delegation, state Senator Ferrell Haile, is a co-sponsor of the “Opportunity Scholarship” program targeted at Memphis.

Here’s the resolution:

WHEREAS, the Sumner County Board of Education is responsible for providing a local system of public education; and

WHEREAS, the Tennessee General Assembly in the 2017 legislative session will entertain legislation that would create a voucher program allowing students to use public education funds to pay for private school tuition; and

WHEREAS, more than 50 years have passed since private school vouchers were first proposed, and during that time proponents have spent millions of dollars attempting to convince the public and lawmakers of the concept’s efficacy, and yet, five decades later, vouchers still remain controversial, unproven, and unpopular; and

WHEREAS, the Constitution of the State of Tennessee requires that the Tennessee General Assembly “provide for the maintenance, support and eligibility standards of a system of free public schools”, with no mention of the maintenance or support of private schools; and

WHEREAS, the State of Tennessee, through work of the Tennessee General Assembly, the Tennessee Department of Education, the State Board of Education and local school boards, has established nationally recognized standards and measures for accountability in public education; and

WHEREAS, vouchers eliminate public accountability by channeling tax dollars into private schools that do not face state-approved academic standards, do not make budgets public, do not adhere to open meetings and records laws, do not publicly report on student achievement, and do not face the public accountability requirements contained in major federal laws, including special education; and

WHEREAS, vouchers have not been effective at improving student achievement or closing the achievement gap, with the most credible research finding little or no difference in voucher and public school students’ performance; and

WHEREAS, vouchers leave many students behind, including those with the greatest needs, because vouchers channel tax dollars into private schools that are not required to accept all students, nor offer the special services they may need; and

WHEREAS, vouchers give choices to private schools, not students and parents, since private schools decide if they want to accept vouchers, how many and which students they want to admit, and the potentially arbitrary reasons for which they might later dismiss a student; and

WHEREAS, many proponents argue these programs will increase options, when in fact several options currently exist within public school systems; and

WHEREAS, voucher programs divert critical dollars and commitment from public schools to pay private school tuition for a few students, including many who already attend private schools; and

WHEREAS, vouchers are an inefficient use of tax payer money because they compel taxpayers to support two school systems: one public and one private, the latter of which is not accountable to all the taxpayers supporting it; and

NOW THEREFORE BE IT RESOLVED, that the Sumner County Board of Education opposes any expansion of the special education voucher program as well as any new legislation that would divert money intended for public education to private schools.

For more on education politics and policy in Tennessee, follow @TNEdReport