Still Not TNReady

Rocky Top Ed Talk has an updated list of school systems experiencing delays in receiving TNReady testing materials. These delays have happened in spite of Commissioner McQueen’s confidence in the process of moving forward with pencil and paper tests. Schedules have been changed, updated, and disrupted again and again as the shift was made from computer-based tests to paper tests. Students and teachers have lost valuable instructional time while the state and its testing vendor, Measurement, Inc. continue to experience challenges in meeting test delivery obligations.

Here’s the current list of school systems that have experienced delays in receipt of TNReady materials:

  • Hamilton County Schools
  • Dickson County Schools
  • Robertson County Schools
  • Murfreesboro City Schools
  • RePublic Charter Schools (Nashville)
  • Sumner County Schools
  • Maury County Schools
  • Wilson County Schools
  • Putnam County Schools
  • Williamson County Schools
  • Bartlett City Schools
  • Tipton County Schools
  • Achievement School District (Memphis)
  • Blount County Schools

If your school system has experienced delays or disruptions due to this year’s testing issues, let us know in the comments.

For more on education politics and policy in Tennessee, follow @TNEdReport

Bill Dunn Wrong

Yesterday, in his advocacy for HJR 493, legislation that would remove the Tennessee Constitution’s requirement that the General Assembly adequately fund schools, State Representative Bill Dunn suggested that increasing funding for schools across the state actually does not improve student outcomes. He cited the initial BEP investment, started in 1992 and said that from beginning to end, the program actually resulted in lower student achievement numbers.

This would be a great way to prove Dunn’s case that the General Assembly need not provide additional funds to schools in order to provide an adequate education.

It’s also not true.

Dunn cited ACT scores from the start of the BEP until 1998 and suggested they’d gone down slightly. What he failed to mention is that between 1995 and 1998, the number of students taking the ACT increased by 25%. That would seem to indicate that Rep. Kevin Dunlap was correct when he suggested that new BEP funds created new opportunities for students in rural districts. As the State of Tennessee noted in the 1998 State Report Card:

The ACT is one of three tests approved by the State Board of Education to fulfill the requirement in state law that all students take an exit exam to receive a full high school diploma. The total number of Tennessee graduates taking the ACT rose 25% during the first three years of this new requirement: from 32,628 in 1995 to 40,782 in 1998. Included among those tested were 14,284 who had not completed a college preparatory course of study. Even with these dramatic increases in the number and percentage of students tested, Tennessee’s students were able to narrow the gap between the state and national composite scores in 1998.

So, more students than ever were taking the ACT and by 1998, the state was turning around an initial decline in scores. That’s a different story than the one Bill Dunn told.

Another way to look at the data is to see what happened on the National Assessment of Educational Progress (NAEP) during the early BEP years. While reading scores from 1992 are not readily available, math scores are. Here’s the comparison:

4th Grade Math

1992         211

2000        220

8th Grade Math

1992        259

2000       263

These results show statistically significant improvements in math scores over the same time period the General Assembly was significantly improving investment in public schools. That is, what Bill Dunn said yesterday was just plain wrong.

Finally, it’s worth examining the ACT score differences among districts during the early BEP years. An examination of data beginning in 1991 (the year before BEP) and ending in 2001 (so as to provide 10 years of comparable data) indicates that the top scoring districts in the state on the ACT were also among the top spending districts. In fact, over those years, while not technically statistically significant, it can be said with 92% confidence that the difference in ACT scores among the highest- and lowest-performing districts is explained by per pupil expenditures. That is, the higher the spending, the more likely the district is to be among the state’s top performers on the ACT.

Additionally, during this same ten year time period, the gap between the highest and lowest scores among districts is clearly explained by the gap in per pupil expenditures among those districts. You spend more, you get better results. The impetus for all this spending was the new BEP formula that sent more money to all school systems. Those districts already at the top were most able to take advantage and boost ACT scores while those at the bottom saw an increase in the number of students taking the ACT, resulting in the statewide slight ACT decline Dunn references.

Investing in schools matters. Our state’s constitution requires the General Assembly to provide a system of free public schools, including providing adequate funding for those schools. Bill Dunn doesn’t think spending levels matter. The data suggests otherwise.

For more on education politics and policy in Tennessee, follow @TNEdReport

Creative Problem Solving

What happens when, despite your best efforts, local school systems sue your state claiming a lack of adequate funding? You get nervous is what happens. Especially when three previous lawsuits claiming your state has underfunded schools have been successful.

When a body like the Tennessee General Assembly faces a dilemma such as whether or not to make funding schools a top priority, they can either make a significant new investment in schools OR wait and see if the courts order them to make a significant new investment in schools. Historically, our General Assembly has waited and then taken corrective action by way of new investment only after courts have found that school funding is not adequate and/or equitable.

Now, however, lawmakers are taking a different approach. They are advancing amendments to the state constitution that would essentially eliminate the requirement that the General Assembly provide for a “system of free public schools” in Tennessee.

That’s creative problem solving. The state’s governing legal document binds the General Assembly in a way they don’t much like. So, just change it. Thus, you are now free to continue inadequately funding the state’s schools.

Former state Senator Roy Herron decried this effort on behalf of Tennessee School Systems for Equity. Here’s his take from a letter he submitted to legislators:

I write on behalf of the Tennessee School Systems for Equity, which includes most of Tennessee’s school districts. As your former colleague, I know something of how incredibly busy you are and so I will come right to the point.

This week you will consider a constitutional amendment that would strip your schools and students of constitutional protection for adequate funding.

There are two different proposed constitutional amendments that would deny Tennessee’s children any state constitutional right to adequate public schools. We believe that if either of these provisions were in Tennessee’s Constitution instead of our decades-old Article XI, Section 12, then our children effectively would have no state constitutional protection to ensure even minimally adequate public schools.

Some may tell you that the amendments would leave your school systems and your students with some constitutional protections. But these amendments would deem whatever funding any future legislature provided — or didn’t provide — to be adequate and constitutional. No matter how little.

The amendments would leave in the Constitution language that would provide the illusion, but remove the reality, of constitutional protection for public schools. If the proposed language were in the Constitution, school children would be doomed to whatever fate any future legislature decreed. And schools in your district could receive millions less in state funding, leading either to woefully inadequate schools or soaring property taxes or both.

It’s hard to imagine anything that would adversely impact our students — or Tennessee’s future — more than stripping our children of their constitutional right to adequate public schools.

HJR 493. A distinguished House colleague of yours, however, also has a constitutional amendment, House Joint Resolution 493. It is before your House Education Administration & Planning Subcommittee this Tuesday, March 1st at 3:00 p.m.

The able sponsor says that he only wants to remove any constitutional requirement for schools to be funded “adequately.” But without constitutional protection, a future legislature could say, for example, that each child gets to go to a free public school for a month a year. And that would be legally and literally true.

This proposed amendment would strip our children of any state constitutional protection to an adequate education. That is the respected sponsor’s stated intent and would be the legislative effect.

Let me respectfully submit for your consideration the following beliefs and concerns:

1. To destroy our state’s constitutional protection for adequate funding:

1.1 Endangers children in every county;

1.2 Endangers Tennessee’s future;

1.3 Leaves future legislatures and governors free to undo every good thing you and this legislature have done to educate our children and would allow them to do wrong by our children.

1.4 Would let future legislatures and governors decide that our children and grandchildren could go to inadequate schools.

2. It is not conservative to:

2.1 Strip citizens of constitutional protections;

2.2 Blindly trust government and future governments to do right;

2.3 Ignore decades of constitutional precedent and history;

2.4 Vote to amend our Constitution without carefully hearing from leading experts or at least the Attorney General;

2.5 Ignore Congressman Davy Crockett’s maxim, “First be sure you’re right; then go ahead.”

On behalf of more than 80 school systems all across Tennessee, I respectfully request that you not strip our children of their constitutional right to adequate schools.

For more on education politics and policy in Tennessee, follow @TNEdReport

Ready for a Break

Following the Day One failure of TNReady testing, the state proposed switching to only paper and pencil tests.  Last week, the first sign of trouble on that front developed, as Dickson County reported a delay in receiving the printed materials.

While the Department of Education reports that most districts have received their materials, Chalkbeat reported yesterday that at least a dozen districts have had to reschedule testing due to printing delays. Those districts include:

  • Tennessee Achievement School District
  • Bartlett
  • Hamblen County
  • Maury County
  • Madison County
  • Murfreesboro City
  • Putnam County
  • Robertson County
  • Sevier County
  • Sullivan County
  • Tipton County
  • Wilson County

Despite these delays, the TNReady testing will continue, and in fact, many districts have already begun some paper and pencil testing.

Still, it seems that TNReady just can’t catch a break in its first year.

For more on education politics and policy in Tennessee, follow @TNEdReport

 

The Paper Chase

Following the failure of TNReady on Day One, Commissioner Candice McQueen announced a simple solution: Tests will now be administered on pencil and paper. Except, it turns out, it’s not so simple. What if the paper tests don’t arrive on time?

The Dickson Herald reports:

Dickson County Schools have delayed administering the paper version of the state’s new TN Ready standardized tests until March 7 after a delay in receiving the testing materials, the schools director said.

Schools Director Dr. Danny Weeks alerted parents to the issue in a SchoolReach phone message and he also discussed the matter with the county School Board on Thursday night.

Educators and parents had prepared for administering the paper tests on Monday. However, Weeks said the school system had not yet received confirmation the print testing materials had yet shipped Thursday.

The ongoing saga of the TNReady challenges reminds me of the time the legislature pulled Tennessee out of PARCC just as we were preparing to have our first year with the Common Core aligned tests. Instead of a year without a test, we administered another year of TCAP — a test not aligned with our state’s current standards, and thus not an accurate indicator of student mastery or teacher impact.

Governor Haslam and Commissioner McQueen have announced that teachers and students alike won’t be held accountable for test results this year, but what about just taking the year off and getting it right?

For more on education politics and policy in Tennessee, follow @TNEdReport

Is Jeb! TNReady?

Ok, we all know Jeb! already suspended his campaign, but he’ll still be on the ballot in Tennessee.

But, Charles Corra is comparing the TNReady rollout to the Jeb! campaign over at his blog:

The current TNReady debacle is much like Jeb! Bush’s campaign for President:  It was looked at as an inevitable success, generated a LOT of money in support of it, ended up crashing and burning, and ultimately took way too long to pull the plug.

Corra concludes:

Our teachers, students, and families deserve better.  If students are going to be tested with a rigorous, common core-aligned exam, then at least get the mechanics of the exam figured out beforehand.

For more on education politics and policy in Tennessee, follow @TNEdReport

Ready to Waive

Governor Bill Haslam and Commissioner of Education Candice McQueen announced today that in light of difficulties with the administration of the TNReady test, they are proposing that TNReady data NOT be included in this year’s round of teacher evaluations.

The statement comes after the Knox County Board of Education made a similar request by way of resolution in December. That resolution was followed by a statewide call for a waiver by a coalition of education advocacy groups. More recently, principals in Hamilton County weighed in on the issue.

Here’s Governor Haslam’s press release on the waiver:
Tennessee Gov. Bill Haslam today announced he would seek additional flexibility for teachers as the state continues its transition to the TNReady student assessment.

Under the proposal, teachers would have the choice to include or not to include student results from the 2015-2016 TNReady assessment in his or her evaluation score, which typically consists of multiple years of data. The proposal keeps student learning and accountability as factors in an educator’s evaluation while giving teachers the option to include this year’s results if the results benefit them. The governor will work with the General Assembly on specific language and a plan to move the proposal through the legislative process.

“Tennessee students are showing historic progress. The state made adjustments to teacher evaluation and accountability last year to account for the transition to an improved assessment fully aligned with Tennessee standards, which we know has involved a tremendous amount of work on the part of our educators,” Haslam said. “Given recent, unexpected changes in the administration of the new assessment, we want to provide teachers with additional flexibility for this first year’s data.”

Tennessee has led the nation with a teacher evaluation model that has played a vital role in the state’s unprecedented progress in education. Tennessee students are the fastest improving students in the country since 2011. The state’s graduation rate has increased three years in a row, standing at 88 percent. Since 2011, 131,000 more students are on grade-level in math and nearly 60,000 more on grade-level in science.  The plan builds upon the Teaching Evaluation Enhancement Act proposed by the governor and approved by the General Assembly last year. This year is the first administration of TNReady, which is fully aligned with the state’s college and career readiness benchmarks.

“Providing teachers with the flexibility to exclude first-year TNReady data from their growth score over the course of this transition will both directly address many concerns we have heard and strengthen our partnership with educators while we move forward with a new assessment,” Department of Education Commissioner Candice McQueen said. “Regardless of the test medium, TNReady will measure skills that the real world will require of our students.”

Most educator evaluations have three main components: qualitative data, which includes principal observations and always counts for at least half of an educator’s evaluation; a student achievement measure that the educator chooses; and a student growth score, which usually comprises 35 percent of the overall evaluation

 

While the release mentions last year’s changes to teacher evaluation to account for TNReady, it fails to note the validity problems created by an evaluation system moving from a multiple choice (TCAP) to a constructed-response test (TNReady).

Here’s the Tennessee Education Association on the announcement:

“TEA applauds Gov. Haslam on his proposal to give teachers the flexibility to not use TNReady test data in their 2015-16 evaluations. It is encouraging to see the governor listen to the widespread calls from educators, parents and local school boards for a one-year moratorium for TNReady data in teacher evaluations.”

 

“It is important that schools are given the same leniency as students and teachers during the transition to TNReady. These test scores that Gov. Haslam is acknowledging are too unreliable for use in teacher evaluations, are the same scores that can place a school on the priority list and make it eligible for state takeover. All high-stakes decisions tied to TNReady test data need to be waived for the 2015-16 school year.”

 

“While the governor’s proposal is a step in the right direction toward decoupling standardized test scores with high-stakes decisions, these measurements have proven to be unreliable statistical estimates that are inappropriate for use in teacher evaluations at all. TEA will continue its push to eliminate all standardized test scores from annual teacher evaluations.”

For more on education politics and policy in Tennessee, follow @TNEdReport

Back to the Future

After yesterday’s opening day fiasco with the new TNReady test, Commissioner Candice McQueen announced that all TNReady tests for this year will now shift to paper and pencil tests and a new testing window will be created. No testing will happen before February 22nd.

Here’s the letter Commissioner McQueen sent to Directors of Schools about the shift:

Thank you for your patience as we faced technical challenges with the MIST platform this morning. At 8:25 a.m. CST the state’s vendor for TNReady, Measurement Incorporated, experienced a severe network outage, causing significant problems with the MIST platform. Like you, we are incredibly disappointed that the MIST platform was not accessible to schools across the state as the Part I testing window opened.

 

Shortly after learning about the issue, we advised that schools experiencing problems with the test discontinue testing, and return to their normal classes.

 

Throughout the 2015-16 school year, the department has continuously worked with Measurement Incorporated to strengthen the online testing platform. As a result of district feedback and through our efforts to collaborate, we have mitigated and eliminated many technical issues. The online platform has undergone many capacity tests, yielding actionable information to drive improvements. Following Break MIST Day last October, we’ve made significant investments in server capacity. As a follow up to our Jan. 12 capacity test, the department’s technology team also spent multiple weeks in the field visiting select districts around the state to reproduce system errors in a real-world, real-time situation to gather better diagnostic information. As a result of this continued analysis, we offered districts the option to move to paper testing as we saw continuing issues with how the platform interacted with districts’ infrastructure.

 

Unfortunately, issues have continued to arise with the online platform. The new nature of the issue this morning has highlighted the uncertainly around the stability of Measurement Inc.’s testing platform, MIST. Despite the many improvements the department has helped to make to the system in recent months and based on the events of this morning, we are not confident in the system’s ability to perform consistently. In the best interest of our students and to protect instructional time, we cannot continue with Measurement Incoporated’s online testing platform in its current state. Moving forward, during the 2015-16 school year TNReady will be administered via paper and pencil (both Part I and Part II).

 

We thank districts, schools, and teachers for their commitment and perseverance to move our students to a 21st century learning environment. We know this is what the real world requires. We understand and appreciate the investment of time, money, and effort it has taken to attain readiness.

 

As a result of a statewide shift to paper and pencil, we will delay and extend the Part I testing window. Measurement Incorporated is currently scheduling the printing and shipping of the paper tests, and the department will share the revised testing window with districts by Thursday of this week. We understand that the shift to paper and pencil testing has many scheduling implications for your schools, teachers, and students. We thank you for your patience and cooperation as we transition to a test medium that we are confident will allow all students to show what they know.

 

TNReady is designed to assess true student understanding and problem-solving abilities, not just basic memorization skills. Regardless of the medium of assessment, this new and improved test will provide schools, teachers, and parents with valuable information about our students college and career readiness.

 

Warning Signs

Prior to Monday’s scheduled test administration, some educators across the state were raising concerns about the testing system and its ability to handle the load of student all across the state.

Amanda Haggard reports:

In a letter sent to the Tennessee Department of Education Commissioner Candice McQueen on Jan. 31, RePublic CEO Ravi Gupta outlines exactly what happened when the school made its attempt at the test. From the letter:

Our experience on January 28, however, raised substantial concerns about the technical capacity of MIST [Measurement Incorporated Secure Testing platform] to support state-wide testing. RePublic has only 1,200 kids — a tiny fraction of the State’s 500,000. On January 28, we attempted to administer the Math practice test on MIST as a step toward preparing kids for the first round of state exams. More than half of our kids were unable to log on, were kicked off the platform after logging on, or could not submit a completed test. The critical issue, confirmed by MIST representatives, was an error or series of errors on MIST’s own servers.

Haggard goes on to detail other concerns raised ahead of Monday’s test administration.

A Call for a Pause

In response to the challenges presented by the TNReady test administration, some legislators are now calling for a pause on test-based accountability for students, teachers, and schools. The tests would still be administered, and results reported, but they would not impact student grades, teacher evaluations, or the state’s priority schools list.

What Happens Now?

The state now has asked its vendor, Measurement, Inc. to provide paper and pencil tests. These will not start before February 22nd. Districts and schools will have to reschedule testing based on the availability of tests and guidance from the Department of Education.

Now that the tests have shifted to pencil and paper, some are asking how they will be graded. Human graders were always a part of the equation due to the constructed-response nature of the tests, but they will now be assessing handwritten responses.

A Pattern?

This is the third consecutive year the state has had problems with its testing regimen. In 2014, quick scores were not ready in time to be factored into student grades. Last year, there was a change in quick score calculation that was not clearly communicated to districts and which resulted in confusion when results were posted.

 

For more on education politics and policy in Tennessee, follow @TNEdReport

 

 

(NOT) Ready on Day One

It’s campaign season and candidate after candidate is telling voters they are the clear choice because they will be “ready on day one.”

Likewise, it’s the beginning of statewide testing season in Tennessee and districts have been told the state’s new system would be ready on day one.

Except it wasn’t.

Brian Wilson at the Murfreesboro Daily News Journal reports:

A technology failure from a state vendor halted standardized testing across Tennessee on the first day that TNReady, the state’s new online exam program, was set to be administered on a widespread basis.

The state’s testing platform “experienced major outages across the state” Monday morning because of network issues with Measurement, Inc., who is contracted to administer the standardized exams, according to a memo Commissioner of Education Candice McQueen sent to schools directors across the state.

Don’t call us, we’ll call you …

As problems began this morning, the Department of Education sent the following notice to school districts:

At 8:25 a.m. CST the MIST platform experienced major outages across the state. These outages were caused because the network utilized by Measurement Inc. experienced a failure. We are urgently working with Measurement Inc. to identify the causes and correct the problem. At this time, we are advising that schools experiencing problems with the test discontinue testing, and return to their normal classes. Please do not begin any new additional testing you had planned for today until the department provides further information. However, if you have students that are successfully testing, please allow them to complete the current session.

Note, this problem affects both the MICA and MIST platforms. 

The MIST Help Desk is aware of the problem and will be not accepting additional phone calls on this issue. Please encourage your technology directors to call the department’s TNReady Focus Room.

We will provide frequent updates as information becomes available. Thank you for your patience.

It’s not clear how today’s delay will impact testing schedules across the state or whether the TNReady platforms will be ready tomorrow.

Williamson County Schools had already pushed the start of their TNReady testing back to Wednesday as a precaution against the sort of testing glitches that occurred today.

A Call for Fairness

The Tennessee Education Association issued a statement from their President, Barbara Gray, calling for fair treatment of teachers in light of the TNReady problems:

TEA has long had concerns about this transition to a statewide online  assessment. We have seen problems with pilot assessments and practice tests in the past, and unfortunately the first day of TNReady resulted in more issues and frustrations for our students and teachers.

 

Leading up to today’s testing, we have heard from educators and parents statewide about concerns with the state’s capacity to handle so many students on the server at one time, as well as concerns about local districts having enough resources to complete the testing with so little funding from the state.

 

It is unacceptable to have this kind of statewide failure when the state has tied so many high-stakes decisions to  the results of this assessment. Our students and teachers have enough stress and anxiety around these assessments without adding additional worries about technical issues.

 

The state must grant a one-year waiver – at a minimum – from including TNReady scores in teacher evaluations. It is unfair and inappropriate to stake our teachers’ professional standing on flawed, unreliable test scores in any year, but there are even greater implications and uncertainty while implementing a new assessment.

School Boards Expressing Concern

Ahead of the TNReady tests, several school boards have expressed concern about the use of the results in teacher evaluations this year.

MNPS and Knox County are among those asking the state to waive the results this year.

No word on whether state officials are still perplexed about why teachers are wary having TNReady count toward this year’s evaluations.

Again, it’s not clear when we’ll actually be TNReady, just that it wasn’t on day one.

For more on education politics and policy in Tennessee, follow @TNEdReport

 

TC Weber’s Voucher Party

TC Weber has something to say to school voucher proponents.  And it sounds like he wants them to throw a party.

Just look at his opening:

Dear True Believers,

Y’all got to be excited! Here you sit on the cusp of making history in Tennessee, despite a few pesky parents, educators, newspaper columnists, members of the Tennessee County Commissioners Association, school board members, students, and community members, who can’t appreciate all you do, by this time next week, you’ll be celebrating Tennessee joining the forward-thinking states who have provided a pathway out  for all those trapped kids in failing schools. Never mind that vouchers have never worked anywhere else, we all know Tennessee is different. So ignore the haters, this has been a long time coming, and Lord knows, you’ve worked hard for it and deserve it.

He continues in a fashion that would be hilarious if it didn’t contain so many stubborn facts.

Read on>

More on vouchers:

Million Dollar Baby

What TN Can Learn from Louisiana on Vouchers

The Price is Right

Voucher Week

For more on education politics and policy in Tennessee, follow @TNEdReport