TEA on TNReady

The Tennessee Education Association has a statement out on the TNReady debacle:

TEA and its members are extremely disappointed with the failures and delays of the state online assessment system, TNReady. TEA is calling for a full and accurate accounting of the problems and how they affect students, along with proof that the system is secure and fair to Tennessee’s parents and teachers. The association is calling on lawmakers to hold students, teachers and schools harmless in light of the failures and growing concerns of the state testing system.

TEA is pleased the House and Senate are holding an immediate hearing on the testing issue.

“Students and teachers across the state are told these are high-stakes tests. Teachers’ jobs are on the line, students’ futures are on the line,” said TEA President Barbara Gray. “That is the environment put upon every parent, every child, and every educator with TNReady. Now the test has been offline for two days, damaging the integrity of Tennessee testing.”

In some districts, students were able to log in, but the system would not allow them to submit finished exams. Some students were disrupted mid-exam. The State Department of Education has indicated completed work was saved on the local device students were using, but teachers and administrators must remember and document which student used which computer. It is unclear how much student assessment work was saved or lost during the failure of the online system over the past two days.

“Student morale is a key component of how well a student does on a test. Losing work, being disrupted mid-exam, and constant delays affect students negatively. We are concerned this will impact scores to the detriment of students, teachers and schools,” Gray said. “We are approaching a point where the entire testing system is becoming questionable. Students who start and stop exams may suffer emotionally or become distrustful, which may hurt concentration.”

Parents’ concerns are also growing. While the state says there is no evidence that student data or information has been compromised when the vendor said their system was hacked, there have been no guarantees the testing program protected student information.

“Many teachers are also parents, and when we hear the online testing system has been deliberately hacked, we fear for our children’s personal information,” Gray said.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

TNReady Groundhog Day

It’s Day Two of statewide TNReady testing and despite reassurances following yesterday’s disaster, districts across the state are reporting problems and suspending testing.

Nashvillle, Williamson County, Wilson County, Rutherford County, Sumner County, and Chester County have all reported problems. Students are having difficulty logging on in some cases and in others, students complete an entire test but are unable to submit.

Yesterday, Commissioner of Education Candice McQueen said:

“We understand many of you suspended testing today, and we apologize for the unanticipated scheduling changes this issue may have caused,” she said in an email dispatched to district administrators. “…We feel good going into testing tomorrow.”

No, you don’t understand. No, you’re not sorry. This keeps happening. Year after year. Kids went to school yesterday ready to “test like a champion,” and then, nothing happened.

Kids went back today ready to “try again,” and nothing happened.

Word is, Commissioner McQueen is conferencing with districts now. Unless she’s saying we are going to end testing this year and that she’s resigning, I’m not sure how comforting her words can be.

Here’s a tip for Directors of Schools: Don’t believe what she tells you. There’s a clear and disastrous track record when it comes to McQueen and testing.

UPDATE: 10:32 AM

The Department of Education reports the issue is statewide and has issued this statement:

 

UPDATE: Haywood County Director calls on state to immediately suspend all TNReady testing this year>

has suspended testing AGAIN! We need our leadership to step up & suspend testing statewide. It is a statewide issue. Schools, teachers, & students will all be evaluated based on state assessment. Press pause , please!

UPDATE: 3:05 PM Arlington Schools “concerned”

As many of you are aware, TNReady online testing has been severely impacted across the state. The state required grades 9-12 to test online while it remained optional for grades 5-8. We opted out of online testing where available, therefore, grades 2-8 have not been impacted.

With this being the inaugural year of online testing for all high schools, we anticipated the potential for difficulties in the statewide implementation, so we did not schedule online tests to begin until Wednesday for safe measure.

At the time of this release, the Tennessee Department of Education has resumed all testing. We are scheduled to begin online testing at the high school tomorrow and are continuing to get updates from the TDOE. We will proceed according to those updates.

However, we are deeply concerned what impact this may have on our teachers and students and are currently monitoring that impact with other districts across the state.

We’ll update you as more information becomes available.

UPDATE: 3:09 PM – Williamson County Suspends Until Thursday

Only third and fourth grade students taking the paper TNReady tests will continue testing Wednesday. All online testing has been postponed. A decision regarding online testing will be made Wednesday afternoon. WCS hopes to resume online testing on Thursday.

UPDATE: 3:15 PM — TNDOE Says Everything Will be OK Tomorrow:

UPDATE: Lamberth legislation – 

Today I filed an amendment to end computerized testing in Tennessee and return to paper tests. For four years this system has failed our hard working students, teachers and parents and I’m finished with it. The amendment will be heard this afternoon on the House floor. — State Rep. William Lamberth of Sumner County

Stay tuned as more develops with this story.

 

Your support makes it possible to keep covering education news in Tennessee.

Understatement

Today was to be the first day of the second attempt at large scale statewide online testing (TNReady) after the first attempt failed miserably two years ago.

Despite assurances from the Department of Education and new testing vendor (with a $100 million+ contract) Questar, the morning did NOT go smoothly.

Now, however, the TNDOE suggests everything is fine and tomorrow will be better.

Chalkbeat reports:

By the end of the school day, Tennessee Education Commissioner Candice McQueen was looking ahead to the next day.

“We understand many of you suspended testing today, and we apologize for the unanticipated scheduling changes this issue may have caused,” she said in an email dispatched to district administrators. “…We feel good going into testing tomorrow.”

But the opening-day episode renewed mass frustration in a state that is no stranger to online testing glitches. Two years ago, technical snafus derailed a wholesale switch to testing on digital devices, prompting McQueen to fire the state’s testing company and cancel TNReady for grades 3-8.

Frustration is an understatement. We’ve had four consecutive years with some TNReady problem. This marks year five. I wrote in October:

Let’s start from the beginning. Which was supposed to be 2016. Except it didn’t happen. And then it kept not happening. For full disclosure, I have a child who was in 4th grade at the time of what was to be the inaugural year of TNReady. The frustration of watching her prepare for a week of testing only to be told it would happen later and then later and then maybe never was infuriating. That adults at decision-making levels think it is just fine to treat students that way is telling. It also says something that when some adults try to stand up for their students, they are smacked down by our Commissioner of Education.

My daughter is now in 6th grade. Here we go again. She expressed some mild test anxiety over the weekend and was not exactly excited about TNReady today. Nothing to be worried about, though, unless there’s some problem with the test again.

BAM! Today starts and there’s a testing problem and the school day and overall testing schedule gets rearranged.

Here’s the good news: In math, my daughter did a hands-on project to better understand and demonstrate geometry concepts. When she went to science, the class worked in groups to create a board game.

She was excited to tell me about the work she’d done when I picked her up today. Excited! Parents of a child who is almost 12 can relate: When you pick up your kid and they are fired up (in a good way) about what happened at school, that’s huge.

My question: Why can’t she spend the rest of this week doing hands-on projects to demonstrate what she’s learned this year? Some form of project-based assessment would be far superior to the annual headache that TNReady has become.

Instead, the state says it’s all fine and things will resume as normal later in the week.

I’m sorry, but normal the last five years has been nothing short of a disaster.

It’s time for something new. The apologies and reassurances only work for so long. Will my child complete her Tennessee public school education experience with a successfully administered TNReady test that includes returning results in a timely fashion? The track record suggests the answer is NO.

So, kids out there, get ready to go back to the testing this week. Adults in our state think this is what’s best for you. Or, for them. Or, they just can’t admit they were wrong.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

BREAKING: TNReady NOT Ready…AGAIN (UPDATE)

Reports from school districts across Tennessee indicate that the state’s online TNReady platform is failing. This despite promises from the Tennessee Department of Education that all would go smoothly this week.

Update: 11:18 — Message from the TN Department of Education:

We share the frustration that earlier today some students had issues logging into Nextera to take TNReady. This issue has been resolved, and more than 25,000 students have now successfully completed TNReady exams. Testing has resumed across the state and thousands of students are on the platform now without any challenges. No server has crashed, and this issue was not due to volume. Our partners at Questar have worked quickly to resolve the issue.

UPDATE: 11:57 AM — Message from a middle Tennessee school principal:

Teachers and staff I know it is difficult to accept another apparent fiasco with school wide testing. I appreciate your patience but I do understand the frustration with the testing platform. We will discontinue standardized testing until we can get confirmation that the testing platform is operational without mishaps for students trying to take the EOC assessments. My understanding is the problem lies with the vendor, Quesstar  and not with MNPS IT connectivity or bandwidth. The school will turn in submit an irregularity form for the entire English I subpart I. I do not have an answer on the remaining subparts of English I EOC. I will keep you informed as new information is relayed for the office of research and accountability. Please keep the EOC packet that you received last week, modifications to the testing schedule will be made as soon as guidance from the central office is made available.

And a note from a high school teacher:

I teach 10th grade English, and even though I’ve told my students we’ve been assured by the state of TN that this year’s tests will work they log on, they are skeptical. And now on our first day of testing – our 9th graders attempted to take the writing portion of the English test today – many of our students weren’t successful. So my 10th graders, who are supposed to test tomorrow, are wondering what the point is. They don’t have any faith in the system.

UPDATE 12:34 PM: Wilson County Schools suspended testing in grades 6-12 today and there’s this statement from Williamson County:

Williamson County Schools 12:25 email:

“The Tennessee Department of Education experienced some difficulties across the State with online TNReady grades 5-11 testing that began today. WCS students who were able to access the system completed the test, but most could not access their tests. At this point, we have not yet received an explanation as to why some students could access the system while others could not. WCS will attempt to test again tomorrow. Third and fourth graders took TNReady on paper and were not affected.

Carol Birdsong
Communications Director”

UPDATE: 4:02 PM — Coffee County resumed testing after lunch with no problems.

UPDATE: 4:15 PM — Cheatham County Schools: TNReady testing kicked off today. There were some glitches this morning with the state testing platform. The state corrected the issues & we were able to test successfully this afternoon. The district anticipates that all will go well on Tuesday.

Stay tuned as this story develops.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

Danger Ahead?

As Tennessee prepares to test more students than ever via an online platform, there are some signs of potential trouble.

Chalkbeat reports:

State officials said Thursday they are confident the new digital platform will work under heavy traffic, even as their new testing vendor, Questar, had headaches administering computer-based tests in New York on Wednesday. Some students there struggled to log on and submit their exam responses — issues that Questar leaders blamed on a separate company providing the computer infrastructure that hosts the tests.

 

Tennessee officials say they are working with Questar to ensure similar problems don’t occur in Tennessee. They also point out our online testing infrastructure is different and that Questar will have troubleshooting staff in the state during the test administration.

Here’s the problem: Across multiple testing vendors and dating back to TCAP, Tennessee has had problems with testing. This includes the now perennial issue of not being able to deliver scores back to districts in a timely manner. In fact, in December, districts were told scores might not be back in a timely fashion this year, either.

It’s possible the state and Questar have all the issues worked out and this year’s test administration will be nearly flawless. However, the record over the past few years is not encouraging.

Then, there’s the issue of what happens with the results. If they are available for factoring into student scores, it is up to districts to choose the method. I’ve written before about why that’s problematic. Here’s a quick summary:

The cube root method yielded on average a quick score, the score that goes for a grade, of 4.46 points higher. In other words, a studentscoring basic with a raw score of 30 or higher would, on average, receive an extra 4.46% on their final quick score grade, which goes on their report card. A student who scored a 70 last year could expect to receive a 74 under the new quick score calculation.

The additional points do drop as one goes up the raw score scale, however. For the average basic student grades 3-8 with a raw score between 30 and 47, they would receive an extra 5.41 extra points under the new method.

The average proficient student grades 3-8 with a raw score between 48 and 60 would get 4.32 extra points under the new method.

The average advanced student grades 3-8 with a raw score of between 61 and 67 would receive an extra 1.97 extra points under the new method.

The difference varies much more widely for below basic students, but the difference can be as much as 25 points in some cases.

So, for those districts using quick scores in report cards, there could be a wide variance across districts depending on the method chosen. It seems to me, districts should have already communicated to families how they will calculate quick scores with some justification for that choice. Alternatively, the state could have (should have?) mandated a method so that there is score consistency across the state.

Then, of course, there’s the issue of using these scores in teacher evaluation. Let’s say testing goes well this year. This would be the first year of a test without problems. If that happens, this should serve as the baseline for any test-based teacher evaluation. Yes, I think using value-added scores is a misguided approach, but if Tennessee is going to go this route, the state ought to take steps to ensure the data is as accurate as possible. That would require at least three years of successful test administration. So far, we have zero.

If TNReady is a great test that has the potential to offer us useful insight into student learning, it’s worth taking the time to get it right. So far, it seems Tennessee has yet to learn the lesson of the NAEP outlier — we don’t need rapid acceleration, we need to be patient, take our time, and focus.

 

For more on education politics and policy in Tennessee, follow @TNEdReport


 

Outlier

Statisticians define an outlier as an observation point that is distant from other observations in a statistical analysis. Often, this occurs by chance. Additional modeling or deeper analysis (including more data, for example, or a longer range of data) can often correct for this. Outliers that are not the result of measurement error are often excluded from analysis about a data set.

Today, the 2017 results from the National Assessment of Educational Progress (NAEP) were released. This release made me think of a particular outlier.

Back in 2013, Tennessee demonstrated what some heralded as an incredible achievement on the NAEP. In fact, a press release from Governor Haslam at the time noted:

Gov. Bill Haslam today announced that Tennessee had the largest academic growth on the 2013 National Assessment of Educational Progress (NAEP) of any state, making Tennessee the fastest improving state in the nation. (emphasis added)

Those words — “fastest improving state in the nation” — have been uttered by Haslam and many political leaders in our state for years now. Often, this 2013 “success” is used as justification for “keeping our foot on the gas” and continuing an aggressive agenda of test-based accountability and teacher evaluation based on methods lacking validity.

Here’s what I wrote back in 2013 when these results were released:

Yes, Tennessee should celebrate its growth.  But policymakers should use caution when seeing the results from the last 2 years as a validation of any particular policy.  Long-term trends indicate that big gains are usually followed by steady maintenance. And, even with the improvement, Tennessee has a long way to go to be competitive with our peers. Additionally, education leaders should be concerned about the troubling widening of the rich/poor achievement gap  – an outcome at odds with stated policy goals and the fundamental principle of equal opportunity.

Two years later, when the 2015 results were released, I noted:

This year’s scores, in which Tennessee remained steady relative to the 2013 scores suggest, if anything, that the 2013 jump was likely an outlier. Had the 2013 gains been followed by gains in 2015 and again in 2017, more could be suggested. And frankly, it is my hope that we see gains (especially in reading) in 2017. But, it’s problematic to suggest that any specific reform or set of reforms caused the one-time jump we saw in 2013. Saying we are the fastest improving state in the nation over the last 4 years when we only saw a jump in 2013 is like saying we started the first quarter of a football game way behind, scored a bunch in the second quarter, (so we’re not as far behind), and then scored the same number of points in the third quarter. The result is we’re still behind and still have a long way to go.

Fast forward to today. The leveling off I suggested was likely back in 2013 has happened. In fact, take a look at this chart put out by the Tennessee Department of Education:

First, notice that between 2009 and 2011, Tennessee saw drops in 4th and 8th grade reading and 8th grade math. That helps explain the “big gains” seen in 2013. Next, note that in 4th and 8th grade reading and 4th grade math, our 2017 scores are lower than the 2013 scores. There’s that leveling off I suggested was likely. Finally, note that in 4th and 8th grade reading, the 2017 scores are very close to the 2009 scores. So much for “fastest-improving.”

Tennessee is four points below the national average in both 4th and 8th grade math. When it comes to reading, we are 3 points behind the national average in 4th grade and 5 points behind in 8th grade.

All of this to say: You can’t say you’re the fastest-improving state on NAEP based on one testing cycle. You also shouldn’t make long-term policy decisions based on seemingly fabulous results in one testing cycle. Since 2013, Tennessee has doubled down on reforms with what now appears to be little positive result. Instead, as Rep. Jeremy Faison said recently, our policies are “driving teachers crazy.”

Oh, and that new TNReady test has so far not been very ready.

But what about the good policy coming from this? You know, like Governor Haslam’s plan to make Tennessee the “fastest-improving state in teacher pay?”

About that:

Average teacher salaries in the United States improved by about 4% from the Haslam Promise until this year. Average teacher salaries in Tennessee improved by just under 2% over the same time period. So, since Bill Haslam promised teachers we’d be the fastest improving in teacher pay, we’ve actually been improving at a rate that’s half the national average. No, we’re not the slowest improving state in teacher pay, but we’re also not even improving at the average rate.

Surely, though, all this focus on education since the NAEP buzz has meant meaningful investment in schools, right? Well, no:

Tennessee earns a grade of F when it comes to funding effort compared to funding ability. The researchers looked at Gross State Product and Personal Income data in order to determine a state’s funding ability then looked at dollars spent per $1000 (in either GSP or Personal Income) to determine effort. Tennessee spends $29 on schools for every $1000 generated in Gross State Product. When it comes to Personal Income, Tennessee spends just $33 per $1000 of average personal income. That’s a rank of 42 in both.

Then, the report looks at wage competitiveness — how much teachers earn relative to similarly-educated professionals. I’ve written about this before, and Tennessee typically doesn’t do well in this regard.

Maybe we’ve taken a minute to get serious about investing in programs targeting struggling students? Also, no:

One possible solution would be to embed funding for school-level RTI2 specialists in the state’s funding formula for schools, the BEP. In fact, Rep. Joe Pitts offered legislation that would do just that last year. His plan would have added funding for three RTI2 specialists at each school for a total projected cost of $167 million. Commissioner McQueen was quick to shoot that idea down and came back this year with the funding proposal of $13 million, or one specialist per district. That’s only $154 million short of adopting a plan that would actually meet the needs of a program many suggest is an important way to improve educational outcomes for Tennessee students.

Maybe we are closing achievement gaps? Again, no.

Back in 2013, Tennessee students eligible for free/reduced lunch had an average NAEP reading score of 256 and scored 20 points below the non-eligible students. Now, that average score is 252 (four points worse) and 19 points below. For 4th grade, there’s a similar story, with free/reduced lunch eligible students scoring 25 points below their non-eligible peers this year. Four years ago, it was 26 points.

We’re not moving the needle. Our most vulnerable students continue to be left behind. Meanwhile, we hear nice words from top policymakers and see little actual result in terms of tangible improved investment in schools or any meaningful upgrade in teacher pay. Our testing system has yet to be proven.

Maybe now Tennessee policymakers will stop repeating the “fastest-improving” line and start doing the actual work of investing in and supporting our schools.

In any case, the next time you hear someone spout off that tired “fastest-improving” line, just yell back: OUTLIER!

For more on education politics and policy in Tennessee, follow @TNEdReport


 

McQueen: Do It My Way

Tennessee Education Commissioner Candice McQueen said yesterday that despite a desire to move a struggling Memphis middle school into a proven local turnaround model managed by the district, she is insisting the school be moved into the failing Achievement School District (ASD).

Chalkbeat reports:

Education Commissioner Candice McQueen said Thursday that American Way Middle School must be converted to a charter school in the fall of 2019 under the state’s new accountability plan. If Shelby County Schools doesn’t decide by March 15 to do that on its own, she said, the state will take over the school and move it to Tennessee’s Achievement School District.

While the Shelby County Schools iZone has been lauded for achieving solid results, the state’s ASD hasn’t gotten the job done. In fact, of the original schools taken over by the ASD five years ago, all but one remain in the bottom 5% of all schools in the state. That is, there’s be no significant improvement in performance.

So, why is Candice McQueen hellbent on moving American Way into a failed reform model? The Shelby County School Board has taken corrective action and set the school on a path that has gotten proven results at other schools. Further, McQueen’s chosen intervention is one that’s simply not getting results.

Will lawmakers in Nashville take action to stop this move? So far, efforts to rein-in the ASD have been met with significant resistance. However, the lack of a successful TNReady administration has hampered the ASD’s growth. McQueen says that will no longer be a problem:

The commissioner said the state’s decision to delay school takeover until 2019 is due to delayed test scores from the state. That won’t be the case in the next round of sorting schools into various “improvement tracks” under the state’s new school accountability plan. The state’s next list of its lowest performing schools is scheduled to be released next fall, which will inform decisions for future improvement plans.

Let’s be clear: Candice McQueen has presided over a failed transition to a new test and an aggressive intervention model for struggling schools that has left kids behind. Now, she’s insisting that Shelby County do what she says. Why would anyone trust their district’s students to Candice McQueen’s judgment?

For more on education politics and policy in Tennessee, follow @TNEdReport


 

2018 Gubernatorial Education Forum

Last night, candidates vying to be Tennessee’s next Governor participated in a forum on education held at Belmont University and sponsored by SCORE (Statewide Collaborative on Reforming Education).

Five of the seven candidates attended the event. Mae Beavers had a death in the family and was unable to attend. Congressman Diane Black cited a “scheduling conflict.” That’s typically political speak for not wanting to answer tough questions.

Yes, Black is a Member of Congress and yes, Congress is in session. However, key votes on reopening the government after a brief shutdown had already taken place. Further, Black’s vote would not have been a pivotal one in that process.

Diane Black is asking Tennesseans to trust her to lead the state and she couldn’t be bothered to join a forum and answer direct questions on one of the state’s largest expenditures and a top priority issue for voters.

Now, a roundup of reporting on the candidates who did attend and participate: House Speaker Beth Harwell, House Democratic Leader Craig Fitzhugh, former Nashville Mayor Karl Dean, businessman and former Economic Development Commissioner Randy Boyd, and businessman Bill Lee.

Here’s Chalkbeat’s report, noting a significant amount of agreement among the candidates on a range of issues.

First, teacher pay: 

Every candidate said they want to boost pay for Tennessee teachers on the heels of two years of increased allocations under outgoing Gov. Bill Haslam. Former Nashville Mayor Karl Dean, a Democrat, offered the most direct pledge, calling higher salaries his “No. 1 priority,” while House Speaker Beth Harwell, a Republican from Nashville, gave a more restrained endorsement. “We have now given two back-to-back 4 percent pay increases to our teachers,” Harwell said. “Would I like to do more? Of course. And when the budget allows for that, I will.” On a related note, most candidates said it’s also time to revisit the state’s formula for funding K-12 education.

Plight of the DREAMers:

Republicans said they would not sign legislation that would provide so-called “Dreamers” with the tuition break to attend the state’s higher education institutions, while Democrats said they would. “I’m the only person on this panel who has voted to do that, and I will vote to do that again,” Fitzhugh said of unsuccessful bills in Tennessee’s legislature during recent years. “It is cruel that we do not let these children that have lived in Tennessee all their life have in-state tuition,” he added. Republicans emphasized the letter of the law. “It doesn’t seem fair to me that we would offer something in college tuition to an immigrant that was here illegally that we wouldn’t offer to an American citizen from Georgia,” said Bill Lee, a Republican businessman from Williamson County.

Supporting Public Schools:

Fitzhugh was the only candidate who said that he and all of his children are products of public schools, and that his grandchildren attend public schools as well.

READ MORE from Chalkbeat

The Tennessean has this break down of answers to three key questions:

Pre-K:

Boyd: “We need to find the programs that work well and duplicate those.”

Dean: He would like to see pre-K statewide and “available in all school systems.”

Fitzhugh: “Under Gov. Haslam’s leadership we have moved pre-K where it needs to go and I would like to see it ultimately for every single child.”

Harwell: She cited “mixed results” of existing programs, wants to lean on nurturing high-quality options.

Lee: “Strong pre-K programs move the needle.” He wants to “make certain that the program that we currently have is quality, and we should move on that first.”

Just where was Diane Black?

The Tennessean reports she was in Tennessee, raising money instead of talking with voters about her education policy plans:

Black declined to participate in the forum because of a scheduling conflict. According to an invitation obtained by the USA TODAY NETWORK – Tennessee, she was attending a campaign reception at Southeast Venture, a development firm near 100 Oaks, that cost $250 per couple to attend and included hors d’oeuvres.

While I’m sure the snacks were nice and the haul of campaign cash significant, Tennessee voters surely expect a person running for the state’s top job to join with her opponents in answering relevant questions.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

Are TN Colleges Turning Out Bad Teachers?

You might think Tennessee’s public schools of education are doing a poor job of turning out effective educators if you read this story in yesterday’s Tennessean.

The article notes:

Many of Tennessee’s teacher preparation programs aren’t at the quality the state expects. A number of those underperforming are at state colleges — with none of those schools performing at the highest level.

It’s a “sobering” data point education officials are highlighting as they work toward addressing fixes in Tennessee’s teaching programs.

The article references the redesigned teacher preparation report card produced annually by the Tennessee State Board of Education.

I’ve written before about the problems with this approach.

The revamped report includes candidate profile (who is enrolling in teacher prep programs), retention (whether grads stay in teaching), and “teacher effectiveness” (which is measured primarily by the flawed TVAAS system).

TVAAS scores of graduates account for 25 of the 75 points available to rate teacher prep programs. That means the rating formula is heavily skewed toward an unreliable statistical estimate of performance.

At best, TVAAS is a rough estimate of teacher performance. A fairly solid indicator that a teacher earning a “5” is NOT a “1,” but relatively meaningless otherwise.

Now, of course, Tennessee has transitioned to new tests. TNReady has been fraught with problems, but even if it hadn’t been, the results would render TVAAS data highly suspect. So, 33% — the largest single portion — of the score attributed to teacher prep programs comes from a number that is essentially meaningless. Let me be clear: Schools receiving grades of 4 (the highest) or 1 (the lowest) on this metric are getting numbers that have no basis in statistical reality.

The next area of importance to a program’s score is the profile of the candidates enrolled in their program. Here, the state is looking for high academic achievers and overall diversity.

As noted in the article:

McQueen also has plans for a statewide tour to schools with the purpose of getting high-achieving, young students into the education profession, especially since preparation programs are having trouble getting qualified candidates in the doors.

This is predicated on the assumption that students with higher ACT scores will ultimately become better teachers. Whether or not that’s true, it ignores the underlying reality: Teaching just may not be a very attractive field. That’s not the fault of schools of education and it certainly isn’t their responsibility to fix it.

In fact, Tennessee has been looking at a coming teacher shortage for years now. Districts like MNPS are already seeing the impact.

Why might teaching be unattractive? Well, for one, the pay is not exactly great. In fact, Tennessee teachers earn about 30% less than their similarly prepared peers. Boosting pay may be one way to help make the field more attractive. Alternatively (and much cheaper), the state could send the outgoing Commissioner of Education on a tour of schools to attempt to persuade high achieving students to enter a profession where they can expect to earn significantly less than other professionals and be subjected to a testing and evaluation system that according to some is “driving teachers crazy.”

Another factor? Our state under-funds the BEP (the state’s funding formula for schools) by around $500 million. So, new teachers face low pay, a problematic evaluation system, and under-resourced schools. Is it any wonder teacher prep programs aren’t getting enough qualified applicants?

Nevertheless, teacher prep programs are being held “accountable” for fixing problems over which they have little control. Makes perfect sense.

*NOTE: An earlier version of this story indicated TVAAS accounted for 40 points on the scale. That has been corrected to accurately reflect the 25 points TVAAS scores comprise.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

2018 Legislative Preview

The Tennessee General Assembly is back in session today. Here’s an overview of some education topics that are likely to be considered this year. Of course, more issues always arise, but these issues will most certainly be given attention.

Testing

Senator Bill Ketron has indicated he’s proposing legislation that will place a moratorium on any new testing until the current TNReady tests are successfully administered. Initially, it sounded like his proposal would stop all testing, but Ketron has since clarified that to indicate he wants to see the current test done right before any new tests are added.

Representative Jeremy Faison has proposed separating TNReady test scores from student grades and teacher evaluations. There have been significant problems with getting scores back in a reliable way in order to include them in student grades. Additionally, the apples to oranges comparison of TNReady to the old TCAP tests renders any teacher growth scores essentially meaningless.

Representative Matthew Hill has proposed shifting high school testing from TNReady to the ACT suite of assessments. Hill says there’s too much emphasis on testing and too many hours spent away from instruction.

Combined, these initiatives represent a shift in attitude about TNReady and testing in general that could lead to some changes in how tests impact students and teachers. Decoupling tests from student grades and teacher evaluations would likely have the effect of reducing the influence they have over instructional time.

RTI

Response to Intervention and Instruction (RTI2) has been a state mandate for several years now, but state funding to carry out the program’s demands has not been provided. This has led to some creative (and not terribly effective) implementation strategies. Districts are responding to the mandate to the best of their abilities, but due to lack of financial support, this doesn’t always lead to the best outcome for students.

In her budget presentation to Governor Haslam, Commissioner Candice McQueen indicated she’d propose dedicated funding for RTI in a BEP update. It was not immediately clear how much funding or how it would be integrated into the school funding formula. Rep. Joe Pitts offered a possible option last year, but his proposal was not embraced by the Administration.

It’s encouraging to see this item being discussed. Many districts have used the state’s salary increase funding for teachers to hire RTI teachers — which means lower or no raises for teachers across a district. Providing dedicated RTI funding would allow districts to use state salary funds to boost pay across the board, and that’s good news in a state that pays teachers 30% less than similarly educated professionals.

Teacher Pay

Following up on the RTI discussion as it relates to overall teacher pay, Governor Haslam has proposed and the General Assembly has approved BEP salary fund increases of 4% per year over the past three years. Because of issues like RTI and the general inadequacy of the BEP, teachers haven’t always seen 4% raises. The average, in fact, has been just under 2% per year. Still, Governor Haslam gets some credit for maintaining investment in teacher compensation. Some speculate he’ll go a step further in his last year in office, adding 5% to teacher compensation through the BEP. If this is coupled with a significant investment in RTI, it could mean the largest raise teachers have seen in years. The cost of making this investment would be around $125 million. With revenue continuing to outpace projections, this level of investment is both possible and wise. Tennessee still has a long way to go in terms of improving teacher compensation and support, but these two steps would signal a positive trend.

Vouchers

Both the House and Senate sponsors of voucher legislation have indicated they will not pursue the idea this year. In fact, both have said they want to focus on finding ways to invest in teacher pay and RTI, signaling a level of agreement with Governor Haslam. Last year marked the fifth consecutive year vouchers were defeated. It seems, for now at least, that advocates of using public tax dollars for private schools will wait to fight another day.

For more on education politics and policy in Tennessee, follow @TNEdReport