Why TNReady Wasn’t

Grace Tatter over at Chalkbeat has an informative interview with the President of Measurement Inc., the company charged with delivering TNReady this year.

As I read the interview, a couple of items stood out. First, the company had never delivered an entire state’s online testing program. Tatter notes:

It was also an unprecedented task for Measurement Inc., which had never before developed and delivered a state’s entire online testing program.

Despite this, they somehow won the bid to deliver Tennessee’s program.

Second, the magnitude of the failure. Tatter:

About 48,000 students logged on that day, and about 18,000 submitted assessments. It’s unknown the number of students who weren’t having troubles with the test, but stopped after McQueen sent an email instructing districts to halt testing.

“It was a failure in some respects because we were supposed to design a system that would take 100,000 students in at one time… We had a problem with 48,000,” Scherich said.

Read that again. Measurement Inc. was tasked with developing an online platform that could handle 100,000 students taking a test at the same time. The system they developed couldn’t handle 48,000 students. They didn’t even develop a system that could handle HALF of what they were contracted to provide.

The company president goes on to detail the challenges of printing the tests in a short timeframe. However, back in February, Education Commissioner Candice McQueen expressed confidence in the printed tests:

“I want to stress to you that the paper version of TNReady is still TNReady,” McQueen wrote of the new test aligned to the state’s current Common Core academic standards.

She said the paper tests are being shipped to each district at no additional taxpayer cost.

Unfortunately, it wasn’t. Phase I tests did arrive, albeit quite late. And Phase II tests were not delivered in time to be administered this year.

Now, the state is seeking another vendor who can deliver the test in the 2016-17 academic year.


 

 

For more on education politics and policy in Tennessee, follow @TNEdReport

 

Ready to Refuse

As Tennessee schools prepare for Phase II of TNReady, the Department of Education has sent districts a memo outlining how they should handle students who refuse or attempt to “opt-out” of the test.

The general gist, according to reporting by Grace Tatter, is that you can’t opt-out or refuse. She reports:

District leaders received a memo last week instructing schools to “address student absences on testing days in the same manner as they would address a student’s failure to participate in any other mandatory activity at school (e.g. final exams) by applying the district’s or school’s attendance policies.”

The memo specifically notes:

 “State and federal law also requires student participation in state assessments. In fact, these statutes specifically reference the expectation that all students enrolled in public schools in Tennessee will complete annual assessments.”

That’s not entirely true.

Federal law, even with the newly passed Every Student Succeeds Act (ESSA), requires states to administer annual assessments in grades 3-8 and at least once in high school.

But there’s a difference in requiring a state to administer and requiring a student to complete an assessment. Federal law requires administration of the test, but does not compel students to complete the exams.

Then, there is state law. The memo lacks specific references to Tennessee statute, but there are a few sections that relate to testing.

TCA 49-1-6 includes references to performance assessment and the Tennessee Value-Added Assessment System (TVAAS). This portion of state law says that annual assessments will be administered in grades 3-8 and then outlines the secondary school testing schedule. Here again, the law notes tests will be administered, but contains no compulsory language for students.

Then there’s TCA 49-6-60 dealing with proficiency testing. This section specifically details testing to be administered in grades 8, 10, and 11 as a strategy to promote college readiness. As these three tests are required for graduation, they are essentially mandated. Students who don’t take them won’t complete the graduation requirements.

What’s missing? Language that compels a student to take the test or requires a district to compel students to take the test. The memo says that “state and federal” statutes specifically reference the expectation that students will complete the assessment. True, TVAAS and other accountability measures are made valid by significant student participation in state tests. But, that alone doesn’t make them compulsory. Unless it’s one of the three proficiency tests specifically referenced in the graduation requirements section, there’s no language directly compelling students to participate in annual assessments.

It’s worth noting that while the Department of Education has said there would be penalties if districts refused to administer the TNReady tests, the memo says districts are not authorized to allow “opting-out” or test refusal. What it doesn’t say is what impact allowing opt-out would have on the district. If a district offers the test, and students refuse, then what?

Stay tuned as Phase II starts later this month.

For more on education politics and policy in Tennessee, follow @TNEdReport

 

 

A Little Less Ready

Grace Tatter reports on proposed reductions to the total testing time for TNReady:

After weeks of hard conversations prompted by the rocky debut of Tennessee’s new assessment, Education Commissioner Candice McQueen said Monday that the state will reduce the number of hours that students spend taking TNReady in its second year.

Beginning in 2016-17, the State Department of Education plans to scrap TNReady Part I in math and streamline the English portion of Part I, she said. Department officials will determine how many hours of testing the changes will save students in the coming weeks.

On average, third-graders this year will have spent 11.2 hours taking TNReady end-of-course tests; seventh-graders, 11.7 hours; and high school students, 12.3 hours.

The announcement comes amid concerns expressed by parents and district leaders and at least one district inquiring about the possibility of not administering TNReady Phase II this year.

Tullahoma’s Dan Lawson said:

“Outside of RTI-squared and TNReady, we don’t have time to do anything,” Lawson said. “We’re trying to have class on occasion.”

For more on education politics and policy in the volunteer state, follow @TNEdReport

Phase II Ready

Now that the troublesome Phase I of TNReady is over, districts in coming weeks will move to TNReady Phase II.

Grace Tatter over at Chalkbeat has more on what Phase II means for students and schools:

The second part of TNReady features mainly multiple-choice questions (although, unlike in years past, students sometimes will be able to select several choices.) It has about 60 questions each for math and English, split up over two days. When the test originally was to be administered online, Part II also was supposed to include interactive questions in which students could use drag-and-drop tools, but those won’t be possible on the paper version.

So, multiple choice, no interactive questions, and shorter testing times for this phase.

It’s worth noting that the test is in two phases and includes significantly more total testing time than was common in years past — up to 11 hours.

Also, at least one district is seriously discussing the option of not administering Phase II at all in light of all the disruption caused by the false start on Phase I.

What do you think? Is 11 hours of testing too much for the youngest students? Should Tennessee districts skip Phase II this year and focus on instruction instead of test prep?

For more on education politics and policy in Tennessee, follow @TNEdReport

 

The Biggest Losers

Grace Tatter over at Chalkbeat has a breakdown of Governor Haslam’s BEP changes. While this year’s budget includes an influx of dollars, it also freezes BEP 2.0.

Tatter explains:

Though the governor’s plan nixes BEP 2.0, it permanently increases the state’s spending on English language learners (funding ELL teachers at a 1:20 student ratio and translators at a 1:200 student ratio), and special education students, technology and teacher pay, especially when it comes to teachers insurance. For years, the state only paid for teachers to have 10 months of health insurance. Last year, the General Assembly mandated that the state provide for 11 months of insurance. Haslam’s proposal this year finally gives teachers’ year-round insurance.

It’s important to note here that districts are already paying for year-round insurance for teachers, now they will receive some funding for it. The state funds teacher insurance at 45% of the projected cost for a district’s BEP-generated teaching positions. Until last year, it funded 45% of this cost for only 10 months, now it will shift to 12 months. It’s also worth noting that every single district in the state hires teachers beyond the BEP-generated number. Typically, around 12-15% more than what the BEP formula generates. Districts cover the full cost of salary and insurance for all teachers hired beyond the BEP number.

If districts only hired the BEP number of teachers, they could reduce local costs, but they’d also likely have some pretty unhappy parents on their hands. So, yes, the Governor’s proposed changes do direct additional funds to districts. But the changes do not address the underlying problem with the BEP. Doing so would cost another $250 to $300 million. That would be the cost of adjusting the ratios by 10-15% for teachers. That’s not to mention nurses, counselors, and other positions. And it doesn’t include capital funding.

The BEP Review Committee has been highlighting these deficiencies for years to no avail.

Additionally, Tatter mentions:

Another carryover from BEP 2.0 is the eventual elimination of a “cost differential factor,” known as CDF, that 16 districts in five counties receive to address a higher cost of living. Reducing the CDF would cut state spending by about $34.7 million. Almost half of that money would have gone to Shelby County Schools and the municipal districts in Shelby County. Other counties that would be impacted are Davidson, Anderson, Williamson and Sullivan.

While BEP 2.0 envisioned elimination of the CDF, it also envisioned the state covering 75% of teacher salaries for BEP-generated teachers. The Haslam changes makes the current 70% permanent.

Here are the districts losing money under the CDF elimination. The CDF is cut in half for the upcoming year and then completely eliminated in 2017-18.

Shelby
             30,873,136
Davidson
             17,570,727
Williamson
             11,073,924
Bartlett
                2,111,966
Collierville
                2,007,525
Germantown
                1,411,972
Franklin SSD
                1,260,978
Arlington
                1,169,503
Millington
                   672,030
Anderson
                   473,867
Oak Ridge
                   320,368
Lakeland
                   243,331
Sullivan
                      78,161
Clinton City
                      72,903
Kingsport
                      54,638
Bristol City
                      30,682
Total
69,425,713

It’s not clear whether these changes will impact the current lawsuits regarding funding adequacy. And the additional funds still don’t address the unfunded RTI mandate.

The ultimate impact of the changes will take a few years to determine. However, without significant structural changes, it is difficult to see this “new BEP” adequately meeting the needs of Tennessee’s schools.

More on the BEP:

Bill Dunn Wrong

They Noticed

Clay County and the Broken BEP

Why is TN 40th?

About BEP 2.0

For more on education politics and policy in Tennessee, follow @TNEdReport

As Flexible as a Brick Wall

Grace Tatter reports that officials at the Tennessee Department of Education are “perplexed” by concerns over using TNReady data in this year’s teacher evaluations.

While a number of districts have passed resolutions asking for a waiver from including TVAAS scores in this year’s teacher evaluations due to the transition to TNReady, a department spokesperson said:

“Districts have complete discretion to choose how they want to factor that data,” Ball said Thursday. “They don’t have to use TNReady or growth data in hiring, firing, retention or promotion.”

As Tatter’s story notes, however, data from TNReady will still be a part of a teacher’s TVAAS score — 10%. And that score becomes a part of a teacher’s overall evaluation score — a ranking from 1-5 that purports to measure a teacher’s relative effectiveness.

10% is enough to move a ranking up or down a number, and that can have significant impacts on a teacher’s career, even if they are not fired and their pay is not impacted. Of course, some districts may use this year’s data for those purposes, since it is not prohibited under the evaluation changes passed last year.

Dan Lawson outlines some of the of impact faced by teachers based on that final number:

The statutorily revised “new tenure” requires five years of service (probationary period) as well as an overall score of “4” or “5” for two consecutive years preceding the recommendation to the Board of Education. Last year, no social studies assessment score was provided since it was a field tested and the teacher was compelled to select a school wide measure of growth.  He chose POORLY and his observation score of a “4.38” paired with a school wide growth score in the selected area of a “2” producing a sum teacher score of “3” thereby making him ineligible for tenure nomination.

According to TCA 49-5-503, a teacher may not be awarded tenure unless she achieves a TEAM score of 4 or 5 in two consecutive years immediately prior to being tenure eligible. That means a TVAAS score that takes a teacher from a 4 to a 3 would render her ineligible.

Further, a tenured teacher who receives a TEAM score of a 1 or 2 in two consecutive years is returned to probationary status (TCA 49-5-504). So, that tenured teacher who was a 2 last year could be impacted by a TNReady-based TVAAS score that moves a TEAM score of a 3 down to a 2.

Districts don’t have “complete discretion” to waive state law as TNDOE spokesperson Ashley Ball seems to imply.

Further, basing any part of a teacher’s evaluation on TVAAS scores based on TNReady creates problems with validity. Why include a number in a teacher’s evaluation that is fundamentally invalid?

Teachers want an evaluation process that is fair and transparent. There’s nothing perplexing about that.

For more on education politics and policy in Tennessee, follow @TNEdReport

RTI Rollout Rushed?

Grace Tatter over at Chalkbeat has a story about Tennessee’s RTI2 program implementation in which she notes that the program’s mandates have come largely unfunded by the State of Tennessee.

The Response to Intervention and Instruction program is designed to identify students who are struggling and get them extra assistance before they fall too far behind.

In practice, the program means many students miss related arts or even social studies and science in order to spend extra time in remediation for math and reading, the two subjects tested on the state’s TCAP test.

Additionally, many districts report they lack the funding to provide subject-matter teachers and so individuals not certified in math or reading may be in charge of certain remediation classrooms.

Tatter notes:

Districts have had to spend hundreds of thousands of dollars on assessments, and don’t have the money to hire educators with the expertise required to work with the highest needs students. Some schools are using their general education teachers, already stretched thin, and others are using computer programs.

The state’s RTI2 policy identifies the intervention levels for students:

According to the state RTI2 policy, students should be divided into three groups: the majority, on grade level, are in Tier 1, students in the bottom 25th percentile of students across the country  are in Tier 2, and students in the bottom 10th percentile are in Tier 3.

All students, regardless of tier, get an hour of intervention time a day. For Tier 2 and Tier 3, intervention time is spent in small groups, ideally of fewer than five students, working on specific skills, while for kids in Tier 1 it might be enrichment activities.

Tatter notes that Metro Nashville Public Schools is among the districts taking advantage of the flexibility offered by the state to serve a smaller pool of students.

Essentially, if a district feels it lacks adequate resources to provide services to the bottom 25 perfcent of students, it can shift down to a smaller number, 16% in Tier 2 in MNPS for example, and the bottom 7% in Tier 3.

The shift at MNPS means they can focus on a smaller pool, but it also highlights the challenge faced by districts across the state. That is, those districts with higher concentrations of poverty (and likely to have higher numbers of students needing intervention) also have the least resources available to assist students.  The poorest districts, then, are left further behind as a result of a well-intentioned unfunded state mandate.

Tatter notes that education researchers and practitioners believe RTI2 can work and work well, but without proper support, many districts are struggling to make that happen.

More on RTI2 from our friends over at Bluff City Ed

For more on education politics and policy in Tennessee, follow @TNEdReport