Flexible Validity

Commissioner of Education Candice McQueen today provided additional information on how teacher evaluations would be handled in light of the flexibility the department is granting educators in light of TNReady troubles.

First, the email from McQueen, then some thoughts:

Dear educators,

Thank you for all of your thoughtful questions in response to Gov. Haslam’s proposal to create evaluation flexibility during our transition to TNReady. Last month, we shared an overview of the governor’s proposal (here). Earlier this week, the legislation began moving through the legislative process, so I’m writing to share more detailed information regarding the proposal, specifically how it is designed to create evaluation flexibility for you.

The department has developed an FAQ document on Evaluation Flexibility for Teachers (here) which provides detailed information regarding how this flexibility will affect teachers in different subjects and grades. I encourage you to closely read this document to learn how the flexibility applies to your unique situation.

Meanwhile, I wanted to share a few highlights. The governor’s proposal would provide you the option to include or not include results from the 2015-16 TNReady and TCAP tests within the student growth component of your evaluation, depending on which scenario benefits you the most. In other words, if student growth scores from this year help you earn a higher evaluation score, they will be used. If they do not help you earn a higher score, they will not be used. The option that helps your score the most will automatically be incorporated into your evaluation. This applies to all grades and subjects, including science and social studies.

Because Tennessee teachers will meet over this spring and summer to establish scoring guidelines and cut scores for the new assessment, achievement scores will not be available until the fall. TVAAS scores, however, will be available this summer because cut scores for proficiency levels are not required to calculate growth scores.

You can follow the progress of the governor’s proposal as it moves through the legislative process at the Tennessee General Assembly website (here). If you have additional questions about how this may apply to you, please contact TEAM.Questions@tn.gov.

We hope this evaluation flexibility eases concerns as we transition to a new, more rigorous assessment that is fully aligned to our Tennessee Academic Standards, as well as navigate the challenge of moving to a paper-based test this year. Thank you for your ongoing commitment to Tennessee students, as well as your continued flexibility as we transition to an assessment that will provide us with better information about our students’ progress on the path to college and career readiness.

My thoughts:

While flexibility is good, and the TVAAS waiver is needed, this sentence is troubling:

TVAAS scores, however, will be available this summer because cut scores for proficiency levels are not required to calculate growth scores.

The plan is to allow teachers to include TNReady TVAAS scores if they improve the teacher’s overall 1-5 TEAM rating. That’s all well and good, except that there can be no valid TVAAS score generated from this year’s TNReady data. This fact seems to have escaped the data gurus at the Department of Education.

Here’s what I wrote after analyzing studies of value-added data and teacher performance when using different types of assessments:

If you measure different skills, you get different results. That decreases (or eliminates) the reliability of those results. TNReady is measuring different skills in a different format than TCAP. It’s BOTH a different type of test AND a test on different standards. Any value-added comparison between the two tests is statistically suspect, at best. In the first year, such a comparison is invalid and unreliable. As more years of data become available, it may be possible to make some correlation between past TCAP results and TNReady scores.

This year’s TNReady-based TVAAS scores will be invalid. So will next year’s, for that matter. There’s not enough comparative data to make a predictive inference regarding past TCAP performance as it relates to current TNReady performance. In other words, it’s like comparing apples to oranges. Or, pulling a number out of your ass.

IT’S WRONG!

But, there’s also the fact that in states with both paper-based and online testing, students score significantly higher on the paper tests. No one is talking about how this year’s mixed approach (some 20,000 students completed a portion of the test online on day one) will impact any supposed TVAAS number.

How about we simply don’t count test scores in teacher evaluations at all this year? Or for the next three years? We don’t even have a valid administration of TNReady – there have been errors, delays, and there still are graders hired from Craigslist.

Let’s take a step back and get it right – even if that means not counting TNReady at all this year — not for teachers, not for students, not for schools or districts. If this 11 hour test is really the best thing since sliced bread, let’s take the time to get it right. Or, here’s an idea, let’s stop TNReady for this year and allow students and teachers to go about the business of teaching and learning.

T C Weber Has Had Enough

Nashville blogger T C Weber has had enough of the Tennessee Department of Education’s excuse-making over the ongoing TNReady fiasco.

Here’s what he has to say:

For those of you new to the game, let me give you a recap. This was supposed to be the year that everything was going to be different. But it didn’t take long for things to go awry. Within hours of beginning the administration of the test, the online testing platform failed. A mad scramble to affix blame ensued with the Department of Education ultimately deciding that pencil and paper would be the way to go. But in order to do that, schools would need to receive supplies in a timely manner, and now, that’s not happening either.

This is becoming a complete and utter fiasco. Some schools are having to change testing schedules for the third time. What that translates to is a loss of valuable instructional time and a huge inconvenience for children and teachers. It also fails to take into account special programs like field trips and such. One school in Chattanooga has two field trips scheduled for the end of April during dates they are now supposed to hold for testing. I guess they’ll have to cancel. Why are students going to be punished because adults failed to do their job?

He says more, but the post reminds me of the old adage: The definition of insanity is doing the same thing over and over and expecting different results.

More on TNReady:

Still Not TNReady

Ready for a Break

Ready to Waive

Ready Already?

For more on education politics and policy in Tennessee, follow @TNEdReport

 

 

Memphis to Join NAEP TUDA

Shelby County Schools is among six districts joining the “Nation’s Report Card” via the Trial Urban District Assessment (TUDA) program.

Here’s the press release:

The National Assessment of Educational Progress (NAEP) will include six more urban school districts from around the country after a unanimous vote Saturday by the National Assessment Governing Board to expand the Trial Urban District Assessment (TUDA) program.

The six districts — Clark County School District (including Las Vegas); Denver Public Schools; Fort Worth Independent School District (Texas); Guilford County Schools (including Greensboro, North Carolina); Milwaukee Public Schools; and Shelby County Schools (including Memphis, Tennessee) — volunteered to be part of NAEP administration starting in 2017. TUDA is a special part of the NAEP program that provides results of how fourth- and eighth-graders perform in reading and mathematics in some of the nation’s largest urban school districts. The vote of the Governing Board, which sets policy for NAEP, brings the total number of TUDA districts to 27.

 

The idea for a big-city version of NAEP, also known as The Nation’s Report Card, originated in 2000, when the Council of the Great City Schools — a coalition of the nation’s large urban public school districts led by Executive Director Michael Casserly — requested that the Governing Board conduct a trial NAEP assessment for large urban school districts that volunteered to participate. Congress first authorized funding for TUDA in 2002, and increases in funding over time have enabled the Governing Board to expand the program.

 

“The Governing Board values Mr. Casserly’s foresight and leadership and the bipartisan support from Congress, the president and the Department of Education to support the expansion of this program,” said Governing Board Chair Terry Mazany. “TUDA provides school district leaders, parents and civic leaders with objective and comparable data to measure the progress of student achievement over time in many of the country’s largest school districts.”

 

“The addition of these six new cities to the Trial Urban District Assessment of NAEP is a major step forward for the program and will help sustain efforts to improve the nation’s large-city public schools well into the future,” Casserly said. “We are thrilled that 27 cities will be participating in 2017.”

 

TUDA tests representative samples of students and it reports district-level student achievement results, including trends over time. To be eligible for TUDA, a district must be in a city with a population of 250,000 or more, and at least half of its student population must include minority racial or ethnic groups or must be eligible for free and reduced-price lunch. New TUDA districts must be large enough to support testing three NAEP subjects per year in grades four and eight. The six districts join these other school systems:
  • Albuquerque Public Schools
  • Atlanta Public Schools
  • Austin Independent School District
  • Baltimore City Public Schools
  • Boston Public Schools
  • Charlotte-Mecklenburg Schools
  • Chicago Public Schools
  • Cleveland Metropolitan School District
  • Dallas Independent School District
  • Detroit Public Schools
  • District of Columbia Public Schools
  • Duval County Public Schools (Jacksonville, Florida)
  • Fresno Unified School District (California)
  • Hillsborough County Public Schools (Florida)
  • Houston Independent School District
  • Jefferson County Public Schools (Kentucky)
  • Los Angeles Unified School District
  • Miami-Dade County Public Schools
  • New York City Public Schools
  • School District of Philadelphia
  • San Diego Unified School District
“We now have an ever-greater geographic representation in TUDA, with four more states included. This will provide the nation with an objective picture of the achievement spanning the diversity of our nation’s students, recognizing that the majority of students in our nation’s schools is now composed of minority populations,” Mazany said.

 

View a list of current and eligible TUDA districts at www.nagb.org/policies/list-tuda-districts.html.

 

###

 

The National Assessment of Educational Progress is the only nationally representative, continuing evaluation of the condition of education in the United States. It has served as a national yardstick of student achievement since 1969. Through The Nation’s Report Card, NAEP informs the public about what American students know and can do in various subject areas and compares achievement among states, large urban districts, and various student demographic groups.

 

The National Assessment Governing Board is an independent, nonpartisan board whose members include governors, state legislators, local and state school officials, educators, business representatives, and members of the general public. Congress created the 26-member Governing Board in 1988 to oversee and set policy for NAEP.
For more on education politics and policy in Tennessee, follow @TNEdReport

Frogge Announces Re-election Bid

MNPS School Board Member Amy Frogge today announced she will be running for re-election from her District 9 School Board seat.

Here’s the press release:

Amy Frogge, School Board Representative for District 9, today announced her campaign for re-election to the Metro Nashville School Board. First elected in 2012, Frogge represents the greater Bellevue area, Sylvan Park, Charlotte Park, West Meade, and Hillwood.

“Through all our successes and challenges, it’s been an honor
representing our district,” Frogge said. “Standing up for our schools is
demanding, but the tide is turning away from reckless experimentation
and toward implementing strategies that have been proven to help our
children learn and grow.”

Frogge has been an outspoken proponent of whole child education, early childhood intervention, and increased exposure to physical activity and the arts. At the same time, she has vehemently opposed excessive standardized testing; efforts to diminish our teachers’ ability to be effective; and educationally and fiscally dangerous tactics pushed by out-of-state special interest groups.

During her tenure on the School Board, Frogge has succeeded in
guaranteeing all students in pre-K through sixth grade have recess
daily, and she has worked with other board members and administrative leaders to decrease standardized testing. She has also helped ensure that every middle school child receives instruction in foreign language, supported expansion of MNPS’s model pre-K program, and advocated for adequate and equitable school funding.

In addition, Frogge has been instrumental in efforts to update the aging Hillwood High School and increase capacity at elementary schools and middle schools across District 9. Money has been allocated to pay for architectural plans for a new high school, and plans call for
renovations to various schools as well as a new elementary school in the Bellevue area.

Frogge was named a “Hero of Public Education” by former U.S. Assistant Secretary of Education Diane Ravitch, Best Public School Defender by the Nashville Scene, and School Board Member of the Year by the national blog Schools Matter.  She also received the Distinguished Service to Our Community honor from Delta Kappa Gamma, a teacher organization, and the Robert Chandler Ambassador Award from the Nashville Adult Literacy Council.

“With a new director of schools to be chosen soon, Nashville has a
unique opportunity to make our school system the best urban district in the nation,” Frogge noted. “With a singular focus on serving our
children, we can do great things for our city’s future.”

Frogge is backed by an impressive coalition of civic leaders, teachers,
involved parents, and community members from across the political
spectrum. (See list attached.) Her campaign kickoff is scheduled for
Monday, March 28 at 5:30 p.m. at Thistle Stop Café, 5128 Charlotte Pike.
To contribute to Amy’s campaign, visit https://amyfrogge.com. A complete website is in the works.

For more on education politics and policy in Tennessee, follow @TNEdReport

Still Not TNReady

Rocky Top Ed Talk has an updated list of school systems experiencing delays in receiving TNReady testing materials. These delays have happened in spite of Commissioner McQueen’s confidence in the process of moving forward with pencil and paper tests. Schedules have been changed, updated, and disrupted again and again as the shift was made from computer-based tests to paper tests. Students and teachers have lost valuable instructional time while the state and its testing vendor, Measurement, Inc. continue to experience challenges in meeting test delivery obligations.

Here’s the current list of school systems that have experienced delays in receipt of TNReady materials:

  • Hamilton County Schools
  • Dickson County Schools
  • Robertson County Schools
  • Murfreesboro City Schools
  • RePublic Charter Schools (Nashville)
  • Sumner County Schools
  • Maury County Schools
  • Wilson County Schools
  • Putnam County Schools
  • Williamson County Schools
  • Bartlett City Schools
  • Tipton County Schools
  • Achievement School District (Memphis)
  • Blount County Schools

If your school system has experienced delays or disruptions due to this year’s testing issues, let us know in the comments.

For more on education politics and policy in Tennessee, follow @TNEdReport

Bill Dunn Wrong

Yesterday, in his advocacy for HJR 493, legislation that would remove the Tennessee Constitution’s requirement that the General Assembly adequately fund schools, State Representative Bill Dunn suggested that increasing funding for schools across the state actually does not improve student outcomes. He cited the initial BEP investment, started in 1992 and said that from beginning to end, the program actually resulted in lower student achievement numbers.

This would be a great way to prove Dunn’s case that the General Assembly need not provide additional funds to schools in order to provide an adequate education.

It’s also not true.

Dunn cited ACT scores from the start of the BEP until 1998 and suggested they’d gone down slightly. What he failed to mention is that between 1995 and 1998, the number of students taking the ACT increased by 25%. That would seem to indicate that Rep. Kevin Dunlap was correct when he suggested that new BEP funds created new opportunities for students in rural districts. As the State of Tennessee noted in the 1998 State Report Card:

The ACT is one of three tests approved by the State Board of Education to fulfill the requirement in state law that all students take an exit exam to receive a full high school diploma. The total number of Tennessee graduates taking the ACT rose 25% during the first three years of this new requirement: from 32,628 in 1995 to 40,782 in 1998. Included among those tested were 14,284 who had not completed a college preparatory course of study. Even with these dramatic increases in the number and percentage of students tested, Tennessee’s students were able to narrow the gap between the state and national composite scores in 1998.

So, more students than ever were taking the ACT and by 1998, the state was turning around an initial decline in scores. That’s a different story than the one Bill Dunn told.

Another way to look at the data is to see what happened on the National Assessment of Educational Progress (NAEP) during the early BEP years. While reading scores from 1992 are not readily available, math scores are. Here’s the comparison:

4th Grade Math

1992         211

2000        220

8th Grade Math

1992        259

2000       263

These results show statistically significant improvements in math scores over the same time period the General Assembly was significantly improving investment in public schools. That is, what Bill Dunn said yesterday was just plain wrong.

Finally, it’s worth examining the ACT score differences among districts during the early BEP years. An examination of data beginning in 1991 (the year before BEP) and ending in 2001 (so as to provide 10 years of comparable data) indicates that the top scoring districts in the state on the ACT were also among the top spending districts. In fact, over those years, while not technically statistically significant, it can be said with 92% confidence that the difference in ACT scores among the highest- and lowest-performing districts is explained by per pupil expenditures. That is, the higher the spending, the more likely the district is to be among the state’s top performers on the ACT.

Additionally, during this same ten year time period, the gap between the highest and lowest scores among districts is clearly explained by the gap in per pupil expenditures among those districts. You spend more, you get better results. The impetus for all this spending was the new BEP formula that sent more money to all school systems. Those districts already at the top were most able to take advantage and boost ACT scores while those at the bottom saw an increase in the number of students taking the ACT, resulting in the statewide slight ACT decline Dunn references.

Investing in schools matters. Our state’s constitution requires the General Assembly to provide a system of free public schools, including providing adequate funding for those schools. Bill Dunn doesn’t think spending levels matter. The data suggests otherwise.

For more on education politics and policy in Tennessee, follow @TNEdReport

Creative Problem Solving

What happens when, despite your best efforts, local school systems sue your state claiming a lack of adequate funding? You get nervous is what happens. Especially when three previous lawsuits claiming your state has underfunded schools have been successful.

When a body like the Tennessee General Assembly faces a dilemma such as whether or not to make funding schools a top priority, they can either make a significant new investment in schools OR wait and see if the courts order them to make a significant new investment in schools. Historically, our General Assembly has waited and then taken corrective action by way of new investment only after courts have found that school funding is not adequate and/or equitable.

Now, however, lawmakers are taking a different approach. They are advancing amendments to the state constitution that would essentially eliminate the requirement that the General Assembly provide for a “system of free public schools” in Tennessee.

That’s creative problem solving. The state’s governing legal document binds the General Assembly in a way they don’t much like. So, just change it. Thus, you are now free to continue inadequately funding the state’s schools.

Former state Senator Roy Herron decried this effort on behalf of Tennessee School Systems for Equity. Here’s his take from a letter he submitted to legislators:

I write on behalf of the Tennessee School Systems for Equity, which includes most of Tennessee’s school districts. As your former colleague, I know something of how incredibly busy you are and so I will come right to the point.

This week you will consider a constitutional amendment that would strip your schools and students of constitutional protection for adequate funding.

There are two different proposed constitutional amendments that would deny Tennessee’s children any state constitutional right to adequate public schools. We believe that if either of these provisions were in Tennessee’s Constitution instead of our decades-old Article XI, Section 12, then our children effectively would have no state constitutional protection to ensure even minimally adequate public schools.

Some may tell you that the amendments would leave your school systems and your students with some constitutional protections. But these amendments would deem whatever funding any future legislature provided — or didn’t provide — to be adequate and constitutional. No matter how little.

The amendments would leave in the Constitution language that would provide the illusion, but remove the reality, of constitutional protection for public schools. If the proposed language were in the Constitution, school children would be doomed to whatever fate any future legislature decreed. And schools in your district could receive millions less in state funding, leading either to woefully inadequate schools or soaring property taxes or both.

It’s hard to imagine anything that would adversely impact our students — or Tennessee’s future — more than stripping our children of their constitutional right to adequate public schools.

HJR 493. A distinguished House colleague of yours, however, also has a constitutional amendment, House Joint Resolution 493. It is before your House Education Administration & Planning Subcommittee this Tuesday, March 1st at 3:00 p.m.

The able sponsor says that he only wants to remove any constitutional requirement for schools to be funded “adequately.” But without constitutional protection, a future legislature could say, for example, that each child gets to go to a free public school for a month a year. And that would be legally and literally true.

This proposed amendment would strip our children of any state constitutional protection to an adequate education. That is the respected sponsor’s stated intent and would be the legislative effect.

Let me respectfully submit for your consideration the following beliefs and concerns:

1. To destroy our state’s constitutional protection for adequate funding:

1.1 Endangers children in every county;

1.2 Endangers Tennessee’s future;

1.3 Leaves future legislatures and governors free to undo every good thing you and this legislature have done to educate our children and would allow them to do wrong by our children.

1.4 Would let future legislatures and governors decide that our children and grandchildren could go to inadequate schools.

2. It is not conservative to:

2.1 Strip citizens of constitutional protections;

2.2 Blindly trust government and future governments to do right;

2.3 Ignore decades of constitutional precedent and history;

2.4 Vote to amend our Constitution without carefully hearing from leading experts or at least the Attorney General;

2.5 Ignore Congressman Davy Crockett’s maxim, “First be sure you’re right; then go ahead.”

On behalf of more than 80 school systems all across Tennessee, I respectfully request that you not strip our children of their constitutional right to adequate schools.

For more on education politics and policy in Tennessee, follow @TNEdReport

Ready for a Break

Following the Day One failure of TNReady testing, the state proposed switching to only paper and pencil tests.  Last week, the first sign of trouble on that front developed, as Dickson County reported a delay in receiving the printed materials.

While the Department of Education reports that most districts have received their materials, Chalkbeat reported yesterday that at least a dozen districts have had to reschedule testing due to printing delays. Those districts include:

  • Tennessee Achievement School District
  • Bartlett
  • Hamblen County
  • Maury County
  • Madison County
  • Murfreesboro City
  • Putnam County
  • Robertson County
  • Sevier County
  • Sullivan County
  • Tipton County
  • Wilson County

Despite these delays, the TNReady testing will continue, and in fact, many districts have already begun some paper and pencil testing.

Still, it seems that TNReady just can’t catch a break in its first year.

For more on education politics and policy in Tennessee, follow @TNEdReport

 

The Paper Chase

Following the failure of TNReady on Day One, Commissioner Candice McQueen announced a simple solution: Tests will now be administered on pencil and paper. Except, it turns out, it’s not so simple. What if the paper tests don’t arrive on time?

The Dickson Herald reports:

Dickson County Schools have delayed administering the paper version of the state’s new TN Ready standardized tests until March 7 after a delay in receiving the testing materials, the schools director said.

Schools Director Dr. Danny Weeks alerted parents to the issue in a SchoolReach phone message and he also discussed the matter with the county School Board on Thursday night.

Educators and parents had prepared for administering the paper tests on Monday. However, Weeks said the school system had not yet received confirmation the print testing materials had yet shipped Thursday.

The ongoing saga of the TNReady challenges reminds me of the time the legislature pulled Tennessee out of PARCC just as we were preparing to have our first year with the Common Core aligned tests. Instead of a year without a test, we administered another year of TCAP — a test not aligned with our state’s current standards, and thus not an accurate indicator of student mastery or teacher impact.

Governor Haslam and Commissioner McQueen have announced that teachers and students alike won’t be held accountable for test results this year, but what about just taking the year off and getting it right?

For more on education politics and policy in Tennessee, follow @TNEdReport

Memphis NAACP Says No More ASD

The Memphis branch of the NAACP has called for an end to ASD expansion.

Specifically, the organization’s leaders noted:

The NAACP is also joining others in the community calling for a hold on the state’s Achievement School District. The ASD is tasked with turning around schools in the bottom five percent.

“We respectfully request that there be a statewide moratorium on the addition of schools to the ASD model until sufficient improvement can be demonstrated by the existing schools,” Taylor said.

“We have a proven model with iZone in Shelby County Schools,” said NAACP Education Committee Member Dr. Freda Williams.

ASD Superintendent Malika Anderson responded:

“We are disappointed by the NAACP Memphis Branch’s call to suspend the work of the Achievement School District and the mischaracterization of our turnaround efforts. Our students are showing real and significant gains, and it would be a shame to let politics put the progress of our schools on pause,” ASD Superintendent Malika Anderson said, in a statement.

I wonder if moving schools from the bottom 5% of all schools to the bottom 6% is the type of long-term progress Anderson is touting.

For more on education politics and policy in Tennessee, follow @TNEdReport