Thoughts on Annual Student Assessments

Dan Lawson is the Director of Schools at Tullahoma City Schools

The Issue: Assessments of student academic progress.  As you well know, The state of Tennessee is transitioning assessments from our former suite to the new TNReady assessments.  Furthermore, you are also well aware of the fact that many of the standards on which the current assessment is based are currently under review with consideration for additions and removal.  

 

The Background: In the scenario I described about teachers and growth scores, a senior teacher representing a lauded math department was able to present data that clearly and convincingly aligned our instruction with two critical components in our academic program in Tullahoma City Schools: ACT and Advanced Placement.  As he visited with me, he did so with a concern that can best be characterized by this summary:  Our instructional path produces ACT and Advanced Placement scores significantly above the state average and if we teach all the prescribed TNReady standards in timeframes aligned with TNReady assessments, we are concerned that our student performance on ACT and Advanced PLacement assessments will decline.

Certainly, that statement is based on the experiences and anecdotes of my staff members, but there is tremendous logic in this fundamental question.  Since one of our primary purposes and expected outcomes is to produce students who are “college and career ready” as measured by ACT or SAT, why don’t we allow schools and districts with the desire to do so to assess based on the ACT or SAT suite of services aligned with the measure we aspire to accomplish?  While the issue of assessment often is directly linked to the issue of accountability, I submit that the accountability of most schools and districts would be enhanced by reporting scores that both our students and their parents readily understand.  To that end, nearly every high school student enrolled in Tennessee high schools clearly understands the difference between a “15” and a “30” on the ACT.  That understanding makes it much easier for a teacher and school leader to discuss and propose interventions to address the “15” that has been reported for that student.

 

A Proposed Solution: There has been a misalignment in the testing/teaching standards from SAT 10 to TCAP to ACT and this misalignment has allowed some system’s to experience low TVAAS scores for K-2, 3-8, and 9-12 assessments. Until we pick a plan and follow that plan, we will be hard pressed to see college and career readiness expand in Tennessee. IF college and career readiness is really our goal, then don’t we need a clearly and cleanly aligned set of standards to reach that goal?

 

Align the state assessment with the ACT or SAT suite of services.  I understand that concerns exist suggesting that we can not accomplish that outcome and be compliant with state procurement, but I am also well aware of the fact that other states utilize the ACT suite today.  I am confident that we have the ability to accomplish anything that the state of Alabama has accomplished.

For more on education politics and policy in Tennessee, follow @TNEdReport

Growth Scores and Teacher Tenure

Dan Lawson is the Director of Schools at Tullahoma City Schools. This post reflects his thoughts on the current use of TVAAS as it relates to teacher tenure.

 

The issue: “growth scores” as a determinant for teacher tenure recommendations.

 

The Background: I employ an outstanding young teacher who enjoyed three consecutive years of a level “4”+ evaluations and those scores were moved to a “5” based on the TCAP growth score. In the “old tenure” model, that teacher would have been eligible for tenure recommendation to our Board of Education upon completion of three years of services and the recommendation of their superintendent.  

 

The statutorily revised “new tenure” requires five years of service (probationary period) as well as an overall score of “4” or “5” for two consecutive years preceding the recommendation to the Board of Education. Last year, no social studies assessment score was provided since it was a field tested and the teacher was compelled to select a school wide measure of growth.  He chose POORLY and his observation score of a “4.38” paired with a school wide growth score in the selected area of a “2” producing a sum teacher score of “3” thereby making him ineligible for tenure nomination.

 

This is a very real example of an inequity in our current tenure eligibility metrics.  In the 2014-15 evaluation cycle, more than 66.6% of Tullahoma teachers did not have an individual assessment score, so were compelled to select some other measure. In this case, we have a teacher that we are happy with, who produces great student outcomes and one that we would like to recognize with tenured status but we are unable to do so.  More than anything this sends a message that the process for the majority of our teachers is little more than some arbitrary guessing game, and that guessing games does little more than erode confidence; Our teachers deserve better.

A second teacher visited with his building principal and I related to standards that are not taught aligned with the state assessment.  He went on to produce competition results, ACT scores and AP calculus scores of the students in that “pipeline” in support of his math departmental teaching practice.  His request was simple:  Allow me to teach with a focus on the end product instead of a focus on a test this May.  Within that dialogue, he was quick to share the fact that he expected his growth score to suffer that year but in the long term our students would be better served.  Furthermore, he opined that as long as his principal and superintendent were in place and understood the “big picture” he really had no concerns.  I concurred.  However, his next statement was deeply troubling.  He said “while the number doesn’t mean anything to us, when I retire, that next teacher may believe that number is the most important measure of progress.”  

I believe in accountability.  My board and I embrace expectations of high performance and I am comfortable in making personnel decisions aligned with school improvement and the best academic and developmental opportunities for our children. In this circumstance, however, we are letting the “tail” of growth scores “wag the dog” of teacher evaluations and subsequent tenure eligibility.

A Proposed Solution: We are supportive of the award of tenure returning to a local decision with eligibility determined by service and evaluations.  If, however, that change is not palatable, I believe that an amendment to the current “tenure” statute language allowing a school district to present “mitigating and compelling reason(s)” sponsored by the superintendent to the TDOE for review is warranted. We find the current system of “growth scores” serving as the overwhelming criteria to be an ineffective measure since in our school system since a majority of our teachers do not have those scores available for their use and are thereby compelled to use some school wide measure over which they may have limited influence.

For more on education politics and policy in Tennessee, follow @TNEdReport

So, About the ASD

A new study out of Vanderbilt calls into question the effectiveness of the Achievement School District.

Specifically, the study notes:

While there were some changes year-to-year — up and down — there was no statistical improvement on the whole, certainly not enough to catapult these low-performing schools into some of the state’s best, which was the lofty goal.

Those results echo the findings reported by Gary Rubinstein in his analysis of the schools under ASD management the longest.

Rubinstein noted:

As you can see, four of the original six schools are still in the bottom 5% while the other two have now ‘catapulted’ to the bottom 6%.

In 2014, Ezra Howard did an analysis of the ASD after two years of management and found that the results were not significantly better than what would have been expected had the schools remained under district management.

Based on his reading of the results, he noted:

 First, can the ASD reach 55% P/A in order to be in the top quartile? Maybe. In order to reach that magic number of 55% P/A in all three of these subjects, the ASD would have to average 11.07% gains in Math and 12.67% gains in ELA over a 5 year period. However, in the last two years, the ASD has averaged 2.92% gains in Math and 0.72% gains in ELA.

Second, is the money being spent on ASD a worthwhile investment. Howard notes:

an exorbitant amount is spent on results that are, at best, no different than what the data suggests we could have expected had these schools not been taken over by the ASD.

Now, we have three years of data and analysis by both Gary Rubinstein and Vanderbilt researchers. All of which suggest that Howard’s preliminary analysis was on-target.  The ASD is moving slowly at best, and not markedly better than district schools.

In spite of this, ASD officials noted in response to the Vanderbilt study:

For its part, leaders of the Achievement School District say there’s not enough data “to draw any decisive conclusions” and that their work is making a “positive difference.”

That sounds awfully cautious for an outfit that touted its success in a blog post and media release earlier this year.

As the ASD continues, the question is:  Will the Tennessee General Assembly allow this model to continue, or will it set some limits in order to push the district to demonstrate more success before further expanding its reach?

More on the ASD:

Expansion Teams

That’s Not That Much, Really

ASD vs. Nashville Middle Schools

For more on education politics and policy in Tennessee, follow @TNEdReport

 

 

A Simple Wish

Amanda Kail, a teacher in MNPS and a member of CAPE, has released her prepared remarks ahead of tonight’s MNPS School Board meeting.

Here’s what she plans to say:

Dear ladies and gentlemen of the board. My name is Amanda Kail. I am an EL teacher at Margaret Allen Middle Prep. And I am here to talk about my wish list for this district.
So what do I wish? How would I make things different? I wish that this district would take teaching and learning seriously. I wish that instructional time was treated as the MOST important part of the school year. I wish that no one would even dream of asking teachers to shift their schedules and lesson plans constantly to make room for assessments that give us very little useful feedback.
Why don’t these assessments give us useful feedback? Because they are riddled with confusing formats, questions that are developmentally inappropriate, and require students to navigate unfamiliar technology. Because the internet connection is slow or the laptop malfunctions, or the test kicks them out for unknown reasons. Because they do not differentiate for our vastly diverse student population. Recently, one of my students, Z, told me that he has given up on school. Z is a bright, caring EL student with significant learning disabilities. When I asked him why, he told me that none of the work that he does in the classroom matters, because he is going to fail all the tests anyway. He said, “When my teachers give me work in the classroom, I understand it. But then the tests come and I just fail. I don’t understand anything. I give up.”
Z knows that he can learn. And so do his teachers. He can’t get there by the same path as everyone else, but he can get there. But the barrage of tests, which insist on assessing everyone the same way, tell him otherwise. We have got to stop putting so much trust in these tests that tell us our students are below basic, that our teachers are ineffective, and that our schools are failures. And on behalf of Z and every student like him, I am not giving up.
At some level, the state agrees with me. The TN Department of Education has given students a grace period of a year before TN Ready counts for them. However, this test will STILL count for teacher evaluations. So I am back to wishing that the district would take teaching and learning seriously. How many teachers do you think are going to continue to commit professional suicide by getting low evaluations due to test scores? Tests that they know, and even the state knows, our students have no hope in passing? Would you stay? Are we as a district weary of the teacher retention problem?
Luckily, dear board members, there is something you can do. The Knoxville school board recently passed a resolution asking the state to not count TN Ready scores in teacher evaluations. I am asking you to do the same. The state needs to hear from district leaders as a united front on this issue. It will go a long way to show that you do take teaching and learning seriously. That is my wish.
For more on education politics and policy in Tennessee, follow @TNEdReport

CAPE Flies Again

Newly-formed education advocacy group CAPE (Community Advocates for Public Education) will be in action at tonight’s MNPS School Board meeting, according to a press release:

The Coalition Advocating for Public Education (CAPE) will continue its “Use Your Teacher Voice” campaign at the MNPS school board meeting on Tuesday, December 8. The group attracted significant attention from both the media and board members when nine teachers spoke on the impact of high-stakes testing on their classrooms at the November board meeting.

Amanda Kail, one of the founders of CAPE and an EL teacher at Margaret Allen Middle Prep explains, “We are bringing the voices of professional educators back to the discussions about public education. There are so many big problems that need solving right now like over-testing, teacher retention, school closures, and the school-to-prison pipeline. These are all problems that teachers can help solve. We are the ones professionally grounded in the theory and practice of education. We are the ones that are doing the educating. We can help do what’s right for our kids.”

Kail notes that there are few professions that are so driven by policy makers who are not part of the profession. “A lot of people get involved in public education because they want to sell something. And there is nothing wrong with creating educational products and services, but it creates different goals. Earning a profit is not the same thing as educating a child. This is why CAPE encourages teachers to speak out, in order to create more balance when it comes to policy decisions.”

Board member Will Pinkston has pledged to make reducing testing a priority in the search for candidates for director of schools. Eleven teachers, nine of them who will be addressing the board for the first time, have signed up to speak at Tuesday’s meeting. Their theme will be “wish lists” for the district.

For more on education politics and policy in Tennessee, follow @TNEdReport

A Matter of Fairness

A coalition of education advocacy groups released an online petition today calling for a one year waiver from using student test scores in teacher evaluations in Tennessee.

Here’s the press release:

A coalition of groups supporting public education today launched an online petition asking the Tennessee General Assembly and Governor Bill Haslam to grant teachers a grace period from the use of student test scores in their evaluations in the first year of new TNReady tests. The petition tracks language adopted unanimously by the Knox County School Board, which passed a resolution last week opposing the use of student test scores in teacher evaluation for this academic year.

“The state has granted waivers so that TNReady scores aren’t required to be counted in student grades for this year,” said Lyn Hoyt, president of Tennesseans Reclaiming Educational Excellence (TREE). “If TNReady won’t count in student grades, it’s only fair that it shouldn’t count for teacher evaluation.” Hoyt noted that the transition to the new test means entering uncharted territory in terms of student scores and impact on teacher evaluation scores. As such, she said, there should be a one year or more grace period to allow for adjustment to the new testing regime.

“TNReady is different than the standardized tests we’ve had in the past,” Hoyt said. “Our students and teachers both deserve a reasonable transition period. We support the Knox County resolution and we are calling on the General Assembly to take notice and take action. Taking a thoughtful path transitioning to the new test can also build confidence and trust in the process.”

Hoyt also cited a recent policy statement by the American Educational Research Association that cautions against using value-added data in teacher evaluations and for high-stakes purposes. “Researchers who study value-added data are urging states to be cautious in how it is used to evaluate teachers,” Hoyt said. “The transition to TNReady is the perfect time to take a closer look at how test scores are used in teacher evaluations. Let’s take a year off, and give our students and teachers time to adjust. It’s a matter of fundamental fairness.”

Groups supporting the petition include:

Strong Schools (Sumner County)
Williamson Strong (Williamson County)
SPEAK (Students, Parents, Educators Across Knox County)
SOCM (Statewide Organizing for Community eMpowerment)

Middle TN CAPE (Coalition Advocating for Public Education)
Momma Bears Blog
Advocates for Change in Education (Hamilton County)
Concerned Parents of Franklin County (Franklin County)
Parents of Wilson County, TN, Schools
Friends of Oak Ridge Schools (City of Oak Ridge Schools)
TNBATs (State branch of National BATs)
TREE (Tennesseans Reclaiming Educational Excellence)
TEA (Tennessee Education Association)

For more on education politics and policy in Tennessee, follow @TNEdReport

New and Not Ready

Connie Kirby and Carol Bomar-Nelson, English teachers at Warren County High School, share their frustration with the transition to TNReady and what it means for teacher evaluation.

Connie Kirby:

This is going to be long, but I don’t usually take to social media to “air my grievances.” Today I feel like there’s no better answer than to share how I feel. It’s been a long year with some of the highest of the highs and lowest of the lows. I work in a wonderful department at a great school with some of the most intelligent, hard-working people I know. As the years have progressed, we have gone through many changes together and supported each other through the good and the bad (personally and professionally). We do our best to “comply” with the demands that the state has put on us, but this year everything that we’ve been hearing about and preparing for for years has come to fruition. We’re finally getting familiar with the “real deal” test, instead of dealing with EOCs and wondering how it’s going to change. I’ve seen the posts and rants about Common Core and have refrained from jumping on the bandwagon because I have had no issues with the new standards. I do, however, see an issue with the new assessment, so I have held my hand in the hopes that I might find something worth sharing and putting my name next to. Today, I witnessed an exchange between one of my colleagues and the state, and I couldn’t have said it better myself. With her permission, I am sharing her words.

Carol Bomar-Nelson:

I don’t know how to fix the problems with the test. I agree that teachers should have accountability, and I think student test scores are one way of doing that. Having said that, if the state is going to hold teachers accountable for student test scores, then the test needs to be fair. From what I have seen, I firmly believe that is not the case. I am not just basing this conclusion on the one “Informational Test” in MICA. Other quizzes I have generated in MICA have had similar flaws. When my department and I design common assessments in our PLC’s, we all take the tests and compare answers to see which questions are perhaps ambiguous or fallacious in some way. I do not see any evidence that the state is doing this for the tests that it is manufacturing. A team of people can make a test that is perfect with respect to having good distractors, clear wording, complex passages, and all the other components that make up a “good” test, but until several people take the test, compare answers, and discuss what they missed, that test is not ready for students to take–especially not on a high stakes test that is supposed to measure teacher effectiveness. I understand that this is the first year of this test. I am sympathetic to the fact that everyone is going through a ‘learning process’ as they adapt to the new test. Students have to learn how to use the technology; teachers have to learn how to prepare their students for a new type of tests; administrators have to figure out how to administer the test; the state has to work out the kinks in the test itself…The state is asking everyone to be “patient” with the new system. But what about for the teachers? Yes, the teacher effectiveness data only counts for 10% this year, but that 10% still represents how I am as a teacher. In essence, this new tests is like a pretest, correct? A pretest to get a benchmark about where students stand at the end of the year with this new test that has so many flaws and so many unknowns. In the teaching profession, I think all would agree that it is bad practice to count a pretest AT ALL for a student’s grade. Not 35%, not 25%, not even 10%. So how is it acceptable practice to count a flawed test for 10% of a teacher’s evaluation? We can quibble all day about which practice questions…are good and which questions are flawed, but that will not fix the problem. The problem lies in the test development process. If the practice questions go through the same process as the real questions, it would stand to reason that the real test questions are just as flawed as the practice questions. My students have to take that test; I never get to see it to determine if it is a fair test or not, and yet it still counts as 10% of my evaluation that shows my effectiveness as a teacher. How is that fair in any way whatsoever? In what other profession are people evaluated on something that they never get to see? Especially when that evaluation ‘tool’ is new and not ready for use?

I know how to select complex texts. I know how to collaborate with my PLC. I can teach my students how to read, think critically, analyze, and write. When I do not know how to do something, I have no problem asking other teachers or administrators for suggestions, advice, and help. I am managing all of the things that are in my control to give my students the best possible education. Yet in the midst of all of these things, my teacher accountability is coming from a test that is generated by people who have no one holding them accountable. And at the end of the year, when those scores come back to me, I have no way to see the test to analyze its validity and object if it is flawed.

For more on education politics and policy in Tennessee, follow @TNEdReport

Not Yet Ready for Teacher Evaluation?

Last night, the Knox County Board of Education passed a resolution asking the state to not count this year’s new TNReady test in teacher evaluation.

Board members cited the grace period the state is granting to students as one reason for the request. While standardized test scores count in student grades, the state has granted a waiver of that requirement in the first year of the new test.

However, no such waiver was granted for teachers, who are evaluated using student test scores and a metric known as value-added modeling that purports to reflect student growth.

Instead, the Department of Education proposed and the legislature supported a plan to phase-in the TNReady scores in teacher evaluations. This plan presents problems in terms of statistical validity.

Additionally, the American Educational Research Association released a statement recently cautioning states against using value-added models in high-stakes decisions involving teachers:

In a statement released today, the American Educational Research Association (AERA) advises those using or considering use of value-added models (VAM) about the scientific and technical limitations of these measures for evaluating educators and programs that prepare teachers. The statement, approved by AERA Council, cautions against the use of VAM for high-stakes decisions regarding educators.

So, regardless of the phase-in of TNReady, value-added models for evaluating teachers are problematic. When you add the transition to a new test to the mix, you only compound the existing problems, making any “score” assigned to a teacher even more unreliable.

Tullahoma City Schools Superintendent Dan Lawson spoke to the challenges with TVAAS recently in a letter he released in which he noted:

Our teachers are tasked with a tremendous responsibility and our principals who provide direct supervision assign teachers to areas where they are most needed. The excessive reliance on production of a “teacher number” produces stress, a lack of confidence and a drive to first protect oneself rather than best educate the child.

It will be interesting to see if other school systems follow Knox County’s lead on this front. Even more interesting: Will the legislature take action and at the least, waive the TNReady scores from teacher evaluations in the first year of the new test?

A more serious, long-term concern is the use of value-added modeling in teacher evaluation and, especially, in high-stakes decisions like the granting of tenure, pay, and hiring/firing.

More on Value-Added Modeling

The Absurdity of VAM

Unreliable and Invalid

Some Inconvenient Facts About VAM

For more on education politics and policy in Tennessee, follow @TNEdReport

 

TSBA Leader Named to Education Commission of the States

The Tennessee School Boards Association has announced that its Executive Director, Dr. Tammy Grissom, has been named to the Education Commission of the States:

TSBA is pleased to announce that Governor Bill Haslam has appointed Dr. Tammy Grissom, TSBA Executive Director, to the Education Commission of the States (ECS) as a Representative of state education policymaking.  ECS supports all 50 states and four territories – the District of Columbia, American Samoa, Puerto Rico andthe Virgin Islands. Each state appoints seven commissioners who help guide the work of ECS and their own state’s education agendas. Commissioners also have the authority to approve amendments to bylaws and provide strategic information to ECS staff regarding state education policy issues.  Governor Haslam’s comments about Dr. Grissom were, “ your individual characteristics and professional qualifications were exceptional among the number of nominees who expressed interest and your participation is certain to leave a positive impact on this board and the work it does.”

For more on education politics and policy in Tennessee, follow @TNEdReport

Lunchtime Lecture on Chamber Education Initiatives

The Tennessee Chapter of the American Society for Public Administration (TN-ASPA) will host a lunchtime lecture tomorrow on the Nashville Chamber of Commerce’s K-12 Education initiatives. The event is free and open to the public.

Here’s the press release:

TN-ASPA hosts the third lunchtime lecture in our Fall series on Education in Tennessee and Nashville. Rita McDonald will speak on the Nashville Chamber’s K-12 education initiatives.

  • Who: Rita McDonald, Nashville Area Chamber of Commerce
  • Topic: Nashville Chamber of Commerce K-12 Education Initiatives
  • When: Thursday, November 19, 2015, 12noon1pm
  • Where: UT Center for Industrial Services
    2nd Floor Training Room
    193 Polk Avenue, Nashville, TN
    (Parking available on-site, please park in the front of building and enter through the middle entrance under the “T”)
The Nashville Area Chamber of Commerce has set improvement of public education as its number one priority. The Chamber focuses on helping metro public school students succeed and on getting the community and business leaders involved in public education. The Chamber has several K-12 education programs and initiatives, including the Education Report Card, Freshman Career Exploration Fairs, speaker series, and awards.
Rita McDonald, the Director of Community and Business Engagement in Education with the Nashville Area Chamber of Commerce, will speak on:

  • Why public education is the Chamber’s #1 priority
  • the Chamber’s major initiatives to improve public education
  • the major challenges and opportunities in public education in Nashville
  • the Chamber’s positions on key local and state public policy issues related to education
Lecture is FREE and open to the public.
For more on education politics and policy in Tennessee, follow @TNEdReport