Do Not Standardize Art

Camilla Spadafino, an art teacher in Nashville, offers these thoughts on the Tennessee Fine Arts Portfolio. This portfolio is used in a handful of districts across the state, and an updated version is being piloted by additional districts in the 2018-19 academic year.

Art should never become a standardized process and the TN Fine Arts Portfolio Model is pushing us toward that. When arts teachers are held accountable for checking off boxes, forcing growth, and using standardized measurements in arts classes we are interfering with the creative process. There is a great deal of evidence that despite the effort to standardize and objectify art, the portfolio model scores are wildly subjective making it an invalid, unethical assessment. The TN Arts Portfolio Model seeks to measure and weigh creativity and artistic expression which is counterproductive to the creation of art. The model places an excessive burden of time and energy on teachers that is disproportionate to the complete story of creating and growing a quality arts program.

 

Among the evidence that the scoring system is invalid: Two teachers submitted the same collection for the “create” domain and one received a five and the other a one. Another pair of visual art teachers co-taught and turned in exactly the same portfolio. One teacher received a four and the other a two. Another art teacher turned in the same portfolio two years in a row and received a four one year and a two the other.

 

Many visual art teachers have shared that they are cutting and pasting the same narrative from year to year. Many teachers have found that they can simply repeat the same collections with new pictures. This is encouraging “cookie cutter” teaching at worst and busy work for teachers at best. This does not encourage or promote creativity, experimentation, collaboration or risk taking.

 

Neither the TEAM model nor the Arts Portfolio model is an effective tool for evaluating an arts program. Being a visual art teacher includes managing inventory, advocating for and raising funds, engaging with the community, displaying student work and engaging in collaborations. It’s quite like running a nonprofit organization but without a board or any assistance. Along with all of those responsibilities arts teachers are still planning, assessing, recording, documenting, corresponding and hopefully inspiring and motivating our students. Art will always be subjective and difficult to measure, thank goodness. We need to protect creativity by demanding trust and respect for our field.

 

The TN Fine Arts Portfolio is taking advantage of teachers’ unpaid time and could be breeding unethical work practices. If testing corporations deserve to be paid millions of dollars for their work creating and measuring assessments, at least our teachers should be paid a few more thousand for their work doing the same. Arts teachers are pouring in days of unpaid time to complete the portfolio and days of unpaid time to voluntarily score other teachers. Besides, volunteer scoring practices don’t seem to be very effective based on the evidence of the large number of discrepancies. If the TN Fine Arts Portfolio System is here to stay we must compensate our teachers for the time they spend creating their portfolios. Perhaps MNPS or the State of Tennessee could make participation optional and partner with researchers from Vanderbilt or another university to study the process for several years. We need to insist that the arts not be about checking off boxes, forcing student growth, or standardized processes. We need to advocate for trust and respect in order for creativity to flourish in our students’ lives and educational experiences.

This is a list of my specific concerns about the Tennessee Portfolio Model:

– Teachers teaching the same lesson, to the same students, using similar photos and narratives got completely different scores. One of the teachers received a 1 and the other a 5

– Two art teachers co-taught the same students the same lessons and entered exactly the same portfolios. One of the teachers was scored a 4 and the other a 2. When the teacher who scored the 2 spoke to the school board he was told “don’t worry about it, it’s just a number that pretty much goes in your file.”

– An art teacher submitted the same portfolios two years in a row received a 4 one year and a 2 the next

– Some teachers are using and are being encouraged by others to use art out of order to when it was created to show manipulated growth

– The process is very time consuming taking teachers 18 or more hours to complete the submission portion of the process, there is an untold amount of time devoted to photographing and organizing the student work

– Teachers are expected and encouraged to complete this work at home, on weekends, and breaks

– The deadline was on a Sunday, further encouraging teachers to spend their weekend working off work hours

– The deadline was the day before the federal tax deadline which is disrespectful

– The new online system requires teachers to upload an unmanageable amount of documents

– The new online system requires teachers to enter a redundant amount of information

– No feedback has been given to promote growth

– No other teachers are required to spend this gross amount of extra time compiling their own assessments, using their own photography equipment and their personal time

– The training was weak and misinformation has been given over multiple years

– The first year the evaluators were told to “throw out the rubric” dissolving trust and disrespecting the teacher who had carefully studied and followed the rubric

– A middle school teacher had to wait to upload one of her collections because the site wasn’t ready. When she went to upload that collection the day it was due she saw that all of her collections had been deleted. She was told that there would not be an extension for re-entering her submission even though the error was not her fault

– The system does not offer a “landing place” where you can view and review your collections before submitting

– The process of tagging is confusing and seemingly unnecessary

– The evaluators are merely volunteers and when I was an evaluator I experienced the overwhelming volume of portfolios to review.

– Because teachers share student artwork online and other art teachers are viewing this artwork, it is easy for a peer reviewer to know whose portfolio they are reviewing making this a biased process

– Art standards are purposefully vague to encourage creative and subjective works of art. Evaluating student work is subjective, even when using specific criteria. When using specific criteria we are teaching students to check off boxes rather than to truly be creative. It is important to use criteria and to balance that multiple solution paths to solve artistic problems.

– The portfolio is measuring aesthetic rather than the process of creating art

Have a story about the Tennessee Fine Arts Portfolio? Email me at andy@tnedreport.com

 

For more on education politics and policy in Tennessee, follow @TNEdReport

Keep the education stories coming!


 

Mike Stein on the Teachers’ Bill of Rights

Coffee County teacher Mike Stein offers his thoughts on the Teachers’ Bill of Rights (SB14/HB1074) being sponsored at the General Assembly by Mark Green of Clarksville and Jay Reedy of Erin.

Here’s some of what he has to say:

In my view, the most impactful elements of the Teachers’ Bill of Rights are the last four items. Teachers have been saying for decades that we shouldn’t be expected to purchase our own school supplies. No other profession does that. Additionally, it makes much-needed changes to the evaluation system. It is difficult, if not impossible, to argue against the notion that we should be evaluated by other educators with the same expertise. While good teaching is good teaching, there are content-specific strategies that only experts in that subject would truly be able to appreciate fully. Both the Coffee County Education Association and the Tennessee Education Association support this bill.

And here are those four items he references:

This bill further provides that an educator is not: (1) Required to spend the educator’s personal money to appropriately equip a classroom; (2) Evaluated by professionals, under the teacher evaluation advisory committee, without the same subject matter expertise as the educator; (3) Evaluated based on the performance of students whom the educator has never taught; or (4) Relocated to a different school based solely on test scores from state mandated assessments.

The legislation would change the teacher evaluation system by effectively eliminating TVAAS scores from the evaluations of teachers in non-tested subjects — those scores may be replaced by portfolios, an idea the state has rolled out but not funded. Additionally, identifying subject matter specific evaluators could prove difficult, but would likely provide stronger, more relevant evaluations.

Currently, teachers aren’t required to spend their own money on classrooms, but many teachers do because schools too often lack the resources to meet the needs of students. It’s good to see Senator Green and Rep. Reedy drawing attention to the important issue of classroom resources.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

How to Properly Deploy a New Teacher Evaluation System

Like Tennessee, Kentucky has a new teacher evaluation model — The Professional Growth and Effectiveness System (PGES). Similar to reforms in Tennessee, the new model uses multiple measures to evaluate teachers, including classroom observation and student growth.

Unlike Tennessee, Kentucky has rolled out its new evaluation in phases, improving it along the way based on feedback from teachers and administrators.

Here’s a description of how the model, to be fully implemented in 2014-15, has been rolled out:

During the 2012-2013 school year, over 50 school districts in Kentucky have participated in a field test of the new system.  The field test has allowed educator experience and feedback to inform improvements prior to the statewide pilot during the 2013-2014 school year.  During the statewide pilot in 2013-2014, as least 10% of the schools in each district will implement the Professional Growth & Effectiveness System.  In 2014-2015 the system will be fully implemented statewide with full accountability in Spring 2015.

That’s two years of pilot work before a single teacher is held fully accountable for the results of the new system.  Of course, those evaluated get the chance to have their practice informed by the strengths of the new system. But they also are not held back by problems that may need reform or improvement.

Contrast that with Tennessee, which implemented a new evaluation system in 2011-12.  Teachers were responsible for meeting the evaluation standards immediately.  There was no statewide pilot, no partial implementation, testing, and then improvement.  The evaluation has been changed or “improved” along the way, but that process has caused confusion as the standard by which teachers are evaluated seems to change from year to year.

Yes, there are strengths to evaluating teachers through multiple measures. Certainly, the old evaluation system warranted improvement.  But the implementation process directed by the Department of Education failed to adequately take into account teacher and administrator feedback. A more measured approach, as seen in Kentucky, could have helped build educator support and buy-in and could have improved the process without the fear that comes with instant accountability for a previously unused standard.

It’s not too late for Tennessee to “re-launch” it’s evaluation process in light of new Common Core tests.  A suspension of the use of TVAAS for teacher evaluation, as called for by PET and others could allow the state to re-examine the evaluations and phase-in improvements, fully implementing the new system as Common Core tests replace the old TCAP and EOC tests.

Doing so would require a step back from the rapid pace of recent reforms in the state. But the best way forward is not always the fastest. Tennessee would do well to emulate our neighbors, slow down, and focus on getting education reform right.

For more on Tennessee education politics and policy, follow us @TNEdReport