Ignored

Essentially, that’s what’s happened to Tennessee Pre-K/Kindergarten teachers during the portfolio process. They’ve been ignored. The Tennessee Education Association (TEA) reports on how Tennessee’s Department of Education is slow-walking changes to the state’s misguided portfolio evaluation system:

The new law required the committee to review the pre-k/kindergarten growth portfolio model process, identify expectations for the model and areas of improvement, and make recommendations including “ways to streamline the growth portfolio model rubrics and processes” and  “improve the functionality of the growth portfolio platform.”

The portfolio committee was assembled and met July 23, but it did not include any of the outspoken critics of the portfolio system. The meeting was not publicized, and no notice of the meeting was published on the General Assembly’s calendar of events – an unusual deviation from the legislature’s standard practice of publishing meeting calendars in advance. 

The committee developed nine recommendations, which include ensuring that “the technology platform provides teachers an easy-to-use and error-free environment” to submit student work, reducing the peer reviewer pool, simplifying the scoring rubrics, ensuring there is a grievance process, and reducing the number of collections teachers are required to submit. 

“The portfolio review committee recommended developing alternative growth options to be available by 2020-21,” said TEA President Beth Brown. “Based on the testimony we heard in the General Assembly in the spring and the overwhelming response to the TEA portfolio survey, Tennessee students and teachers cannot afford to wait this long.”

Meanwhile, a process that doesn’t work is allowed to continue:

And, according to teachers, the Portfolium platform is pretty frustrating. Kindergarten teachers report frequently receiving the “Uh-Oh” screen and also note they’ve been told not to upload material during the TNReady testing window so as not to stress the state’s computer system. With dump trucks already preparing to attack this year’s test, it’s certainly not reassuring that there are concerns about capacity.

While teachers were raising concerns with legislators, the Department of Education, always eager to call teachers liars, suggested that MOST Kindergarten teachers loved the portfolio model and were enjoying this year’s experience. No, I’m not joking. A TN DOE representative claimed that more than 80% of Tennessee Kindergarten teachers actually liked the portfolio model.

Teachers spoke out. Legislators listened and responded. Now, the Department of Education is doing as little as possible.

For more on education politics and policy in Tennessee, follow @TNEdReport

Your support$5 or more today — makes publishing education news possible.

This is a Joke, Right?

The Tennessee Department of Education continues to demonstrate they don’t give a damn about teachers (or their students) as evidenced by the handling of the Pre-K/Kindergarten portfolio fiasco.

Here’s the latest email from the TNDOE on the portfolio situation and the very, very slow process of developing an alternative:


In August, the department submitted the pre-K and kindergarten (pre-K/K) portfolio review committee report to the House and Senate education committees. One of the recommendations included developing a path forward to support districts in pursuing alternative growth options in lieu of portfolio. The department is working closely with the State Board of Education on potential alternatives with the below timeline:

In November 2019, the department submits proposed alternatives to pre-K/K portfolios on first reading.

In February 2020, proposed alternatives submitted to the board for final reading.

By March 1, the department will communicate to districts a list of alternatives approved by State Board.

Districts will indicate in the annual evaluation flexibility survey any approved alternatives for pre-K/K they opt into for the 2020-21 school year or if they will continue with the current pre-K/K portfolio models.

To recommend an alternative growth option for consideration, directors of schools should submit any proposed pre-K/K alternatives to David Donaldson. All proposed alternatives will be reviewed to determine if they are nationally normed and are valid measures of student growth. We will be accepting proposed alternatives through Nov. 1, 2019. 

Here’s what this means: If you have a child in Kindergarten, they are losing valuable instructional time while their teacher complies with a ridiculous state mandate that Kindergarten teachers have repeatedly said is of little to no value.

Do these portfolios even get graded? NO!

Let’s be clear: Governor Bill Lee is trying to accelerate his voucher scheme (which will harm students) but the state department of education can’t get a portfolio alternative ready in time to actually help students.

What, exactly, is Bill Lee’s education agenda?

For more on education politics and policy in Tennessee, follow @TNEdReport

Your support makes publishing education news possible.

No Approved Alternatives

The Tennessee Department of Education doesn’t give a damn about teachers. At all. Not one. And, apparently, they are also willing to ignore legislators. You know, the people tasked with both making laws and funding budgets. That’s the clear message from the attitude demonstrated by the TNDOE around the issue of Pre-K/Kindergarten Portfolios.

Here’s the deal: On May 10th, Public Chapter 376 became law — it’s legislation designed to create alternatives to the current portfolio disaster. The law states that districts may use the current (failed) portfolio model or “an alternative academic growth indicator approved by the state board of education.”

So, teachers will finally get relief from the fiasco that has been K portfolios.

IF the state has an approved alternative. Which they don’t.

Here’s the text of an email from Jaime Grimsley, Senior Director of Educator Effectiveness at the TNDOE (total bs job title):


The department is working with the State Board of Education to recommend alternative growth options to portfolio in early grades.  At this time, there are no approved alternatives to implement and all districts should move forward with implementing portfolios for the 2019-20 school year. Our goal is to have approved alternatives ready for use in the 2020-21 school year. 

Translation: We didn’t do what teachers asked and what legislators mandated. We don’t want to and you can’t make us.

Here’s more on how the TNDOE has failed educators and students in the portfolio process:


Kindergarten teachers I talked to estimate the evidence collection process takes up a minimum of five instructional days. This means students aren’t actively engaged in the learning process during the evidence collection days. As in the scenario with Eric, it requires the full attention of the teacher (and if possible, an assistant) in order to collect the evidence. This doesn’t include the tagging of evidence or the uploading to an often unreliable online platform known as Educopia. Some districts report hiring subs on evidence collection days so teachers can document the evidence from their students.

Eric’s story is just one more example of a Department of Education that claims victory when the evidence suggests much improvement is needed. It’s a Department hellbent on pursuing supposedly lofty goals no matter the consequences to students or their teachers.
Lost instructional time due to portfolio evidence collection? No problem!
Days of stress and chaos because TNReady doesn’t work? Outstanding!
Teachers faced with confusing, invalid evaluations? Excellent!
Eric and his teachers and Tennessee’s schools and communities deserve better.

So, teachers and students will have to wait ONE MORE YEAR until the DOE actually provides an alternative model. That means your Kindergarten student will be losing instructional time and that teachers across the state will be forced to jump through meaningless hoops in order to meet a ridiculous mandate.

Does the TNDOE care? Nope. Not at all.

Will legislators hold them to account? They haven’t yet, and there’s no sign the current crop of lawmakers or the Governor will do one damn thing to make the TNDOE responsive to the needs of those in classrooms.




For more on education politics and policy in Tennessee, follow @TNEdReport

Your support makes reporting education news possible.

Timely Guidance

By now, readers know the TNDOE’s Kindergarten portfolio system is a complete and utter fiasco. The flawed evaluation system takes time away from instruction and, quite simply, doesn’t work. The state is now on its second vendor in two years of the program. Still, the online system for uploading content is sketchy, at best.

Here’s more on the new vendor:

Since last year, the Department of Education has moved to a new platform for portfolio evaluation — a group called Portfolium. More on this “new” group:


Who is Portfolium?
Portfolium is a startup company designed to provide college students with a way to highlight accomplishments and work samples for future employers. Yes, you read that right: The new evaluation platform is a startup company that was founded in 2013 and just three years ago, began raising a small amount of capital to launch:
Portfolium, a Web-based social network for students preparing to start their careers, said it has closed on $1.2 million in new venture funding, bringing its total funding to $2.1 million since 2013, when the San Diego-based startup was founded.

And, according to teachers, the Portfolium platform is pretty frustrating. Kindergarten teachers report frequently receiving the “Uh-Oh” screen and also note they’ve been told not to upload material during the TNReady testing window so as not to stress the state’s computer system.

Now, just two weeks before portfolio materials are due, teachers are receiving “guidance” from the Department of Education. Here’s the email sent last week late in the afternoon:


Thank you for all you have done so far during this year’s portfolio process. We wanted to provide some additional guidance and reminders to help support you during this final push of uploading and submitting your student artifacts. A walkthrough of how to login, choose a model, and upload artifacts has been provided by Portfolium and can be watched here.


Supported Browsers
It has come to our attention that some educators are having challenges utilizing the platform via Internet Explorer. As a reminder, Internet Explorer is no longer supported by Microsoft (meaning using it will reduce your experience on all websites). It is recommended that teachers utilize Chrome or Firefox when accessing the platform. 
When playing back videos, please be sure that you are using the most updated version of your media software (e.g., Quicktime, Windows Media Player, etc.). 


Supported File Formats
The TEAM Portfolio platform supports multiple file formats which include but are not limited to:
Images: .png, .gif, .jpeg
Documents: .doc, .docx, .pdf
Audio/Visual: .mp4, .mp3, .wav, .wma
For a full list of supported file formats, please see the guidance provided here. Please note that Wi-Fi speeds could impact upload time.
Contacting Technical Support
If an educator is having trouble with the technical aspects of the platform, including slow uploads and/or artifacts disappearing or showing up incorrectly, please utilize the chat feature on the platform itself. The educator having the issue should reach out to Portfolium for support via the chat feature so that they can check the individual account. Please be prepared to share some of the following when contacting Portfolium:


What browser were you using when the problem occurred? Did the problem occur right away or after some time in the platform? Please provide any relevant details around any conditions that were present when problems arose.
Does the problem occur when you use a different browser? 
Was there an error code or any messaging when the issue occurred? 
The chat function is the blue circle at the bottom right-hand corner of the platform screen. This feature allows an educator to interact with someone in real-time during Portfolium’s business hours: 11 a.m. CT/12 p.m. ET – 7 p.m. CT/8 p.m. ET. For after-hours issues, teachers can still utilize the chat feature, but will receive a response on the following business day. Educators may also email support@portfolium.com with technical questions. 
Please note there is no phone number for support. All inquiries should be made by direct chat or email.

So, TNReady starts next week, which means teachers heeding the state’s warning will not be uploading material during the school day. I’ve heard from some teachers that uploading very late in the evening or very early in the morning is a great time to do so because the servers are not overloaded.

To be clear: The Tennessee Department of Education is mandating a disastrous portfolio model while providing little support. This model requires teachers to spend the equivalent of 4-6 days away from direct instruction of students. The platform for uploading materials is not reliable. Teachers either spend hours attempting to upload material OR must do so at extremely odd hours — all with no additional compensation.

How are these portfolios evaluated? Well, last year, that process didn’t really work, either. More on that:

The bad news: That’s because there was no scoring as the state’s vendor, Educopia, could not provide access to the portfolios in order for them to be graded.

To be fair, some portfolios were graded in certain locations before the infrastructure was overloaded and all grading stopped.

This means trained reviewers sat in rooms around the state looking at blank screens instead of assessing portfolios. It means they were fed sandwiches and then told to go home. It means they were promised $500 for the lost day.

While lawmakers debate whether or not to continue the portfolio model in coming years, the state continues to make errors and, subsequently, make the lives of Kindergarten teachers miserable.

Will relief in the form of legislation come this year, or will the Senate Education Committee side with the state and against the trained educators doing the actual work in classrooms every day?

For more on education politics and policy in Tennessee, follow @TNEdReport

Your support makes reporting education news possible.

Fiasco

That’s how one Kindergarten teacher described the state’s portfolio assessment program for teachers at a legislative committee meeting last week. At the final meeting of the House Education Subcommittee on Curriculum, Testing, and Innovation, legislators presented bills that would fundamentally change the way Kindergarten and 1st grade teachers are evaluated. One bill would allow local districts to choose to use the current portfolio model or use an approved alternative evaluation. Another piece of legislation would simply move away from portfolio evaluation altogether.

Readers will remember the story last year that exposed the current portfolio model as a complete failure. Here’s more on that:


Kindergarten teachers I talked to estimate the evidence collection process takes up a minimum of five instructional days. This means students aren’t actively engaged in the learning process during the evidence collection days. As in the scenario with Eric, it requires the full attention of the teacher (and if possible, an assistant) in order to collect the evidence. This doesn’t include the tagging of evidence or the uploading to an often unreliable online platform known as Educopia. Some districts report hiring subs on evidence collection days so teachers can document the evidence from their students.


Eric’s story is just one more example of a Department of Education that claims victory when the evidence suggests much improvement is needed. It’s a Department hellbent on pursuing supposedly lofty goals no matter the consequences to students or their teachers.
Lost instructional time due to portfolio evidence collection? No problem!
Days of stress and chaos because TNReady doesn’t work? Outstanding!
Teachers faced with confusing, invalid evaluations? Excellent!
Eric and his teachers and Tennessee’s schools and communities deserve better.


Many teachers also recall the nightmare that was the portfolio scoring process from last year:


Anyway, after this year’s blame the teachers portfolio event, the state finally agreed to review portfolios and re-score them. In fact, the state offered $500 each to reviewers who would meet at centralized locations and on a single day (September 8th) to assess the portfolios in question. This would allow for immediate feedback and assistance should problems arise.
The good news: No assistance was necessary because problems didn’t arise during the scoring.
The bad news: That’s because there was no scoring as the state’s vendor, Educopia, could not provide access to the portfolios in order for them to be graded.
To be fair, some portfolios were graded in certain locations before the infrastructure was overloaded and all grading stopped.
This means trained reviewers sat in rooms around the state looking at blank screens instead of assessing portfolios. It means they were fed sandwiches and then told to go home. It means they were promised $500 for the lost day.

Since last year, the Department of Education has moved to a new platform for portfolio evaluation — a group called Portfolium. More on this “new” group:


Who is Portfolium?
Portfolium is a startup company designed to provide college students with a way to highlight accomplishments and work samples for future employers. Yes, you read that right: The new evaluation platform is a startup company that was founded in 2013 and just three years ago, began raising a small amount of capital to launch:
Portfolium, a Web-based social network for students preparing to start their careers, said it has closed on $1.2 million in new venture funding, bringing its total funding to $2.1 million since 2013, when the San Diego-based startup was founded.

And, according to teachers, the Portfolium platform is pretty frustrating. Kindergarten teachers report frequently receiving the “Uh-Oh” screen and also note they’ve been told not to upload material during the TNReady testing window so as not to stress the state’s computer system. With dump trucks already preparing to attack this year’s test, it’s certainly not reassuring that there are concerns about capacity.

While teachers were raising concerns with legislators, the Department of Education, always eager to call teachers liars, suggested that MOST Kindergarten teachers loved the portfolio model and were enjoying this year’s experience. No, I’m not joking. A TN DOE representative claimed that more than 80% of Tennessee Kindergarten teachers actually liked the portfolio model.

In any case, the legislation to change portfolios advanced to the full Education Committee in the House. That’s where lawmakers will decide the likely path for next year.

For more on education politics and policy in Tennessee, follow @TNEdReport

Your support makes reporting education news possible.



The State Backs Down


Just one day after the Knox County School Board voted 8-1 to indicate they had “no confidence” in last year’s Pre-K/Kindergarten portfolio evaluation by the TDOE, Commissioner Candice McQueen issued a reprieve of sorts for teachers impacted by what her department has deemed “user error.”

In a communication to district leaders today, McQueen states:

while we will not allow resubmissions, we will re-review educators’ collections in select cases. If a district reviews its submission error cases with impacted teachers and believes it has identified a case in which there was not in fact a submission error, the district can request to have those collections re-reviewed.

 

By Aug. 27, districts will be asked to submit one form with the names of the teacher(s) whom you believe do not have a submission error but were noted as having one, along with their portfolio collection. Those collections will be peer reviewed again. If it is confirmed there is a submission error, the educator will still receive a 1 on that collection and have the opportunity to vacate his or her overall portfolio score. They will also receive feedback on what error they made. If the peer reviewer determines there was no submission error, the collection will be scored and the department will review and post the new score in TNCompass.

Finally, the DOE is beginning to work to correct a process that was time-consuming, disruptive, and not at all helpful to improving instruction.

I was recently able to listen to a group of more than 20 Kindergarten teachers describe their experience with the portfolio process in the 2017-18 school year. All 20 indicated they had at least one collection that received a score of “1.” While this may not have resulted in an overall score below a three for that teacher, it does seem problematic that every single teacher I heard had the exact same experience. At least one collection was given a “1” and there was no explanation — no feedback as to whether it was a submission error or the teacher simply didn’t meet the expected standard.

As someone who has taught college courses for 20 years, if I gave an assignment or test and ALL my students made the same error, I’d think the problem was with the test — either my instructions or the question weren’t clear. My default response would not be that it must be student error, but instead, to ask what can I do to make this item more clear in the future.

Let’s think about this issue some more. McQueen says teachers will get feedback about submission errors if those existed. Shouldn’t these teachers be getting clear, constructive feedback if this evaluation process is actually intended to help improve instruction?

McQueen indicates the scores will be re-reviewed if a district believes there was no submission error. That’s a step in the right direction. However, it raises the question: Who will do the reviewing? Last year ended with questions about whether or not the state had enough reviewers to complete the work. Now, questions have been raised about reviewers not being paid for the many hours they spent assessing portfolios. Will the state be offering additional compensation for those portfolios requiring additional review? Where will they find these reviewers? Will the checks actually arrive?

For now, at least, Pre-K and Kindergarten teachers know their organized, focused action has gotten some result. I know many have been communicating with both district leaders and their legislators. Next, we’ll see if the “new” process for 2018-19 takes into account teacher and district leader feedback and actually creates a reasonable, usable portfolio process.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

User Error


Dear Teachers,

It’s your fault.

It always is.

That’s essentially the sentiment expressed by the Tennessee Department of Education led by Candice McQueen after the latest round of problems, this time with portfolio evaluation of Pre-K/Kindergarten teachers.

The Tennessean has more:

Tennessee’s teacher union is blaming a vendor glitch for issues with some teachers’ low kindergarten and prekindergarten portfolio scores. But the state says the problems are due to user error.

“There was no error by our vendor. The vendor has double-checked all of the peer review scores and everything has been correctly and accurately reported,” according to a statement from Sara Gast, Tennessee Department of Education spokeswoman.

But Gast said Monday that portfolios are reviewed and scored by peers through a rubric. In some cases, Gast said, an educator mismatched students or standards, which made it impossible to score. In that case, she said, educators were given a score of 1.

The Department of Education, an entity with a serious allergy to the truth, is blaming teachers instead of accepting responsibility.

This is the same DOE that seemed surprised when May 15th arrived this year and portfolio reviewers hadn’t been provided guidance:

The initial portfolios were to be evaluated by May 15th. Then, the portfolios with score disputes go on to the “experts.”

Here’s the text of an email about that sent on May 15th:

Dear Educator,

Thank you for all your hard work! The portfolio scoring in the general pool concludes at 11:59pm tonight. The consensus review scoring begins tomorrow, Wednesday, May 16, 2018.

In the event that you were unable to meet your 10 portfolio review requirement (the same as 40 collections) AND you have demonstrated competence during the certification process and/or general pool scoring, you may receive additional portfolios to score. Reviewers who will receive additional portfolio submissions in this next phase and Expert Reviewers will be provided additional guidance to support the scoring process.

Thanks for all that you do! Please look for our next communication in 24 hours.

Here’s a follow-up email sent on May 16th:

Thanks again for your patience and support. We are still developing the guidance documents for the next phase of peer review. Our goal is to make sure you have the most comprehensive and best information to be successful. We appreciate your understanding and will communicate in the next 24-48 hours with updates.

This is also the same DOE that gave teachers one rubric for preparing their portfolios while providing reviewers with a rubric with significantly more difficult standards by which to assess those same portfolios.

Teachers received:

Reviewers were given:

This is the same DOE that set a June 15th deadline for returning scores, then moved it to June 30th, then released the scores last week — in late July.

By all means, let’s give Commissioner McQueen and her department the benefit of the doubt despite all the mishaps during her tenure at the helm.

In Candice McQueen’s world, it’s blame everyone all the time and it’s NEVER her fault or her responsibility.

Never fear, though, the state is now switching to a new platform for portfolio submissions. This means rolling out new training for teachers well after the academic year has started. For teachers in the few districts using Fine Arts Portfolios, this will be the third platform for submission in the last three years. Yes, each year is spent preparing for the portfolio collection and submission AND learning a new platform well into the school year.

If one wonders what Governor Haslam thinks of Tennessee’s teachers, let’s be clear: He’s been standing steadfastly behind Commissioner McQueen. In short, he doesn’t respect our teachers or the work they do.

Frankly, any lawmaker not demanding McQueen be held to account is complicit in this mistreatment of our teachers. The message is and has been clear: Everyone is accountable and responsible EXCEPT the Commissioner of Education. Teachers will continue to pay the price and must go along because no one with authority will stand up and make this stop.

I’d caution those sitting silently to note the teacher uprisings in places like West Virginia, Kentucky, Oklahoma, and Arizona. We may be inviting just this sort of direct action here.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

Eric Goes Back to School


As the 2017-18 school year came to a close, we reviewed the Kindergarten experience of a student named Eric and his teacher. Eric’s teacher was participating in an exciting new mandate from the Tennessee Department of Education known as a portfolio. The idea was to assess that teacher’s ability to impart knowledge by looking at her ability to move Eric and other students from Point A to Point B according to state standards.

Here’s how Eric’s year ended:

Eric has now just about completed Kindergarten. He knows no other “normal” environment for school. Complete the task, be recorded, do it again at the end of the year.

The story doesn’t note the hours his teacher spent tagging evidence and uploading it instead of (or in addition to) preparing for learning activities for her class. The story also isn’t over. The results of the first year of statewide, mandatory Kindergarten portfolios have not been recorded.

Now that the 2018-19 school year is about to start, we return to the questions posed as teachers waited on portfolio review and scoring:

How many parents are aware that their child is spending time in Kindergarten working as evidence collection specimens for a system used to assign a 1-5 number for their child’s teacher? How many know just how much instructional time is lost to this process?

Results?

Teachers were initially told by the Department of Education that results would be back by June 15th. Then, they were told it would be June 30th. Since the TN DOE has never met a deadline it could find ways to miss, June 30th came and went with no scores available to teachers. Also missing: Any clear explanation or accountability from the state.

Finally, on July 26th, the Department of Education sent a memo that included these lines teachers across the state had been waiting for:

The department is excited to announce that early grades portfolio scores (pre-K, kindergarten, and first grade) are now available. TNCompass displays the Teacher Effectiveness Indicator, which will be used as the 35 percent student growth measure in calculating the level of overall effectiveness (LOE);

Finally, after a frustrating year of jumping through hoops and losing instructional time, teachers could see the results. According to the state’s propaganda, these results would help teachers improve future instruction, so all that lost time helping kids would be worth it in the long haul. Plus, all that frustration was just because the system was new, it would get better with time.

But wait, this is the Tennessee Department of Education we’re talking about. It’s not like they have a track record of treating teachers fairly or getting evaluation and assessment right.

So, you’re saying there were problems?

Yes!

Initially, teachers noted relatively low scores. That might be expected in the first year of a new evaluation. However, closer examination revealed the low scores were the result of a grading error. For many teachers, entire sections were not reviewed. When a section was not reviewed, that section’s assessment score defaulted to a 1 – the lowest possible score. Because of this default to a low score, a teacher’s entire portfolio score was impacted.

A number of teachers shared score reports that had one or more sections that had not been reviewed.

What’s going on?

Well, it’s time for another memo from the Department of Education. Here’s what they say happened:

Portfolios are designed to demonstrate student growth across time and for standards which teachers select and are assessed through student work. In cases where evidence of student growth is significantly below expectations, these collections would receive a score of 1.

Collections could also receive a score of 1 because of a mismatch either between samples of students or between the standards that were chosen at Point A and the standards that were chosen at Point B. When the standards are mismatched in either of these ways, those portfolio collections/submissions were both flagged by a peer reviewer and autoscored as a 1. • It’s important to note that, for teachers who used all standards consistently from Point A to Point B for all three samples of students, no autoscore was generated, and the collection was scored by a peer reviewer and an expert reviewer if needed. If the difference between these two scores is more than one performance level, an expert reviewer scores the collection/submission, providing an additional level of review. If an expert reviewer scores a collection/submission, those scores are considered final.

So, a teacher who has the highest possible score on three sections and a 1 on a single section either demonstrated below expectations growth OR mismatched the collection and the standard — in other words, it was the teacher’s fault.

An analysis of department guidance by staffers at the Tennessee Education Association noted:

Based on the TDOE’s initial guidance, the cause of the debacle is a glitch in the Educopia platform that allowed a “mismatch” to occur between the two data collection points.  According to TDOE, this mismatch could result in one of two ways, either from a lack of continuity in the student sample or in the standard selected.  Apparently, the Educopia platform allowed erroneous mismatched data to be submitted without alerting the submitter to the apparent mismatch.  When that happened, the platform proceeded to “autoscore” the mismatched collections assigning a default score of “1” rather than flagging such collections for further human review and possible correction. This procedure was not in accordance with the TDOE’s published guidance.

 

The Hotline reviewed all of the TDOE guidance prior to the release of the portfolio scores and it appears there was nothing to advise teachers that errant mismatched data submissions were possible, or that such mismatches could result in an autoscore of “1” for the collection.  To the contrary, TDOE’s guidance repeatedly suggests all collections would be subjected to a progressive human review process in response to any discrepancies greater than one performance level.  So not only does it appear there was no way teachers reasonably could have known these mismatch errors could occur, there was nothing to alert teachers to the possibility such mismatched collections could receive an autoscore of 1 without later being reviewed.

Look at that again: The Tennessee Department of Education — the same department that blamed this year’s TNReady problems on non-existent hackers and incredibly powerful dump trucks — is now blaming the Pre-K/K portfolio problems on a computer glitch. Boy, we sure do have bad luck with testing and evaluation vendors. I’m sure glad our DOE is not to blame, that’d be terrible if they were held accountable for all these crazy coincidences.

A New Approach

Thankfully, Eric has been happily enjoying his summer, blissfully ignorant of the challenges his teacher is having with all that portfolio madness. Now, though, he’s ready to go back to school and the teachers are feeling defeated as their Commissioner of Education and the department she leads continue to disrespect them.

Good news! Now, the DOE is going to provide a new portfolio vendor — one without all those pesky glitches! Here’s more on that:

One way that we plan to reduce the amount of time for portfolio development and provide enhanced support is through a partnership with Portfolium, Inc. to give educators a new e-portfolio platform: TNPortfolio. TNPortfolio will house TEAM portfolios in 2018-19, and in the future, it will support educator micro-credentialing and Work-Based Learning Student ePortfolio systems. In supporting the TEAM student growth portfolios, the platform provides functionality that will automate and improve several processes associated with portfolio development. The improved platform will allow schools to track student work samples longitudinally across multiple years. The TEAM Portfolio element of the platform will be available for teacher use on Aug. 24. On that date, you will receive an email from portfolium.com to access the system for the first time. All portfolio scoring guides and other resources will be available on that date.

YAY! A new, better vendor. Where have we heard this before? This is coming from the same Department of Education that fired Measurement, Inc. from TNReady and hired Questar. Both of them flopped. Then, in an attempt at trickery, the DOE announced Questar was being replaced by the company that owns Questar?!?

Still, there’s hope, right? I mean, this new vendor, Portfolium, is a tried and true teacher evaluation provider ready for the task, right? Well, maybe…

Here’s a bit more about the new company taking over the portfolio process — not just for Pre-K and Kindergarten teachers, but for all teachers submitting portfolios:

SAN DIEGOJuly 26, 2018 /PRNewswire-PRWeb/ — The Tennessee Department of Education has awarded the contract for its TEAM student growth portfolio, student Work-Based Learning, and educator micro-credential ePortfolio systems to Portfolium, Inc., the only Student Success Network.

Portfolium’s TNPortfolio platform, which can accommodate up to 500,000 users, will allow Tennessee teachers to demonstrate the impact of classroom instruction on student growth through the TEAM student growth portfolio, allow students to demonstrate the value of the education they’re receiving through work-based learning, and allow educators to acquire and maintain micro-credentials earned through personalized professional learning. The TEAM Portfolio element of the platform will be available for teacher use starting August 24; other elements of the platform will be available for use during the 2019-20 school year.

Note that the Portfolium press release announcing the awarding of the State of Tennessee contract came on July 26th, the same day as the state’s memo to teachers regarding this year’s portfolio scores.

Who is Portfolium?

Portfolium is a startup company designed to provide college students with a way to highlight accomplishments and work samples for future employers. Yes, you read that right: The new evaluation platform is a startup company that was founded in 2013 and just three years ago, began raising a small amount of capital to launch:

Portfolium, a Web-based social network for students preparing to start their careers, said it has closed on $1.2 million in new venture funding, bringing its total funding to $2.1 million since 2013, when the San Diego-based startup was founded.

I mean, sure, this could work out great. But let’s be cautious — this is a partnership between a Department of Education with a record of failed testing ventures and a startup company seeking to expand market share. What could go wrong?

Oh, and all that time and energy teachers spent learning how to use Educopia? Gone out the window. Time to learn a new platform and see if it works.

In fact, the DOE plans to roll out training for the new platform via webinar on August 23rd. Teachers will have login credentials for Portfolium on August 24th.

Parents, you should be aware that your child’s Pre-K/K teachers may be just a tad frustrated as the year starts — it’s probably not your kid (I mean, it might be). It’s most likely the poor treatment they are receiving at the hands of the Tennessee Department of Education.

How much longer must we tell Eric’s story before policymakers in Nashville make changes that support rather than deflate our teachers?

Have a portfolio experience you’d like to share? Email me at andy@tnedreport.com

For more on education politics and policy in Tennessee, follow @TNEdReport


 

 

 

Shrinking TNReady


That’s the hope behind a resolution passed by the Johnson City Board of Education this week.

The Johnson City Press reports:

Some changes included shrinking testing timing back from three weeks to one week for grades 3 through 8, pushing the writing assessment back to February to give the state more time to get grades in by the end of the school year, and drawing back on pre-K and kindergarten ELA assessments to be less time-consuming for teachers.

The proposal comes after another year of testing trouble in Tennessee. In fact, a recent report noted that while most states transitioning to online testing are doing so smooth, Tennessee is the one glaring exception.

Broad Support?

Now that the Johnson City School Board has given unanimous approval to this proposal, the Director of Schools hopes to spread the message to other districts and build support for changing TNReady:

What I’d like to do if the board approves this resolution is reach out to all the other school superintendents and talk to them about the resolution and get feedback from them,” Barnett said at the meeting. “I think we’d have some support.”

It’s possible this is the beginning of a move that will see district leaders stand up to the state and say “Enough!”

The Board also referenced the problematic implementation of portfolios to evaluate teachers in Pre-K/Kindergarten:

Anderson said that the state estimated those assessments would take about 15 to 17 hours, but some teachers reported spending as many as 44 hours on the project, most of that time being spent in the English Language Arts component of the assessment.

She added that portfolio assessment is considered an appropriate avenue to track student learning in those early grades, and the portfolios can be completed with video or audio taping or with written assessment.

“I don’t think anybody has anything against the concept of portfolios for pre-K (and kindergarten),” she said. “Though the piloting process went fairly well, it ended up morphing into a process this past year that I think was just very complicated and very unwieldy.

It will be interesting to see how the state moves forward in revising those portfolios and if there is any move toward making significant change in the TNReady tests.

For more on education politics and policy in Tennessee, follow @TNEdReport


 

Give Me My Money Back


If you thought Eric’s Story was the last word in the saga that is this year’s Kindergarten portfolio evaluation, you’d be wrong.

True to form, the Tennessee Department of Education has created another mess in the ongoing quest to catch and eliminate all those “bad teachers.”

In our previous visit to Kindergarten, here’s a bit of what we saw:

Moving on to the scoring process, each teacher self-scores the submitted portfolio. Then, another teacher evaluates. If the scores are more than two levels apart, an “expert” receives the portfolio to make a determination.

What do those experts have that the initial teacher evaluating did not? First, a willingness to assess even more portfolios. Second, “guidance” from the Tennessee Department of Education.

The initial portfolios were to be evaluated by May 15th. Then, the portfolios with score disputes go on to the “experts.”

Here’s the latest challenge: Portfolio evaluators were to evaluate 40 collections (10 portfolios) in order to complete their paid assignment. These teachers were paid $500 from the state for what was estimated to be 15 hours of work. Kindergarten teachers who are evaluators indicate the process takes more like 40-45 hours of work. At the end of May, as school years ended around the state, many portfolio evaluators had also completed their assessment of a minimum of 40 collections. Or so they thought.

Here’s an email a number of evaluators recently received (I have a copy of one sent June 1st):

Dear Peer Reviewer,

Based on the most current Educopia reports, you have not made progress in completing your commitment of 40 collections (=10 portfolios). Not completing this commitment may affect your stipend and/or future leadership opportunities in the portfolio work.

If you have questions and/or concerns, please let us know how we can assist you. If you are no longer able to review, you must notify your district point of contact.

Here’s an earlier email noting the expectations (sent April 25th):

Dear Peer Reviewer,

 

Thank you so much for your contribution to the peer review process! As some of you have already started live scoring, you may have noticed that you are able to keep track of the number of your scored submissions (collections). As stated in the Peer Review General Training Overview, the workload expectation is that reviewers score 40 submissions (collections). In the event that collections continue to be sent to your rater que after you have met this expectation, please know that these will be recirculated to other peer reviewers for scoring.

Here’s the problem:

Evaluators receiving the first email (indicating they had not completed the required minimum number of evaluations) were provided information via Educopia (the online platform for submitting/evaluating portfolios) saying they had completed evaluation of at least 40 collections.

Why are these same evaluators being told they have more work to do and also told the state is coming for their money?

Further investigation indicates that Educopia counted “practice” evaluations toward the initial total of 40. So, teachers conducting evaluations believed they had completed the process when some had as many as six actual portfolios remaining.

Now, the Department of Education is left with a number of unrated portfolios while evaluating teachers believe they are finished (and most likely have been paid).

Imagine that… the Tennessee Department of Education utilizing an online assessment platform that fails to deliver expected results!

Now, the question is: Will they come after teachers to claw back the meager stipends? How will the remaining portfolios be evaluated, or will they be evaluated at all?

Stay tuned…it’s still early this summer and the deadline for completion of this portfolio assessment has been extended until June 30th.

For more on education politics and policy in Tennessee, follow @TNEdReport

Keep the education news coming!