Linda Suskie

  A Common Sense Approach to Assessment & Accreditation

Blog

Barriers to using assessment results

Posted on June 6, 2015 at 6:40 AM

I’ve heard assessment scholar George Kuh say that most colleges are now sitting on quite a pile of assessment data, but they don’t know what to do with it. Why is it often so hard to use assessment data to identify and implement meaningful changes? In my new book Five Dimensions of Quality: A Common Sense Guide to Accreditation and Accountability (Jossey-Bass), I talk about several barriers that colleges may face. In order to use results…

 

We need a clear sense of what satisfactory results are and aren’t. Let’s say you’ve used one of the AAC&U VALUE rubrics to evaluate student work. Some students score a 4, others a 3, others a 2, and some a 1. Are these results good enough or not? Not an easy question to answer!

 

Compounding this is the temptation I’ve seen many colleges face: setting standards so low that all students “succeed.” After all, if all students are successful, we don’t have to spend any time or money changing anything. I’ve seen health and medicine programs, for example, set standards that students must score at least 70% on exams in order to pass. I don’t know about you, but I don’t want to be treated by a health care professional who can diagnose diseases or read test reports correctly only 70% of the time!

 

Assessment results must be shared clearly and readily. No one today has time to study a long assessment report and try to figure out what it means. Results need to “pop out” at decision makers, so they can quickly understand where students are succeeding and where they are not.

 

Change must be part of academic culture. Charles Blaich and Kathleen Wise have noted that the tradition of scholarly research calls for researchers to conclude their work with calls for further research for others to make changes, not acting on findings themselves. So it’s not surprising that many assessment reports conclude with recommendations for modifications to assessment tools or methods rather than to teaching methods or curriculum design.

 

Institutional leaders must commit to and support evidence-based change. Meaningful advances in quality and effectiveness require resource investments. In my book I share several examples of institutions that have used assessment to make meaningful changes. In every example, the changes required significant resource investments: in redesigning curricula, offering professional development to faculty, restructuring support programs, and so on. But at many other colleges, the culture is one of maintaining the status quo and not rocking the boat.

 

I am honored and pleased to be one of the featured speakers at Taskstream's CollabExLive! on June 22 at New York University's Kimmel Center. My session will focus on the first two of these barriers: having clear, justifiable standards and sharing results clearly. This session will be especially fun because we'll be working with simulated TaskStream reports. I hope to see you!

 

 

 

Categories: Clearing the Fog, Upcoming Events

Post a Comment

Oops!

Oops, you forgot something.

Oops!

The words you entered did not match the given text. Please try again.

2 Comments

Reply ★ Owner
9:03 AM on June 20, 2015 
Excellent point, Monica! Sometimes there's no one clear strategy, and all I can do is suggest some things for faculty to consider (curriculum design, teaching strategies, placement, support services, etc.). Sometimes trial and error is needed, which requires a campus culture that encourages innovation and even some risk-taking. I hope you have a wonderful day too!
Reply Monica Stitt-Bergh
3:54 PM on June 19, 2015 
I agree with your four barriers. Thanks for sharing the post. Lately, I've been thinking about a 5th: not knowing what change to make. Perhaps this could fall under your "support evidence-based change." If faculty know what satisfactory results are, see results that "pop," are willing to change, and have support, but are unclear what change to make, it's a problem. My latest dream is for a small team of terrific faculty/educators who can help faculty make confident decisions about which modifications are likely to improve the program and then to support the faculty in the modification(s), whether it be changing entrance requirements, redesigning curricula, or changing hiring practices. Have a wonderful day!