AEA365 | A Tip-a-Day by and for Evaluators

Jul/13

15

Michelle Baron on Building a Culture of Assessment

Well, hello there! I’m Michelle Baron, Academic Assessment Specialist at Utah Valley University, and an Independent Evaluation Strategist.

I’d like to share some tricks of the trade with you in building a culture of assessment in higher education. As an evaluator, the main idea for me is helping people understand what works, why it works, and how to use the resulting ideas and information to improve programs and organizations. These same principles apply directly to building a culture of assessment in higher education.

Why build a culture of assessment?

Building a culture of assessment in institutions of higher education is a multi-faceted process filled with both successes and potential pitfalls. Evaluators must take into account many internal and external factors, including, but not limited to, the following:

  • National and specialized accreditation requirements
  • Federal, state, and local government education policies and standards
  • Internal ease of access to information through institutional research or other entities
  • Internal capacity of entities to take the initiative for assessment activities
  • The willingness and ability of entities to use assessment results to enhance student learning and strengthen programs

Hot Tip #1: Speak their language:

Many times organizations do assessment, but because they may use different terminology, there is often a disconnect between the evaluator and the organization in communicating ideas and information. Understanding the terms they use and using them in your conversations helps get the message across more smoothly.

Hot Tip #2: Keep assessment visible:

In the daily activities of faculty and staff members, assessment is often last on their to-do list – if it’s there at all. I make a point to meet early and often with associate deans, department chairs, and assessment coordinators to help them develop and use assessment in their areas of responsibility. Regular communication with these entities keeps assessment at the forefront of their minds and helps them to make connections between assessment and their other activities (e.g., teaching courses, engaging in research, developing strategic plans).

Hot Tip #3: Recognize assessment champions:

There are often many people within an organization who see the benefit to assessment and actively use it in their departments and programs. I take opportunities to recognize these assessment champions in meetings and other public events and activities. This not only validates their efforts and helps them know their work is well received, but recognizing them also introduces them to other members of the campus community as potential assessment resources.

Do you have questions, concerns, kudos, or content to extend this aea365 contribution? Please add them in the comments section for this post on the aea365 webpage so that we may enrich our community of practice. Would you like to submit an aea365 Tip? Please send a note of interest to aea365@eval.org. aea365 is sponsored by the American Evaluation Association and provides a Tip-a-Day by and for evaluators.

· · ·

9 comments

  • Michael Carter · November 16, 2017 at 11:24 pm

    Hi Michelle,

    It looks like I am not the first one responding to you who is a graduate student from Queen’s University. I am also new to the world of evaluation and teach at a Community College in Toronto.

    I found your article to be very interesting as I would love to create a culture of assessment at our school. However, as you mention, there can be some challenges with this as the management does not show a “willingness and ability…to use assessment results to enhance student learning and strengthen programs”.

    We perform student evaluation surveys and measure program success, but management seems resistant to examining the results of these assessments. I decided to gently question a manager about this and she stated that she did not believe in assessments because she had one bad experience as one student she had while teaching gave her a negative assessment and it hurt her reputation at the school. She claimed that other managers had similar experiences.

    This is why I like the advice that you give as it seems very positive and may be able to help this manager get over her bad experience and take assessments more seriously.

    I am going to follow your advice and see how it works by speaking the language of my managers (team-building), keeping assessment visible by always reminding them how important it is, and recognizing other faculty members who are assessment champions (some seek out feedback from students without being prompted). Is there anything else I can do to get this manager over her bad experience with assessments to create a culture of assessment?

    Thanks,

    Mike

    Reply

    • Michelle Seidling · November 23, 2017 at 1:28 pm

      Hi Mike,

      I’m glad to see that Queens University is alive and well with regard to evaluation and student assessment. 🙂

      It sounds like you have a great handle on student evaluations and other aspects of assessment. It is important, however, to distinguish between assessments as students rating teacher performance and assessments as evaluating student learning. There is a distinct difference that is often overlooked.

      It sounds like some of the managers there are focusing on assessment as evaluating teacher performance. You may want to talk to them one on one terms of what specifically happened in that situation and do your best to alleviate any fears or concerns. Hopefully they will not allow that one incident to define them and be able to move on in terms of evaluation.

      It is also important to help them understand that assessment is not only about teacher performance, but it is also about student learning. Yes, the faculty members have a lot to do with student learning, but that’s not the only aspect of student learning with regard to assessment. Student assessment also involves goalsetting with regard to programs and courses, and providing opportunities for student learning using a variety of methods.

      As you continue to speak with managers and faculty members, I would encourage you to help them understand the breadth and depth of student learning and help them to move forward in a way that helps students to progress in a variety of ways for their success.

      I wish you all the best as you continue in your evaluation and assessment endeavors!

      Michelle

      Reply

  • Kerry Drake · August 10, 2017 at 5:37 pm

    Michelle,

    I am currently completing my Masters of Education at Queen’s University in Canada and I am fairly new to the world of evaluation. Your idea of “building a culture of assessment” really resonated with me. I currently work in a post secondary educational environment where assessment is somewhat of a constant, whether it be for student learning, or for the effect of the program itself. After reading your post, it encouraged me to look into other aspects of the “culture of assessment” leading me to some excellent resources on the subject matter.

    One such resource was from Ryerson University in Toronto Canada, http://ryersonstudentaffairs.com/what-is-a-culture-of-assessment/ and within this, the questions was posed “So what can you do, personally, to contribute to our assessment culture?” I did not consider that I am in a position to be involved in assessment essentially daily.

    After reading your post, I am very excited to start to find a way to become an “assessment champion” of my own and then be able to coach others to do the same.

    Kerry Drake

    Reply

    • Kerry Drake · August 10, 2017 at 5:40 pm

      Do you have any suggestions or strategies to get the process started?

      Reply

      • Michelle · August 22, 2017 at 1:57 pm

        Hi Kerry,

        Thanks for your comments. Your enthusiasm for building a culture of assessment is contagious! I enjoyed reading about how you are catching the vision of assessment.
        I strongly believe you are already on the road toward becoming an assessment champion with the education and experience you have acquired so far.

        Here are three recommendations to get you started:

        1. Build an environment in which assessment can thrive. Look at the environment in which you work or are associated with. Is the focus on people just “doing their job”, or are people interested in a process of improvement? Creating openness in communication and sharing ideas is a great first step to building trust within the organization – which is how assessment develops.

        2. Ask the right questions. Building a culture of assessment involves going beyond the surface and asking the tough questions such as, “Why does something work/not work? What are the goals (of a program, process, etc.)? How well are those goals communicated? Are there other factors to success that have not been addressed?” Demonstrating your genuine interest and commitment to success can help get people thinking in the direction of assessment.

        3. Find and communicate success stories. There are often little bits of assessment going on in organizations. They may be called by different names. They may not be given much attention. Call out those stories and dig deeper to understand both the magnitude of the success and what it would take to replicate across the organization.

        I hope these starting points are helpful for you. I look forward to hearing from you along the way as you become an assessment champion and help those around you to do the same.

        All the best,

        Michelle

        Reply

  • Megan · July 17, 2013 at 1:23 pm

    This is great: “I take opportunities to recognize these assessment champions in meetings and other public events and activities.” How do you recognize them? We are starting a research to practice / evaluation use in our organization and I think recognition would be a great incentive.
    Thanks!

    Reply

    • Michelle Baron · July 19, 2013 at 12:34 pm

      Hi Megan,

      Congratulations on starting a research to practice/evaluation use program! I hope it’s going well so far.

      We recognize assessment champions in our monthly meetings with the colleges/schools, during our presentations at Faculty Convocation (a welcome back event for the faculty held in the fall) and Summer University (a professional development event for staff members held in the spring), and by publishing success stories on our Academic Assessment website (www.uvu.edu/academicassessment). We are also planning to begin a monthly spotlight of faculty and staff members who actively use assessment to strengthen their programs and enhance student learning.

      I hope this information helps. Best of luck to you with your evaluation/assessment program.

      Michelle

      Reply

  • Tricia Griffin · July 16, 2013 at 3:32 pm

    Hi,
    Thanks for your comments they are so valid. I am an Academic Advisor at The Western Institute of Technology at Taranaki in New Zealand which is your equivalent to a community college and we have been working hard to build a culture of evaluation/self assessment which includes assessment. This has definitely meant that we have encountered and had to deal with many pitfalls and successes along the way. We have champions but they are hard to keep as their workload can take over so easily, we try and ensure that everyone is aware of what is expected, required and by when through newsletters, email and meetings but they tend to only start to do something once we point out the consequences of not complying instead of building the requirements into their ongoing teaching/workload.
    So thank you for your comments/tips I will bring them to everyone’s attention.

    Reply

    • Michelle Baron · July 19, 2013 at 12:42 pm

      Thank you, Tricia, for all you do at your institution.

      You may also want to consider using more of the carrot than the stick, so to speak. Emphasizing the visibility and benefit of assessment information for more informed decision-making, for promoting programs and services, and for partnering with various organizations will likely help to be a positive motivator for them to keep the assessment momentum going and for enlisting the help of other staff and faculty in the process.

      I hope the tips will be helpful for you and your associates.

      Best,

      Michelle

      Reply

Leave a Reply

<<

>>

Archives

To top