Welcome to aea365! Please take a moment to review our new community guidelines. Learn More.

AHE TIG Week: Harnessing Big Data in Higher Education: Evaluators as Data Scientists by Stephanie Fuentes

This week is sponsored by our colleagues in the Assessment in Higher Education (AHE) TIG. Today’s contribution is an evergreen post about a topic so relevant, it’s worth a second read.

-Liz DiLuzio, Lead Curator


I’m Stephanie Fuentes, an institutional researcher for a small, for-profit college and I’m totally fascinated by the hype around data scientists and predictive analytics. Tom Davenport and D.J. Patil call it the sexiest job of the 21st century (according to an often-cited Harvard Business Review article). Who knew evaluators were in such demand?

As evaluators we don’t often get a lot of press about the technical and deep nature of our work to investigate questions of interest that yield results that get used. We understand the complexities and context that drive data.

What can you do as an evaluator to better position yourself in the big data movement?

Lessons Learned:

Know what big data can and can’t do. Just because you know “what” doesn’t mean you know “why”. It takes the “why” to move the needle on many metrics important to organizations. Evaluators are experts at finding and leveraging the why.

Partner with other experts. Data scientists are often described as unicorns. Why is that? Because it’s extremely difficult to develop skills in both evaluation and in programming simultaneously. Following on the prior point, just because you have data doesn’t mean it’s useful. Evaluators bring balance. Find technical partners in IT, programming, and database administration to help you bring data and meaning together. The real breakthroughs happen in cross-disciplinary relationships among experts.

Expect evolution. The Big Data movement has only been possible in the past few years because of technological advances in data collection and storage. There’s more data out there than we have the time to analyze. Think about how easy it is to collect, and how hard it is to develop a focused question to get an answer from that vast sea of data. Someone has to think through how to use that data meaningfully. The ability of individuals to ask intelligent questions that generate usable results is just being realized.

There are new communities of data scientists being hosted by both companies (like IBM) and organic groups (LinkedIn). If you don’t already know what competencies evaluators should be able to demonstrate, pick up a copy of Evaluator Competencies (a must-have for evaluators’ performance reviews).

Hot Tip:

To keep tabs on how the Big Data movement is evolving, monitor the HBR Blog Network postings. The most current thinking on this movement is often featured here.

Above all, keep asking questions. Big Data has not replaced the value of being able to think.

Rad Resource:

Check out this handout in the AEA Public eLibrary from my recent AEA Coffee Break Webinar.


The American Evaluation Association is hosting Assessment in Higher Education TIG Week. The contributions all this week to AEA365 come from AHE TIG members. Do you have questions, concerns, kudos, or content to extend this AEA365 contribution? Please add them in the comments section for this post on the AEA365 webpage so that we may enrich our community of practice. Would you like to submit an AEA365 Tip? Please send a note of interest to AEA365@eval.org. AEA365 is sponsored by the American Evaluation Association and provides a Tip-a-Day by and for evaluators. The views and opinions expressed on the AEA365 blog are solely those of the original authors and other contributors. These views and opinions do not necessarily represent those of the American Evaluation Association, and/or any/all contributors to this site.

Leave a Comment

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.