Hello! Welcome to the Needs Assessment (NA) TIG Week on AEA365. As the AEA proposal process for the 2024 AEA conference in Portland is underway, the NA TIG invites you to submit a proposal, volunteer to be a proposal reviewer, or simply join our TIG in your AEA profile. Reach out to our TIG Chair Lisle Hites for more info.
I’m Ryan Watkins and I’m a professor at George Washington University, program director of the Educational Technology Leadership (MA) program, and faculty lead of the interdisciplinary Human-Technology Collaboration (PhD) concentration (research lab). I’ve authored 12 books and over 100 articles/chapters, and developed several web platforms (including Code2Learn, We Share Science, SciencePods). I also maintain www.needsassessment.org.
Lessons Learned
1st Obstacle: “We need…”
Unfortunately, needs assessment conversations often start (wrongly) with this statement, “We need…”. Operate cautiously when a predetermined “solution” to a problem (e.g, we need more teacher training to solve poor student test scores) is given by stakeholders. Remember, a need is defined as the gap between current and desired results. Learning about needs first can help you, later, to prioritize the right solution(s) to close that gap. To overcome the “we need” obstacle:
- Flip the solutions-before-results mindset.
- Focus the conversation on the results stakeholders want to achieve (e.g., improvements in student knowledge and abilities)
2nd Obstacle: Performing is not performance
Just because a person is performing tasks (e.g., buying new textbooks) doesn’t mean that they are necessarily achieving desired the performance/results (e.g., improved student knowledge). To overcome this obstacle:
- Differentiate between performance and performing in your planning, data collection, analysis, and reporting.
- Don’t offer solutions before you have defined the need (then set criteria for comparing possible solutions).
- Use performance standards defined in the needs assessment as guides for designing an appropriate evaluation.
3rd Obstacle: Speaking their language
As needs assessors, we face language and terminology challenges. To overcome this obstacle:
- Identify and learn the language of your stakeholders (e.g, city planners, nurses).
- Use their language to define your language.
- Model your language carefully and religiously in order to communicate across professions with necessary precision.
4th Obstacle: No time, no money
Needs assessments are commonly undertaken when there is increased urgency for improved performance. But you’ll often hear the “no time, no money” mantra. To overcome this obstacle:
- Vary the scope of your needs assessment appropriately.
- Focus clearly on the results that matter most to the organization, its direct and indirect stakeholders, as well as our shared society.
- Sell the value of the needs assessment in terms of cost-saving derived from informed decision-making.
5th Obstacle: Analysis paralysis
Needs assessments must end at some point – despite tendencies toward wanting more data or analysis. To overcome analysis paralysis:
- Set parameters for what information is essential to inform justifiable decisions.
- Make a data collection and analysis plan, then stick to it.
- Avoid “scope creep” which will lengthen the assessment beyond what is required to make critical decisions.
- Use existing sources of data whenever possible, even if they are not “perfect”.
Rad Resources
Check out www.needsassessment.org (and the redirect site https://na.weshareresearch.com/ for a comprehensive list of all things ‘needs assessment’).
The American Evaluation Association is hosting Needs Assessment (NA) TIG Week with our colleagues in the Needs Assessment Topical Interest Group. The contributions all this week to AEA365 come from our NA TIG members. Do you have questions, concerns, kudos, or content to extend this AEA365 contribution? Please add them in the comments section for this post on the AEA365 webpage so that we may enrich our community of practice. Would you like to submit an AEA365 Tip? Please send a note of interest to AEA365@eval.org. AEA365 is sponsored by the American Evaluation Association and provides a Tip-a-Day by and for evaluators. The views and opinions expressed on the AEA365 blog are solely those of the original authors and other contributors. These views and opinions do not necessarily represent those of the American Evaluation Association, and/or any/all contributors to this site.