Hi Everyone, this is Tarek Azzam (director of the Center for Evaluation and Assessment at the University of California, Santa Barbara) and Ralph Renger (Just Evaluation Services, LLC, Vail, AZ). We are the co-editors of the Method Note Section of AJE, and we’d love to share our thoughts on the vision for this section.
The Method Note Section highlights new or improved developments in research and evaluation methods, techniques, and tools. We are particularly interested in methods that have been systematically studied, and that can be applied to different types of evaluations. For example, if there are new methodological developments in Qualitative Comparative Analysis (QCA), novel ways of using systems theory in evaluation, or an interesting take on how to use statistical analysis to answer evaluation questions (for example, using meta-analysis to examine the overall effects of a national policy by aggregating across evaluation reports of that policy), then we would love to feature it in the Method Note Section. The Method Note Section is methods neutral, meaning that we welcome articles that enhance qualitative, quantitative, and mixed methods approaches to evaluation. The critical point to consider when developing a method note is to connect it directly to the evaluation process or outcome.
This can be accomplished through exemplars from the author’s evaluation work or other published evaluations. The most common structure for a Method Note Section article is to overview the area of focus or interest, identify a current issue or limitation with a method, and propose then illustrate a solution. This solution is the new development or innovation being presented in the paper, and it typically includes a description of how the new method addresses the issue raised or allows evaluators to answer questions in an improved or more efficient manner. The typical article also provides an example of the new method as applied in a real-world evaluation, followed by a discussion of its strengths and limitations. Some articles also include informational resources to help readers adopt the new method to their work. Overall, the Method Note Section introduces the evaluation community to cutting-edge development that can help enhance the quality and rigor of our evaluations. Method notes are typically between 20-25 pages describing methods and techniques that support effective evaluation practice.
Rad Resource
Here is one of our most cited Method Note articles (it is also ope n source!) that is also very useful and outlines the structure of a Method Note submission:
Abraham, T. H., Finley, E. P., Drummond, K. L., Haro, E. K., Hamilton, A. B., Townsend, J. C., Littman, A.J, & Hudson, T. (2021). A method for developing trustworthiness and preserving richness of qualitative data during team-based analysis of large data sets. American Journal of Evaluation, 42(1), 139-156.
We look forward to receiving new submissions and ushering them through the review and publication process to get smart ideas out there and into use in the field!!
The American Evaluation Association is hosting the American Journal of Evaluation (AJE). All posts this week are contributed by evaluators who work for AJE. Do you have questions, concerns, kudos, or content to extend this AEA365 contribution? Please add them in the comments section for this post on theAEA365 webpage so that we may enrich our community of practice. Would you like to submit an AEA365 Tip? Please send a note of interest to AEA365@eval.org . AEA365 is sponsored by the American Evaluation Association and provides a Tip-a-Day by and for evaluators. The views and opinions expressed on the AEA365 blog are solely those of the original authors and other contributors. These views and opinions do not necessarily represent those of the American Evaluation Association, and/or any/all contributors to this site.