Hi! We’re Ghazia Aslam and Sarah Lunsford of EnCompass LLC, with some tips on the “virtues” of virtual data collection.
Virtual data collection has many benefits. With this year’s restrictions on travel, effective virtual data collection has become even more important. It can be quick to deploy, reduce cost and environmental footprint, achieve high coverage, and include geographically dispersed stakeholders who might not participate if data is collected in person.
It also has challenges: reduced participation, careless or incorrect responses survey fatigue, data security, connectivity—especially for marginalized and vulnerable populations—and difficulty in keeping participants interested. As evaluators, we need to engage with these challenges, including potential biases they can introduce.
We asked colleagues who have collected data virtually for many evaluations, long before the pandemic, to gather these tips for more effective virtual data collection.
Invest in trust building before and during data collection. Building trust is essential, especially with marginalized and vulnerable respondents. Already a challenge during in-person data collection, this is even harder virtually, since we cannot see body language. Our colleagues build trust before and during data collection, first by clearly sharing the purpose of the evaluation, so participants know what to expect, and information about data security and confidentiality. During data collection, we honor respondents’ choice to participate by building in multiple opportunities to revisit their consent.
Be creative and use multiple methods. Virtual platforms facilitate the use of methods that are less common during in-person data collection. For example, using photo, voice, and video elicitation, diaries, journals, and voice memos becomes easier when we are collecting data virtually.
Use methods that hold respondents’ attention. Participatory methods like social, community, or body mapping, free lists, ranking, diagramming, timelines, and photo voices can all support respondents’ engagement, and are well suited for virtual platforms.
Collect data asynchronously using multiple applications. Asynchronous data collection empowers respondents because they can choose when to respond to the data collector’s inquiry. They have time to consider their answers and can share materials to support their responses. It also helps us; we gain time to look through the materials before posing additional questions. This can produce thoughtful exchanges in which we and our respondents both have opportunities to consider, clarify, and expand our meaning.
Asynchronous data collection can take place on platforms requiring less bandwidth than synchronous video interviews—voice memos, WhatsApp, video messages, or even email. Thus, we can reach respondents who lack reliable internet service. Online discussion forums are another good platform, because respondents can react to and build on messages from other participants.
Tailor communication channels and technology to the respondents. Select the platforms people actually use in the locations and populations where you are collecting data. Using different channels with different respondents allows us to reach as many individuals as possible. Be careful to maintain consistency, though, by asking the same questions of all stakeholders.
For more tips, please check out our brief on the Virtues of Virtual MEL.
Do you have questions, concerns, kudos, or content to extend this aea365 contribution? Please add them in the comments section for this post on the aea365 webpage so that we may enrich our community of practice. Would you like to submit an aea365 Tip? Please send a note of interest to email@example.com. aea365 is sponsored by the American Evaluation Association and provides a Tip-a-Day by and for evaluators.
2 thoughts on “ITE TIG Week: Hot Tips for Effective Virtual Data Collection by Ghazia Aslam and Sarah Lunsford”
Hello Ghazia and Sarah,
I think making data collecting be less monotonous and repetitive is a great way to motivate participants into doing good surveys. I agree that although doing everything virtually can become a bit tedious, it is beneficial in many ways as well.
Ghazia and Sarah,
Thank you for sharing this valuable information and hot tips for effective virtual data collection. I work in post-secondary education in Ontario, Canada and find it difficult to collect reliable, accurate data, especially during a remote, online academic year. As you mention in your post, the challenges we face are low response rates and survey fatigue. I really appreciate your recommendation of utilizing creative platforms and methods to increase respondent interest and attention, to increase engagement. Lately, to increase response rates, we have offered incentives (i.e., entered to win a $100 gift card) for completing surveys. What are your thoughts on incentivizing surveys? My worry is that although this may increase responses, is the data collected accurate and truthful.
Thank you again for your amazing tips! I look forward to researching new technologies and methods for collecting data.