Intended Learning outcomes
This page is designed to help you:
Better understand the differences between qualitative and quantitative data collection
Advocate for a mixed methods approach
Strengthen your knowledge of when to apply certain methods
What are data collection methods?
Methods are ways of collecting and analysing data. Data can be collected in a number of ways - the most common methods are through surveys, interviews, focus groups and observations. You might also consider how you measure more quantitative change: interaction with your online collections or website, engagement with social media, location-tracking, use of your API, etc. Each of these data sources can give you interesting information to triangulate with more qualitative information.
Whatever type of impact you are most interested in measuring, how you collect your data will generally fall into one of two categories: qualitative or quantitative methods. It’s important to know the pros and cons and to think about how you can balance a mixed methods approach.
Qualitative vs quantitative data collection - an overview
Quantitative
What: Things that can be quantified - numbers are always involved. Like satisfaction ratings, numbers of people engaging with an exhibit, etc.
When:
To answer questions about how many, how much
To make comparisons between different (groups of) people
To get a general overview of a situation
Advantages:
Generalisable to larger population
(Relatively) easy to analyse
Reliable and consistent data
Disadvantages:
Difficult to interpret without context
Not everything can be quantified
Building representative samples is difficult
Qualitative
What: Things that can’t be quantified: can be observed and described but less easily measured. Like videos, diary entries, textual analysis in surveys, interviews, focus groups, real-time observation.
When:
To answer questions about why and how
To dig deeply into a problem
When you have access to people from whom you can learn
To understand context
Advantages:
Rich, in-depth information
Flexibility in process
Grow relationships with your stakeholders
Insight into links and causation
Disadvantages:
Time-consuming in collection and analysis
Interpretation strongly depends on researcher’s understanding of the environment and context
Tackling the researcher’s bias during interpretation
Rarely generalisable to a larger population
A mixed methods approach
A wholly qualitative approach is unlikely to result in a report full of statistics. At the same time, if you collect data using rating scales or yes and no questions, you’re unlikely to have the rich information that adds nuance to your analyses and creates the narrative you need to help share your impact story. We suggest thinking about how you ensure a balance between qualitative and quantitative methods.
Ask yourself: what sort of evidence/information would I or my stakeholders find convincing in support of the impact claims? When one of our authors asked this to interviewees in research she was conducting, a large majority said that it’s more convincing to have statistical evidence as well as real more qualitative case studies. That is to say, a mixed methods approach where you balance numbers and insight.
Quiz - test what you understand
You want generalisable data that can be compared exactly to data collected by other people. Will you want to use a qualitative or quantitative method?
You want to ask only a few questions to a large group of people in a fast, simple way. Will the method you choose be qualitative or quantitative?
You want to understand how someone behaves or reacts in a certain situation in the library. Will the method you choose be qualitative or quantitative?
You know that your funder wants to see hard facts and percentages that can be easily quoted and shared. Will the method you choose be qualitative or quantitative?
You want to report on both what happened and why. Will the method you choose be qualitative or quantitative?
0 Comments