Buying Partner-Sourced Sample? How to Audit What You're Getting
Seven essential questions to help evaluate sample sourcing, respondent quality and provider accountability.
Category
Quality & Compliance
Share:
Buying Partner-Sourced Sample? How to Audit What You're Getting
Most online sample is sourced through multiple partners, and that's perfectly normal. Partners help you reach niche audiences that no single panel can cover. The real question isn't whether sample is partner-sourced. It's whether someone is accountable for its quality.
Start with the ESOMAR 37 Framework
ESOMAR's 37 Questions to Help Buyers of Online Sample is a widely used framework for evaluating how a provider sources, manages and validates sample.
Many providers publish their completed answers. If yours can't or won't, that's worth investigating.
Seven Questions to Ask Any Sample Provider
Before choosing a sample provider, ask these seven essential questions:
Where do your respondents actually come from, and how are they recruited?
How are they incentivised, and does the incentive encourage careless or inflated answers?
If several partners feed one project, how do you prevent the same person appearing twice?
What checks run before fieldwork starts, and what runs while it's live?
Who reviews open-ended answers: a script, a person, or both?
What happens to respondents you flag: removed, replaced or reported?
How is the data stored and protected, and which regulations do you work to?
What Good Answers Look Like
Good answers are specific rather than vague, consistent across conversations and supported by documentation you can review. A reliable provider should also be willing to demonstrate and test its quality processes.
Why Independent Quality Checks Matter
Online survey fraud, including bots and AI-assisted responding, remains a concern across the research industry. Estimates of its scale vary, but no single partner's checks can catch everything.
A documented second layer of validation, applied independently before delivery, helps identify potential risks and improves confidence in the final data.
Our Approach to Sample Quality
We work only with partners that meet our quality standards and audit them regularly. We also apply our own independent quality checks throughout the research process.
Automated and manual respondent validation.
Duplicate respondent detection.
Outlier detection and response quality checks.
Open-ended response review.
Real-time fieldwork monitoring.
Regular partner quality audits.
Our completed ESOMAR 37 responses are available on request. We believe transparency and independent validation are essential to delivering reliable research data.
The Takeaway
Partner-sourced sample is not inherently a quality risk. What matters is how respondents are sourced, monitored and validated.
Before choosing a provider, ask the right questions, review its quality processes and ensure independent checks are in place.
