How to Gather Demographically-Representative Samples in Online Studies

Aaron Moss, PhD

published on December 7, 2018

By Aaron Moss, PhD & Leib Litman, PhD

Most social science research relies on convenience sampling of participants, meaning few samples look like let alone represent the general population. For many research questions, convenience samples are not a problem. Yet, for other questions, being able to capture and represent the opinions of people from different groups is essential. Because most researchers do not routinely gather these kinds of samples, knowing where to find one when it’s needed can be difficult. Using CloudResearch you can easily and affordably obtain a sample matched to the demographics of the US census on our market research platform called Prime Panels.


What is Prime Panels?

Prime Panels is a crowdsourced research platform with over 30 million research participants around the world. While Prime Panels is not a probability-based sample, the sheer number of people it provides access to makes it better matched to national demographics than most other sources of research participants. In addition, using census-matched quotas, it is possible to recruit a sample of U.S. participants that reflects the national population.


Obtaining a Census-Matched Sample on Prime Panels

To collect a census-matched sample on Prime Panels, go to the Create a Study drop-down menu on the header of the CloudResearch homepage. From the drop-down menu, select Prime Panels.

Screenshot of CloudResearch's navigation menu showing the 'Create a Study' dropdown with Prime Panels option highlighted, illustrating how to access the platform for census-matched sampling

You will be directed to the Prime Panels page. You can skip the “Panels” features and move to Tab 2, “Study Settings.” On the Study Settings page, fill in the details of your project and insert a shareable URL to your survey.

Screenshot of Prime Panels' Study Settings page showing the interface for entering survey details including title, description, URL, estimated completion time, and payment information

In Tab 3 Quotas, select Apply Census Matched Template. When you make this selection, the system will automatically set Quotas for demographic categories proportional to the U.S. Census (e.g., Age, Gender, Ethnicity, Hispanic/Latino). The system will divide your sample size by each group’s share of the population to make sure you wind up with a sample that is matched to the nation’s demographics.

Screenshot of Prime Panels' Quotas page highlighting the 'Apply Census Matched Template' button that automatically sets demographic quotas proportional to U.S. Census data
Screenshot showing the age quota settings in Prime Panels with percentage distributions across different age brackets matching U.S. Census proportions
Screenshot of Prime Panels' gender quota settings showing the percentage distribution between males and females based on U.S. Census data
Screenshot of Prime Panels' ethnicity quota settings displaying percentage distributions across different racial groups matching U.S. Census proportions
Screenshot of Prime Panels' Hispanic/Latino quota settings showing the percentage distribution between Hispanic/Latino and non-Hispanic/Latino populations based on U.S. Census data

Lastly, click the Save button and you should now see your Prime Panels study on the dashboard.

Screenshot of TurkPrime's Prime Panels study dashboard showing the control panel for monitoring study progress, quota fulfillment, and participant recruitment status

From the Dashboard, you can see your quotas. While your study is running, you can view which demographic groups have collected participants.

Screenshot of the quota monitoring interface showing real-time progress of demographic quota fulfillment across age, gender, ethnicity, and Hispanic/Latino categories with completion percentages

Congratulations, you have just created a Prime Panels study that will obtain a sample matched to the US census!

Share this blog

Related Articles

How to Obtain an Online National Sample Stratified by Wealth
How to Obtain an Online National Sample Stratified by Wealth

A Case Study From a Recent JESP Article A new study appearing in the Journal of Experimental Social Psychology suggests Americans strongly believe in economic mobility because they fail to ...

Read More >
Recruiting Older Adults Online
Recruiting Older Adults Online

People of different ages vary greatly in their beliefs and behaviors. For example, a recent Pew report outlines wide generational gaps in people’s opinions on several political issues like presidential ...

Read More >

SUBSCRIBE TO RECEIVE UPDATES

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.