Qualtrics Studies Run on Mechanical Turk Can Be Integrated With CloudResearch

Run Qualtrics Surveys on MTurk using CloudResearch

Running Qualtrics surveys on CloudResearch streamlines several major pain-points researchers using MTurk have dealt with:

1. Researchers can setup a dynamic secret code so that each Worker receives a unique code upon completing the study. This eliminates the possibility of workers sharing codes.

2. Researchers can choose to auto approve and reject workers based on their submission of the dynamic secret code.

3. Researchers can automatically capture information such as the MTurk WorkerID, HitID, and AssignmentID of each person who completes their survey. This allows you to match workers with their data.

Below is a basic description of these features and how to use them.

The CloudResearch Design Survey Form is intuitive and similar to the MTurk Requester HIT Design form except that it adds many useful features like exclude Workers, target specific workers and much more. Below is a portion of the CloudResearch Design Survey form where you specify the Survey Hyperlink.

Qualtrics Surveys With Workers Specific Secret Codes

Now, you can also run Qualtrics surveys with CloudResearch Worker Specific Secret Codes. That means each worker will be assigned a unique secret code they need to submit to demonstrate they completed your Qualtrics survey. Unique codes eliminate the possibility that workers might share completion codes and submit your HIT without completing the survey.

The Dynamic Secret Completion Code can be easily integrated into other non-Qualtrics systems as well. CloudResearch calculates the Secret Code based on query string parameters that are added to the url of your survey. These parameters are named:

• a
• b
• c

As long as your survey platform ensures that the query string values are preserved in the url when a participant reaches the last page of your survey that contains the TurkPrime iframe, then a completion code should get displayed.

This can be achieved by capturing the parameters within your study. Nearly all platforms support this functionality. Please contact us if you have questions.

Furthermore, you have the option to manually approve each assignment or have CloudResearch auto-approve the assignment based on the secret code. (If for any reason, a worker is rejected in error by either you or the system, you can reverse the rejection within TurkPrime).

Setup in CloudResearch is very simple.  and involves a few steps to the instructions at the end of your Qualtrics study as follows:

Setup for Qualtrics

1. Create or Edit a Survey

2. Click on “Survey Options”

   

3. In the Survey Termination Section: Click on Custom end of survey message…

4. 

5. If you have a Secret Key option that you previously created Select it and you are done. Otherwise, Click New Message

6. Enter Secret Key in the Description field. (Next time you can select this message.)

7. Click the Source code button

   

8. Paste the following text exactly into the window as shown

   <iframe width=‘100%’ height=‘200’ id=“cr_secretcode”></iframe>
   <script>
       function createIFrame() {
           var ref = encodeURIComponent(document.location.search);
           var ifrm = document.getElementById(“cr_secretcode”);
           ifrm.setAttribute(“src”, “https://app.cloudresearch.com/TakeLaunchedSurvey/DynamicKey/?referrer= + ref);
       }
       createIFrame();
   </script>

   

9. Click Save

Passing Mechanical Turk WorkerId and AssignmentId to Qualtrics

CloudResearch automatically adds the following query string parameters to your URL so you can take advantage of them in your data collection. The parameters are: workerId ,  assignmentId , and hitId .

• workerId - The worker’s MTurk id

• assignmentId - A unique id that Amazon generates for a worker taking your HIT

• hitId - The id of your HIT

This eliminates the need to add JavaScript code snippets into your surveys or other solutions.that Requesters have developed. It just is added to your URL automatically.

See here for how to integrate these parameters into your Qualtrics survey.

For CloudResearch integration with Google Forms see here.