[Last Updated: January 1, 2021]
The Response Quality Protocol ensures that there are proactive measures in place to protect the quality of responses. As responses are the bases of reported survey results, it is critical to ensure that Verified Respondents (VRs) give responses to survey questions with the necessary thought and reflection that questions require.
The Response Quality Protocol has three levels:
Level 1: Explicit caution on untruthful, rushed or non-thought-out answers are made clear with respondents and are formalized through their agreement with the Verified Respondents Terms and Conditions (which is required in every survey before entry is granted).
VRs agree not to answer survey questions in any of the following ways described below:
Rule-Breakers: not reading or not following (or both) or disregarding instructions of questions.
Speeders: answering questions in haste without giving the needed thought and reflection required.
Straightliners: answering questions in an intentionally careless manner by choosing response options in a random manner.
Cheaters: attempting to answer surveys multiple times by using fraudulently-acquired accounts.
Posers: answering questions untruthfully.
SP.A institutes the necessary, critical check and balance procedures in order to catch these five kinds of untruthful and/or fraudulent survey responses.
Level 2: Proactive measures against professional survey takers.
Professional survey takers are those who use several email accounts and several identities (which may or may not be actually existing identities/persons who may or may not have given their explicit authorization for their identities to be used). Using these multiple credentials, they then take as many surveys as they can in the shortest possible time.
Social Pulse Asia proactively institutes measures to monitor and exclude answers by these professional survey takers so as avoid any negative effects of their untruthful answers on the reported survey results. These measures are not publicly declared so as not to provide any information that will allow these professional survey takers to then implement countermeasures. However, these proactive measures against professional survey takers are declared to institutional clients who require their trust and confidence in Social Pulse Asia to have a strong foundation.
Level 3: Embedded consistency-checking capabilities.
Questions in Social Pulse Asia surveys are designed in such a way that there are embedded consistency-checking capabilities. A Verified Respondent answering questions truthfully and authentically will have consistency in his/her answers. This is because the bases for answers given is the truthful situation of that person – which does not change. So if multiple questions about that same truthful situation are asked, that respondent will provide consistent answers because the referent situation is the same.
In contrast, a respondent who randomly provides answers with no referent situations as bases will inevitably display inconsistency in answers.
Social Pulse Asia invests significant effort in designing its questions such that surveys have the capability to check for consistency in answers.