Quality Criteria of a Survey for Market Research

What are Quality Criteria in market research?

Objectivity

Maintaining objectivity is critical to ensure that research results are free from bias and independent of the conditions under which the survey was conducted.

It is only by achieving this that different respondents' answers can be compared.

Objectivity in market research can be classified into three types:

1. Data collection
2. Evaluation
3. Interpretation

Objectivity in data collection

Objectivity in data collection demands that the survey's target group's responses should not depend on the who conducts the survey or interviews them.

Standardization of survey conditions is crucial to achieve this. The interviewer must not influence the results in any way.

Objectivity in evaluation

Objectivity in evaluation requires that different researchers arrive at the same results when evaluating the collected data. This means adhering to pre-defined rules and ensuring that there is no scope for subjective interpretation.

Open-ended questions should be evaluated based on predetermined criteria. However, multiple-choice and single-choice questions can be evaluated objectively.

Objectivity in interpretation

Reliability

Reliability is a crucial quality criterion in market research as it determines the consistency and accuracy of the survey results. To achieve high reliability, a questionnaire must be designed in a way that allows for consistent measurement.

This means that if a consumer completes the questionnaire under the same conditions at different times, the results should be the same.

To test for reliability, researchers often use retest-reliability, which evaluates the relationship between two surveys presented to the same person at two different times.

Objectivity is a fundamental requirement for a reliable survey as it ensures that the results are independent of who conducts, evaluates, or interprets the test. By achieving objectivity, a researcher can ensure the consistency of the results, which in turn ensures reliability.

Therefore, reliability is a prerequisite for validity, the third and most important criterion for a successful study.

Validity

A valid questionnaire measures exactly what a company wants to know.

However, for a questionnaire to be considered valid, it must first satisfy the prerequisites of objectivity and reliability.

For instance, if a company wants to know whether consumers would be willing to buy a particular product at a specific price, then the questionnaire should measure exactly that and not any other unrelated factors.

There are two critical types of validity, namely internal and external:

1. Internal validity

   
   Internal validity of a questionnaire measures the effect of an independent variable (e.g., product design) on a dependent variable (e.g., purchase intention).

    

   The questionnaire has high internal validity if the change in the dependent variable can be attributed solely to the modification in the independent variable. This means that there should be minimal disruptive factors during the survey.
   
   

   For instance, if a company wants to test the packaging for a yogurt and shows consumers various designs, the change in respondents' attitude towards the yogurt design should result from the design differences and not because the respondents were distracted.
   
   

2. External validity

   
   External validity measures the generalizability and representativeness of the survey results.
   
   

   It shows how much the statements made by respondents in the survey can be applied to their actual behavior and to what extent this also applies to other people outside the sample surveyed.
   
   

   For example, if a company wants to know whether consumers want to buy milk at their next purchase, the response given by the participants should reflect their real behavior.

    

   
   

   Therefore, what respondents say in surveys should accurately represent their actual behavior.

Summary