Research
SapiensQ · Population Modeling · Survey

Preview how a population may respond before you ask.

Survey builds synthetic respondent panels from population data and uses them to forecast response distributions for draft questions. Before fieldwork begins, teams can test wording, compare alternatives, and identify potential acceptability risks.

What it is

A dress rehearsal for your survey.

Real fieldwork is expensive and takes time, and it often leaves little room to test multiple versions of a questionnaire. Survey lets you test the questionnaire first. Synthetic respondents drawn from population data answer draft questions, so you see the likely response distribution, wording risks, and questions that may need revision before fieldwork begins.

It complements fieldwork rather than replacing it. It helps teams sharpen questions, compare alternatives, and flag acceptability risks, then measures its forecasts against the completed survey.

How it works

From draft questionnaire to forecast, in four steps.

01

Build the panel

Draw synthetic respondents from population data, then weight them using raking/IPF to align the panel with benchmark distributions for age, gender, and region, so it reflects the observed demographic structure of the target population.

02

Ask your draft questions

Upload a questionnaire (CSV, XLSX, or JSON). Each synthetic respondent returns a probability distribution across answer choices rather than a single fixed response, which reduces over-concentration on one answer and preserves variation at the panel level.

03

Read the forecast

Get predicted response distributions, subgroup breakdowns by age, gender, and region, and per-question risk flags for ambiguous, leading, or sensitive wording before fieldwork.

04

Validate against reality

Once the real survey is complete, score the forecast against it. Distribution fidelity and top-choice agreement indicate where the panel performs reliably and where further calibration may be needed.

Measured fidelity

We don't ask you to trust the panel. We measure it.

Synthetic response distributions are compared with population-weighted survey results across demographic groups. Below are results from our own end-to-end benchmark — reported with clear limits, including areas that still require calibration.

0.142
Mean TVD · core questions
Distribution distance to the real survey — lower is better (target ≤ 0.20)
0.14 pp
Region composition error (MAE)
Mean absolute difference between the weighted synthetic panel and benchmark population statistics (region)
0.41 pp
Gender composition error (MAE)
Mean absolute difference between the weighted synthetic panel and benchmark population statistics (gender)
1.14 pp
Age-band composition error (MAE)
Mean absolute difference between the weighted synthetic panel and benchmark population statistics (age band)
51%
Distribution error reduction
Reduction from single-choice outputs to probability-vector responses, with top-choice agreement held
≥ 70%
Top-choice agreementTarget
Share of questions whose top choice matches the real survey

The methodology draws on prior research on silicon sampling, including Argyle et al., Out of One, Many; Santurkar et al., OpinionQA. Per-run and per-question breakdowns are available on request.

What it's for — and what it isn't

A pre-check, not a replacement.

Distribution-level simulation

Respondents are synthetic and are not tied to identifiable individuals. We evaluate aggregate distributions across demographic groups rather than matching synthetic respondents to individual survey participants.

Reliability is reported with limits

The panel performs better on questions with clear consensus and broad population-level attitudes. Perception-based, sensitive, and high-neutral-response items still need calibration, and each report identifies which item types require additional caution.

Every forecast includes its caveats

Every report includes confidence intervals, a fidelity score, and documented limits on reproducibility. Each one states the same caveat: this simulates a survey; it does not replace one.

Where it applies

Questions that call for a population-level response.

The panel can be configured to model a city, a country, a customer segment, or a workforce. Forecasts can then be checked against subsequent fieldwork or an established benchmark.

Policy & public services

Assess likely public acceptance and compare policy options before consultation.

Product & market research

Explore likely segment responses before investing in fieldwork.

Messaging & price testing

See how different subgroups may respond to alternative messages and price points.

Employee & organizational surveys

Model workforce-level responses and pre-test sensitive questions before fielding the survey.

Pre-test your next survey with a synthetic panel measured against real results.

Discuss a Collaboration