CPG demo · Monadic beer concept test, four package concepts (n=803)

How Model-Dependent Is the Estimate?

Triangulation check

The simulator reports what the model implies under a stated scenario. This page asks whether the same scenario produces a similar result through two structurally different routes: propensity-score subclassification, and the fitted Bayesian network where it can represent the scenario. The results appear side by side.

Agreement narrows one concern: that the result is an artifact of the logit specification. Material disagreement points the other way: the scenario should be described as model-form dependent rather than presented as though the alternative route supported it.

More detail

Frederick Mosteller suggested that a difficult quantity be estimated through several structurally different models (triangulation), on the reasoning that similar outcomes from differing structures are themselves evidence.

The propensity route standardizes the observed outcome among records that actually have the selected values to the full sample, whereas the model assigns the selected values to every record and averages the predicted probabilities. The network route can read the scenario under the same rule as the model, holding the other factors at each record’s observed values.

Where a scenario factor reaches the outcome only through another factor, the network reports a projection that lets the other factors respond, labeled as a different estimand and comparable on direction rather than size. Where a factor has no path to the outcome, it reports no network estimate.

The check uses the network fitted on the same specification: the same predictors and subgroup scope. The check does not address omitted measurement, nonresponse, causal direction, or other shared vulnerabilities, and similar point estimates are not treated as formal equivalence.

Filter to a subgroup (or stay on All respondents), change one or more factors below, then click Run scenario. The check appears underneath.

Loading simulator…