NBA 2014-15 · Shot Logs · 33,362 Three-Point Shots

How Model-Dependent Is the Estimate?

Triangulation check

The simulator reports what the published model implies under a stated scenario. This page asks whether the same scenario produces a similar result through two structurally different routes: propensity-score subclassification, and the fitted Bayesian network where it can represent the scenario. The results appear side by side.

Agreement narrows one concern: that the result is an artifact of the published logit specification. Material disagreement points the other way: the scenario should be described as model-form dependent rather than presented as though the alternative route supported it.

More detail

Frederick Mosteller suggested that a difficult quantity be estimated through several structurally different models (triangulation), on the reasoning that similar outcomes from differing structures are themselves evidence.

The propensity route standardizes the observed outcome among records that actually have the selected values to the full sample, whereas the published model assigns the selected values to every record and averages the predicted probabilities. The network route can read the scenario under the same rule as the published model, holding the other factors at each record’s observed values.

Where a scenario factor reaches the outcome only through another factor, the network reports a projection that lets the other factors respond, labeled as a different estimand and comparable on direction rather than size. Where a factor has no path to the outcome, it reports no network estimate.

The check uses the network fitted on the same specification: the same predictors and subgroup scope. The check does not address omitted measurement, nonresponse, causal direction, or other shared vulnerabilities, and similar point estimates are not treated as formal equivalence.

Pick a player (or stay league-wide), change one or more factors below, then click Run scenario. The check appears underneath.

Loading simulator…