Accepted answer
Check the SURMOUNT-2 inclusion criteria against yourself in that order: entry BMI band, diabetes status, prior weight-loss attempts, and what the run-in excluded. Registration programmes recruit a population selected to show an effect if one exists, which is the right design and a poor basis for generalising. The run-in is the part that is easiest to miss: a programme that drops people during a placebo lead-in has already removed those least likely to tolerate or comply, and the published arms describe the survivors. External validity is not a property of the trial; it is a property of the distance between its population and yours, and that distance is yours to measure.
Start with what the trial was powered for. Everything else in the publication is secondary, exploratory, or a subgroup, and those three words mean three different things.
Trial populations are selected. Exclusion criteria in this class routinely remove people with significant renal impairment, prior pancreatitis and unstable psychiatric illness, which is exactly the population the results are then quoted for.
Confidence intervals matter more than point estimates when two trials disagree. Two studies reporting fifteen and twenty per cent whose intervals overlap heavily have not disagreed about anything.
Registry entries at ClinicalTrials.gov carry the pre-specified primary endpoint with a timestamp, which is the cheapest available check on whether an endpoint was changed after the data were seen.
The caveat is that trial evidence is about licensed product administered under supervision. None of it transfers automatically to research-grade material of unverified content.
If a claim cannot be traced to a named trial with a named endpoint, treat it as a claim rather than as evidence.
edited 19 Feb 2026 by Dr_Ilse_Vandenberg — added the placebo-arm figures
3The number needed to treat is the framing that finally made this concrete for me. – Dr_Bram_Verhoeven 43 days ago add a comment