Is STEP 8 a fair comparison of semaglutide against its comparator arm?

Concretely: STEP 8 · semaglutide.

The claim is plausible, which is exactly why I want to check it.

I am able to read a paper if someone points me at one.

Has anyone verified this independently?

Fair depends on the comparator arm, and in STEP 8 that means asking whether the comparator was titrated to the same ambition as the experimental one. A head-to-head that runs its comparator to a dose below the one it is licensed at is not measuring the two agents, it is measuring one agent against a handicapped version of the other. Check three things: the maximum comparator dose reached, the proportion of the comparator arm that reached it, and whether the titration schedules had the same duration. If those match, the comparison is fair on dosing and the argument moves to the endpoint. If they do not, the effect size is partly an artefact of the protocol.

In practice, the trial answers a narrower question than the headline suggests, and the narrowing is where the useful information is.

Placebo arms in this class are not nothing. Lifestyle-intervention placebo arms in the major obesity trials commonly lose two to three per cent of body weight, so an active-arm figure quoted without its comparator overstates the drug effect by roughly that much.

Headline results, principal programmes

A composite endpoint is only as informative as its least serious component. Where a cardiovascular composite combines death, infarction and stroke, ask which component moved, because they are not interchangeable outcomes.

Where a result is quoted from a conference abstract rather than a peer-reviewed publication, the numbers routinely move between the two. It is worth checking which one you are reading.

Be careful about generalising from a trial population to yourself. The exclusion criteria are usually the most informative page in the supplement.

The short version: check the endpoint, check the comparator, check who was excluded, then look at the number.

edited 9 Sept 2025 by Dr_Ilse_Vandenberg — fixed an arithmetic slip in the third paragraph

The short version: the effect is real, the magnitude depends on the population, and the population is usually the part that gets dropped when a result is quoted second-hand.

Confidence intervals matter more than point estimates when two trials disagree. Two studies reporting fifteen and twenty per cent whose intervals overlap heavily have not disagreed about anything.

To be exact about it, open-label extensions are not the same evidence as the randomised phase. Once everyone knows what they are taking, the reported outcomes acquire a bias that no analysis fully removes.

The cardiovascular outcome programme in this class runs to several large randomised trials — LEADER for liraglutide, SUSTAIN-6 and SELECT for semaglutide, REWIND for dulaglutide — and they are the reason the class is discussed as more than a weight intervention.

One qualification: absence of a signal in a trial of this size is not evidence of absence for a rare event. It is evidence that the event is rarer than the trial could detect.

Quote the interval alongside the estimate and half the disagreements on this site would not start.

Before comparing two trials, check whether they share an endpoint definition. Frequently they do not, and the numbers then are not comparable in any sense.

Non-inferiority and superiority designs are not interchangeable. A non-inferiority result says the new agent is not meaningfully worse against a pre-specified margin — it does not say it is as good, and it certainly does not say it is better.

Duration decides what can be seen. A 68-week trial can measure weight and glycaemia; it cannot measure anything whose event rate is one per cent per year without enrolling tens of thousands.

Meta-analyses in this area are dominated by whichever trial contributed the most participants, so read the forest plot rather than the summary estimate.

I am not a clinician and this is not medical advice; it is a reading of a published protocol.

Read the protocol and the statistical analysis plan if the result matters to you. Both are usually published alongside.

Look at the discontinuation rate alongside the efficacy figure. A large effect in the two thirds who stayed is a different result from a large effect in everyone.

Intention-to-treat and per-protocol analyses answer different questions. ITT asks what happens if you offer the treatment; per-protocol asks what happens if it is taken as directed. The gap between the two is a measure of how tolerable the protocol was.

Registry entries at ClinicalTrials.gov carry the pre-specified primary endpoint with a timestamp, which is the cheapest available check on whether an endpoint was changed after the data were seen.

The caveat is that trial evidence is about licensed product administered under supervision. None of it transfers automatically to research-grade material of unverified content.

If a claim cannot be traced to a named trial with a named endpoint, treat it as a claim rather than as evidence.