PeptideStack
5.2kquestions
20kanswers
220users

Why do two papers on STEP 8 report different headline figures?

Asked 22 Sept 2024Modified 19 months agoViewed 58k times
38

This is a question about interpretation, not about whether to act — I will take action questions elsewhere.

I want to know whether this is a real physical effect or an artefact of how it is measured.

What prompted the question is an inconsistency between two sources I otherwise trust.

Is the standard explanation correct, and if so, what is the evidence for it?

clinical-trials
clinical-trials

Reading the primary literature properly: estimands, intention-to-treat versus per-protocol, confidence intervals, absolute versus relative…

913 questions
dosing-math
dosing-math

The arithmetic itself: milligrams to millilitres to insulin units, concentration after reconstitution, dose per draw, and vial-days per vial. Show…

811 questions
semaglutide
semaglutide

A GLP-1 receptor agonist with a fatty-acid-acylated backbone and a roughly one-week half-life, marketed for type 2 diabetes and for weight…

360 questions
ecnoglutide
ecnoglutide

A long-acting GLP-1 receptor agonist with a cAMP-biased signalling profile. A niche tag, mostly used for mechanism questions about biased agonism…

14 questions
shareeditfollowflag
CL
askedcold_lane14k1822 Sept 2024

5 Answers

Accepted answer first, then by votes
89

Accepted answer

In practice, this is a question about what the trial was designed to answer, and the honest response is that it was not designed to answer this.

ApoB and LDL-C disagree because they measure different things: LDL-C is the cholesterol mass carried in the LDL fraction, ApoB is a count of atherogenic particles. Small dense particles carry less cholesterol each, so a person with many small particles has a concordantly higher ApoB than their LDL-C suggests. When they disagree, ApoB is the better risk marker.

Headline results, principal programmes

TrialAgentnDurationPrimary result
STEP 1Semaglutide 2.4 mg1,96168 wk−14.9 % vs −2.4 % weight
STEP 2Semaglutide 2.4 mg, T2DM1,21068 wk−9.6 % vs −3.4 % weight
SURMOUNT-1Tirzepatide 5/10/15 mg2,53972 wk−15 / −19 / −21 % weight
SURMOUNT-4Tirzepatide, withdrawal67088 wkContinued loss vs substantial regain
SELECTSemaglutide 2.4 mg17,604~40 moMACE HR 0.80 (0.72–0.90)
FLOWSemaglutide 1.0 mg, CKD3,533~3.4 yrRenal composite reduced; stopped early
SURMOUNT-OSATirzepatide, OSA46952 wkAHI reduced with and without PAP

Creatinine is a muscle-derived metabolite, so a substantial loss of lean mass lowers serum creatinine and mathematically raises estimated GFR without anything happening to the kidney. If you have lost twenty kilograms, your creatinine-based eGFR is flattering you. Cystatin C is not muscle-dependent and is the measure to use when the two disagree.

SUSTAIN 6 was the original cardiovascular outcomes trial for semaglutide in type 2 diabetes and is the reference point for the class effect that SELECT later extended to a non-diabetic population[1].

Worth being explicit that this is interpretation of published data and not medical advice. Laboratory results belong in a conversation with whoever ordered them.

If the trend across three draws is flat, the difference between draws one and two was noise. Most of what people react to is noise.

edited 29 Oct 2024 by Dr_Nadia_Farsi — added the placebo-arm figures

shareimprove this answerflag
DF
answered · acceptedDr_Nadia_Farsi90k25816 Oct 2024
4The distinction between purity and content cannot be repeated often enough here. – wren_calloway 2 months ago
add a comment
Sponsored

PeptideMeter - Independent Peptide Analytics

Aggregated, published test results and vendor ratings built from submitted batches. Methodology stated, dataset browsable, no listing fees.

Browse results
79

Start with the population. The inclusion criteria of the trial determine what its result can be extrapolated to, and the extrapolation people want is usually to a population the trial excluded.

HbA1c is a weighted average, not a flat one: roughly half the signal comes from the most recent month. That is why a value drawn six weeks after a change already reflects most of the effect, and why a value drawn during rapid haematological turnover reflects something other than glycaemia.

Stated carefully, the rodent thyroid C-cell findings that generated the labelled warning appear to be species-specific: rodent C-cells express GLP-1 receptors at high density, human C-cells at very low density, and human calcitonin data across large trial populations has not reproduced the signal. A family history of medullary thyroid carcinoma or MEN2 is nonetheless a genuine contraindication rather than a theoretical one.

SURMOUNT-OSA reported reductions in the apnoea-hypopnoea index with tirzepatide in adults with obesity and moderate-to-severe obstructive sleep apnoea, both with and without concurrent positive airway pressure therapy[1].

The limitation is that surrogate endpoints and hard endpoints have come apart before in metabolic medicine, so a favourable biomarker is a reason for optimism rather than a conclusion.

Convert everything to an absolute effect before you compare two interventions. Relative effects are not comparable across different baseline risks.

shareimprove this answerflag
RP
answeredrhian_prydderch44k385 Oct 2024
I have seen exactly this failure mode twice and both times it was the diluent. – tyndall_haze 8 months ago
8The distinction between purity and content cannot be repeated often enough here. – h_pergande 6 months ago
add a comment
38

The hazard ratio is the relative effect. What changes decisions is the absolute effect, and converting between them requires the event rate in the control arm, which is usually in the same table and rarely in the abstract.

The early fall in estimated glomerular filtration rate on treatment is haemodynamic rather than structural. Reduced intraglomerular pressure lowers the filtration rate acutely and preserves the glomerulus chronically — the same pattern seen with renin-angiotensin blockade and with SGLT2 inhibition. A dip of a few millilitres per minute in the first weeks, followed by a shallower long-term slope, is the desired trajectory, not a warning sign.

Specifically, a fasting lipid panel drawn during rapid weight loss reads oddly for a mechanical reason: mobilised adipose tissue delivers free fatty acids to the liver, and hepatic triglyceride export rises. Triglycerides can transiently increase while the person is doing exactly the right thing. Draw the panel when weight has been stable for a few weeks if you want an interpretable number.

SURMOUNT-1 reported mean weight reductions of approximately 15, 19 and 21 per cent at tirzepatide 5, 10 and 15 mg respectively at 72 weeks[1].

One qualification: a trial that demonstrates an endpoint at a given dose has demonstrated it at that dose. Extrapolating the endpoint down the dose ladder is an assumption, not a finding.

Read the confidence interval, read the estimand, and compute the absolute effect yourself. It takes two minutes and it changes how the result feels.

shareimprove this answerflag
HL
answeredharriet_lonsdale14k2711 Jan 2025
30

The confidence interval is the informative part. A point estimate with an interval spanning no effect is a different object from the same point estimate with a tight interval, and the abstract presents them identically.

Liver enzymes are a poor surrogate for hepatic histology in both directions: substantial steatohepatitis with normal transaminases is common, and modest enzyme elevation with minimal fibrosis is common. If the question is fibrosis, the answer comes from a non-invasive score such as FIB-4 or a stiffness measurement, not from ALT.

The PIONEER programme established oral semaglutide’s efficacy and the constraints on its administration, and the bioavailability figure of roughly one per cent is what drives the fasting and water-volume requirements[1].

The caveat is the population. Trial participants were screened, monitored and supported; the effect size in an unmonitored setting is not the trial effect size, and it is not obvious in which direction the difference runs.

The papers are readable. Read the paper rather than the summary of the paper, especially where the summary is enthusiastic.

shareimprove this answerflag
DB
answeredDr_Signe_Baldursdottir46k3824 Sept 2024
8Is there a reason to prefer the second method over the first, other than cost? – a_lindgren 3 months ago
add a comment
25

Read the estimand before the effect size. Almost every apparent contradiction between two published figures from the same trial resolves once you notice that one is a trial-product estimand and the other is a treatment-policy estimand.

A network meta-analysis can rank agents that were never compared directly, but only under a transitivity assumption — that the trials being linked are similar enough in population, duration and endpoint definition for the indirect comparison to hold. In this field that assumption is often visibly violated, which is why indirect rankings should be read as hypotheses.

SELECT reported a hazard ratio of 0.80 (95% CI 0.72–0.90) for the primary composite major adverse cardiovascular event endpoint with semaglutide 2.4 mg in overweight or obese adults with established cardiovascular disease and without diabetes[1].

None of this replaces a clinician who can see the whole picture, and the whole picture is usually where the answer is.

edited 27 Nov 2024 by nynke_dekker — added the method parameters

shareimprove this answerflag
ND
answerednynke_dekker18k2819 Nov 2024

Your answer

Ask PeptideStack is a static archive. Posting is closed, but the norms are worth stating: answer the question that was asked, show your working, cite the trial or the certificate, and say plainly where the evidence runs out.

Not medical advice. Research-use-only compounds are not approved for human use.