PeptideStack
5.2kquestions
20kanswers
220users

Why do two papers on STEP 1 report different headline figures?

Asked 9 Oct 2024Modified 18 months agoViewed 12k times
6

I have the full paper rather than the abstract, and the supplementary appendix.

I can predict the outcome but I cannot explain it, which means I will get the next case wrong.

I would like to know how confident the field actually is about this.

What is actually going on here, physically?

clinical-trials
clinical-trials

Reading the primary literature properly: estimands, intention-to-treat versus per-protocol, confidence intervals, absolute versus relative…

913 questions
dosing-math
dosing-math

The arithmetic itself: milligrams to millilitres to insulin units, concentration after reconstitution, dose per draw, and vial-days per vial. Show…

811 questions
semaglutide
semaglutide

A GLP-1 receptor agonist with a fatty-acid-acylated backbone and a roughly one-week half-life, marketed for type 2 diabetes and for weight…

360 questions
shareeditfollowflag
TA
askedtri_gly_ala48k389 Oct 2024

5 Answers

Accepted answer first, then by votes
102

Accepted answer

Concretely, a single laboratory value is a point on a noisy curve. What you want is a trend across at least three draws under comparable conditions, and "comparable" is doing a lot of work in that sentence.

Absolute risk reduction, worked: if the control-arm event rate is 8.0 per cent over the follow-up period and the hazard ratio is 0.80, the treated rate is approximately 6.4 per cent, the absolute risk reduction is 1.6 percentage points, and the number needed to treat is 1 ÷ 0.016 ≈ 63 over that period. A 20 per cent relative reduction and a number needed to treat of 63 are the same finding stated two ways, and only one of them sounds impressive.

Relative to absolute, worked

QuantityValueDerivation
Control-arm event rate8.0 %From the trial table, not the abstract
Hazard ratio0.80Reported
Treated event rate6.4 %8.0 × 0.80
Absolute risk reduction1.6 pp8.0 − 6.4
Number needed to treat631 ÷ 0.016
Relative risk reduction20 %1 − 0.80

The last two rows describe the same finding. Only one of them is used in headlines.

To be exact about it, creatinine is a muscle-derived metabolite, so a substantial loss of lean mass lowers serum creatinine and mathematically raises estimated GFR without anything happening to the kidney. If you have lost twenty kilograms, your creatinine-based eGFR is flattering you. Cystatin C is not muscle-dependent and is the measure to use when the two disagree.

SUSTAIN 6 was the original cardiovascular outcomes trial for semaglutide in type 2 diabetes and is the reference point for the class effect that SELECT later extended to a non-diabetic population[1].

The papers are readable. Read the paper rather than the summary of the paper, especially where the summary is enthusiastic.

edited 26 Jan 2025 by ilaria_bertone — removed a claim I could not source

shareimprove this answerflag
IB
answered · acceptedilaria_bertone43k387 Jan 2025
3The placebo-arm figure is the part everyone omits. – bufferline42 5 months ago
add a comment
Sponsored

Sigma-Aldrich - Certified Reference Materials

Analytical standards and reagents with traceable certificates. Every quantitative result you read inherits the accuracy of the standard behind it.

Shop standards
41

The confidence interval is the informative part. A point estimate with an interval spanning no effect is a different object from the same point estimate with a tight interval, and the abstract presents them identically.

HbA1c is a weighted average, not a flat one: roughly half the signal comes from the most recent month. That is why a value drawn six weeks after a change already reflects most of the effect, and why a value drawn during rapid haematological turnover reflects something other than glycaemia.

Put another way, a fasting lipid panel drawn during rapid weight loss reads oddly for a mechanical reason: mobilised adipose tissue delivers free fatty acids to the liver, and hepatic triglyceride export rises. Triglycerides can transiently increase while the person is doing exactly the right thing. Draw the panel when weight has been stable for a few weeks if you want an interpretable number.

None of this replaces a clinician who can see the whole picture, and the whole picture is usually where the answer is.

shareimprove this answerflag
GA
answeredgrainne_ahearn13k1627 Dec 2024
8I tested this on two lots and got the same answer, so at least it reproduces. – retest_please 3 months ago
The timing signature is the useful part. Everything else is confounded. – w_okoye 5 months ago
add a comment
32

It helps to be literal here: start with the population. The inclusion criteria of the trial determine what its result can be extrapolated to, and the extrapolation people want is usually to a population the trial excluded.

Estimated average glucose from HbA1c: eAG in mg/dL = 28.7 × A1c − 46.7, or in mmol/L, 1.59 × A1c − 2.59. An A1c of 6.5 per cent is therefore about 140 mg/dL or 7.8 mmol/L. The relationship is a population regression, so an individual can sit well off the line.

The relevant detail is that the early fall in estimated glomerular filtration rate on treatment is haemodynamic rather than structural. Reduced intraglomerular pressure lowers the filtration rate acutely and preserves the glomerulus chronically — the same pattern seen with renin-angiotensin blockade and with SGLT2 inhibition. A dip of a few millilitres per minute in the first weeks, followed by a shallower long-term slope, is the desired trajectory, not a warning sign.

Read the confidence interval, read the estimand, and compute the absolute effect yourself. It takes two minutes and it changes how the result feels.

shareimprove this answerflag
C8
answeredcoldpack_8837k3830 Jan 2025
27

This is a question about what the trial was designed to answer, and the honest response is that it was not designed to answer this.

ApoB and LDL-C disagree because they measure different things: LDL-C is the cholesterol mass carried in the LDL fraction, ApoB is a count of atherogenic particles. Small dense particles carry less cholesterol each, so a person with many small particles has a concordantly higher ApoB than their LDL-C suggests. When they disagree, ApoB is the better risk marker.

STEP 1 reported a mean weight change of approximately −14.9 per cent with semaglutide 2.4 mg versus −2.4 per cent with placebo at 68 weeks[1]; the difference between the figures quoted from this trial in different places is an estimand difference.

Convert everything to an absolute effect before you compare two interventions. Relative effects are not comparable across different baseline risks.

shareimprove this answerflag
MF
answeredmeniscus_film34k3819 Jan 2025
23

Specifically, read the estimand before the effect size. Almost every apparent contradiction between two published figures from the same trial resolves once you notice that one is a trial-product estimand and the other is a treatment-policy estimand.

The rodent thyroid C-cell findings that generated the labelled warning appear to be species-specific: rodent C-cells express GLP-1 receptors at high density, human C-cells at very low density, and human calcitonin data across large trial populations has not reproduced the signal. A family history of medullary thyroid carcinoma or MEN2 is nonetheless a genuine contraindication rather than a theoretical one.

The limitation is that surrogate endpoints and hard endpoints have come apart before in metabolic medicine, so a favourable biomarker is a reason for optimism rather than a conclusion.

If the trend across three draws is flat, the difference between draws one and two was noise. Most of what people react to is noise.

shareimprove this answerflag
RC
answeredRP_C1885k15824 Nov 2024

Your answer

Ask PeptideStack is a static archive. Posting is closed, but the norms are worth stating: answer the question that was asked, show your working, cite the trial or the certificate, and say plainly where the evidence runs out.

Not medical advice. Research-use-only compounds are not approved for human use.