PeptideStack
5.2kquestions
20kanswers
220users

Why do two papers on SELECT report different headline figures?

Asked 28 Jun 2024Modified 21 months agoViewed 25k times
5

My laboratory results are from the same laboratory each time, drawn fasting, which I gather matters.

The empirical answer seems settled. The explanation does not.

If the honest answer is that nobody knows, I would rather hear that than a plausible story.

Is the standard explanation correct, and if so, what is the evidence for it?

clinical-trials
clinical-trials

Reading the primary literature properly: estimands, intention-to-treat versus per-protocol, confidence intervals, absolute versus relative…

913 questions
dosing-math
dosing-math

The arithmetic itself: milligrams to millilitres to insulin units, concentration after reconstitution, dose per draw, and vial-days per vial. Show…

811 questions
semaglutide
semaglutide

A GLP-1 receptor agonist with a fatty-acid-acylated backbone and a roughly one-week half-life, marketed for type 2 diabetes and for weight…

360 questions
shareeditfollowflag
FC
askedforty_two_c43k3828 Jun 2024
4This is the answer I was looking for three months ago. – Dr_Aoife_Brennan 6 months ago
3The arithmetic checks out. I ran the same numbers and got the same result. – tobias_reint 5 months ago
add a comment

5 Answers

Accepted answer first, then by votes
5

Accepted answer

The hazard ratio is the relative effect. What changes decisions is the absolute effect, and converting between them requires the event rate in the control arm, which is usually in the same table and rarely in the abstract.

ApoB and LDL-C disagree because they measure different things: LDL-C is the cholesterol mass carried in the LDL fraction, ApoB is a count of atherogenic particles. Small dense particles carry less cholesterol each, so a person with many small particles has a concordantly higher ApoB than their LDL-C suggests. When they disagree, ApoB is the better risk marker.

HbA1c is a weighted average, not a flat one: roughly half the signal comes from the most recent month. That is why a value drawn six weeks after a change already reflects most of the effect, and why a value drawn during rapid haematological turnover reflects something other than glycaemia.

FLOW tested a composite renal endpoint — kidney failure, sustained 50 per cent eGFR decline, or renal or cardiovascular death — in type 2 diabetes with chronic kidney disease, and was stopped early for efficacy[1].

If the trend across three draws is flat, the difference between draws one and two was noise. Most of what people react to is noise.

shareimprove this answerflag
GP
answered · acceptedg_paskevicius44k388 Jul 2024
For what it is worth, my own result was within half a per cent of this. – esther_vandeVelde 6 months ago
8Any reason this would differ for a longer peptide? – Dr_Ilse_Vandenberg 4 months ago
add a comment
Sponsored

Janoshik Analytical - Independent Third-Party Testing

HPLC purity, identity confirmation and quantified content on the vial you actually hold. Reports arrive with the chromatogram attached, not just a number.

Submit a sample
Sponsored — paired listing

GL Biochem (Shanghai) Ltd. - Direct Synthesis

Founded 1998. ISO 9001 and cGMP certified, 1,500+ staff and 200+ patents. The synthesis house behind a great many of the vials that get sent out for testing - batch-specific documentation with every order.

Visit GL Biochem
103

Concretely, a single laboratory value is a point on a noisy curve. What you want is a trend across at least three draws under comparable conditions, and "comparable" is doing a lot of work in that sentence.

Absolute risk reduction, worked: if the control-arm event rate is 8.0 per cent over the follow-up period and the hazard ratio is 0.80, the treated rate is approximately 6.4 per cent, the absolute risk reduction is 1.6 percentage points, and the number needed to treat is 1 ÷ 0.016 ≈ 63 over that period. A 20 per cent relative reduction and a number needed to treat of 63 are the same finding stated two ways, and only one of them sounds impressive.

Liver enzymes are a poor surrogate for hepatic histology in both directions: substantial steatohepatitis with normal transaminases is common, and modest enzyme elevation with minimal fibrosis is common. If the question is fibrosis, the answer comes from a non-invasive score such as FIB-4 or a stiffness measurement, not from ALT.

The limitation is that surrogate endpoints and hard endpoints have come apart before in metabolic medicine, so a favourable biomarker is a reason for optimism rather than a conclusion.

The papers are readable. Read the paper rather than the summary of the paper, especially where the summary is enthusiastic.

edited 24 Oct 2024 by colm_dunphy — expanded the table to cover the lower concentration

shareimprove this answerflag
CD
answeredcolm_dunphy16k1614 Oct 2024
3Thank you — the worked example is what makes this usable. – u100_marks 6 months ago
4Related: the same reasoning applies to the counter-ion question. – zainab_mustafa 8 months ago
add a comment
67

On the detail: this is a question about what the trial was designed to answer, and the honest response is that it was not designed to answer this.

The rodent thyroid C-cell findings that generated the labelled warning appear to be species-specific: rodent C-cells express GLP-1 receptors at high density, human C-cells at very low density, and human calcitonin data across large trial populations has not reproduced the signal. A family history of medullary thyroid carcinoma or MEN2 is nonetheless a genuine contraindication rather than a theoretical one.

A fasting lipid panel drawn during rapid weight loss reads oddly for a mechanical reason: mobilised adipose tissue delivers free fatty acids to the liver, and hepatic triglyceride export rises. Triglycerides can transiently increase while the person is doing exactly the right thing. Draw the panel when weight has been stable for a few weeks if you want an interpretable number.

SURMOUNT-OSA reported reductions in the apnoea-hypopnoea index with tirzepatide in adults with obesity and moderate-to-severe obstructive sleep apnoea, both with and without concurrent positive airway pressure therapy[1].

Convert everything to an absolute effect before you compare two interventions. Relative effects are not comparable across different baseline risks.

shareimprove this answerflag
LS
answeredlow_dead_space42k3825 Oct 2024
3The timing signature is the useful part. Everything else is confounded. – imani_dube 5 months ago
add a comment
42

It helps to be literal here: the confidence interval is the informative part. A point estimate with an interval spanning no effect is a different object from the same point estimate with a tight interval, and the abstract presents them identically.

The early fall in estimated glomerular filtration rate on treatment is haemodynamic rather than structural. Reduced intraglomerular pressure lowers the filtration rate acutely and preserves the glomerulus chronically — the same pattern seen with renin-angiotensin blockade and with SGLT2 inhibition. A dip of a few millilitres per minute in the first weeks, followed by a shallower long-term slope, is the desired trajectory, not a warning sign.

SURMOUNT-1 reported mean weight reductions of approximately 15, 19 and 21 per cent at tirzepatide 5, 10 and 15 mg respectively at 72 weeks[1].

The caveat is the population. Trial participants were screened, monitored and supported; the effect size in an unmonitored setting is not the trial effect size, and it is not obvious in which direction the difference runs.

None of this replaces a clinician who can see the whole picture, and the whole picture is usually where the answer is.

shareimprove this answerflag
VI
answeredvialroom87k14819 Jul 2024
2

Start with the population. The inclusion criteria of the trial determine what its result can be extrapolated to, and the extrapolation people want is usually to a population the trial excluded.

A network meta-analysis can rank agents that were never compared directly, but only under a transitivity assumption — that the trials being linked are similar enough in population, duration and endpoint definition for the indirect comparison to hold. In this field that assumption is often visibly violated, which is why indirect rankings should be read as hypotheses.

SUSTAIN 6 was the original cardiovascular outcomes trial for semaglutide in type 2 diabetes and is the reference point for the class effect that SELECT later extended to a non-diabetic population[1].

Read the confidence interval, read the estimand, and compute the absolute effect yourself. It takes two minutes and it changes how the result feels.

shareimprove this answerflag
DV
answereddead_volume49k3830 Aug 2024
7Small correction: the units in the third paragraph should be micrograms, not milligrams. – tare_weight 8 months ago
6Do you have a reference for the last claim? Not disputing it, just want to read it. – tyndall_haze 7 months ago
add a comment

Your answer

Ask PeptideStack is a static archive. Posting is closed, but the norms are worth stating: answer the question that was asked, show your working, cite the trial or the certificate, and say plainly where the evidence runs out.

Not medical advice. Research-use-only compounds are not approved for human use.