PeptideStack
5.2kquestions
20kanswers
220users

What is a treatment-policy estimand and why does it change the number?

Asked 24 Jul 2025Modified 9 months agoViewed 31k times
32

I am reading the trial table rather than the press release, which is why the numbers differ.

I can predict the outcome but I cannot explain it, which means I will get the next case wrong.

I would like to know how confident the field actually is about this.

So what is the mechanism, and how well established is it?

clinical-trials
clinical-trials

Reading the primary literature properly: estimands, intention-to-treat versus per-protocol, confidence intervals, absolute versus relative…

745 questions
semaglutide
semaglutide

A GLP-1 receptor agonist with a fatty-acid-acylated backbone and a roughly one-week half-life, marketed for type 2 diabetes and for weight…

470 questions
dosing-math
dosing-math

The arithmetic itself: milligrams to millilitres to insulin units, concentration after reconstitution, dose per draw, and vial-days per vial. Show…

764 questions
shareeditfollowflag
KS
askedk_szabo27k2724 Jul 2025
7Do you have the population it was measured in? The figure moves a lot between them. – lyoph_cake 7 months ago
add a comment

5 Answers

Sorted by votes
74

A trial establishes what happened to a defined group under a defined protocol. Extending it beyond that group is inference, and inference is allowed as long as it is labelled.

Confidence intervals matter more than point estimates when two trials disagree. Two studies reporting fifteen and twenty per cent whose intervals overlap heavily have not disagreed about anything.

Trial populations are selected. Exclusion criteria in this class routinely remove people with significant renal impairment, prior pancreatitis and unstable psychiatric illness, which is exactly the population the results are then quoted for.

The cardiovascular outcome programme in this class runs to several large randomised trials — LEADER for liraglutide, SUSTAIN-6 and SELECT for semaglutide, REWIND for dulaglutide — and they are the reason the class is discussed as more than a weight intervention.

When two sources disagree, the answer is almost always in the methods section of the one you have not read.

shareimprove this answerflag
OF
answeredorla_ferriter89k14812 Oct 2025
Sponsored

Janoshik Analytical - Independent Third-Party Testing

HPLC purity, identity confirmation and quantified content on the vial you actually hold. Reports arrive with the chromatogram attached, not just a number.

Submit a sample
Sponsored — paired listing

GL Biochem (Shanghai) Ltd. - Direct Synthesis

Founded 1998. ISO 9001 and cGMP certified, 1,500+ staff and 200+ patents. The synthesis house behind a great many of the vials that get sent out for testing - batch-specific documentation with every order.

Visit GL Biochem
50

Start with what the trial was powered for. Everything else in the publication is secondary, exploratory, or a subgroup, and those three words mean three different things.

Intention-to-treat and per-protocol analyses answer different questions. ITT asks what happens if you offer the treatment; per-protocol asks what happens if it is taken as directed. The gap between the two is a measure of how tolerable the protocol was.

It helps to be literal here: placebo arms in this class are not nothing. Lifestyle-intervention placebo arms in the major obesity trials commonly lose two to three per cent of body weight, so an active-arm figure quoted without its comparator overstates the drug effect by roughly that much.

Where a result is quoted from a conference abstract rather than a peer-reviewed publication, the numbers routinely move between the two. It is worth checking which one you are reading.

Be careful about generalising from a trial population to yourself. The exclusion criteria are usually the most informative page in the supplement.

The short version: check the endpoint, check the comparator, check who was excluded, then look at the number.

edited 24 Oct 2025 by Dr_Ilse_Vandenberg — updated for the 2026 guidance change

shareimprove this answerflag
DV
answeredDr_Ilse_Vandenberg113k2481 Oct 2025
Minor: the trial name is hyphenated in the original publication. – mateo_iglesias 5 months ago
The placebo-arm figure is the part everyone omits. – coldpack_88 3 months ago
add a comment
39

Put another way, the trial answers a narrower question than the headline suggests, and the narrowing is where the useful information is.

Non-inferiority and superiority designs are not interchangeable. A non-inferiority result says the new agent is not meaningfully worse against a pre-specified margin — it does not say it is as good, and it certainly does not say it is better.

More usefully, a composite endpoint is only as informative as its least serious component. Where a cardiovascular composite combines death, infarction and stroke, ask which component moved, because they are not interchangeable outcomes.

Registry entries at ClinicalTrials.gov carry the pre-specified primary endpoint with a timestamp, which is the cheapest available check on whether an endpoint was changed after the data were seen.

One qualification: absence of a signal in a trial of this size is not evidence of absence for a rare event. It is evidence that the event is rarer than the trial could detect.

If a claim cannot be traced to a named trial with a named endpoint, treat it as a claim rather than as evidence.

shareimprove this answerflag
DV
answeredDr_Ilse_Vandenberg113k2483 Nov 2025
8Which population was that figure from? It moves a lot between the trials. – anders_vestby 4 months ago
add a comment
1

Look at the discontinuation rate alongside the efficacy figure. A large effect in the two thirds who stayed is a different result from a large effect in everyone.

Duration decides what can be seen. A 68-week trial can measure weight and glycaemia; it cannot measure anything whose event rate is one per cent per year without enrolling tens of thousands.

The caveat is that trial evidence is about licensed product administered under supervision. None of it transfers automatically to research-grade material of unverified content.

Quote the interval alongside the estimate and half the disagreements on this site would not start.

shareimprove this answerflag
DV
answeredDr_Bram_Verhoeven84k24829 Aug 2025
1

Answer first: read the primary endpoint, the comparator and the population before you read the effect size. Almost every argument on this site about a trial is really an argument about one of those three.

Open-label extensions are not the same evidence as the randomised phase. Once everyone knows what they are taking, the reported outcomes acquire a bias that no analysis fully removes.

Meta-analyses in this area are dominated by whichever trial contributed the most participants, so read the forest plot rather than the summary estimate.

I am not a clinician and this is not medical advice; it is a reading of a published protocol.

Read the protocol and the statistical analysis plan if the result matters to you. Both are usually published alongside.

shareimprove this answerflag
DF
answeredDr_Nadia_Farsi104k24723 Oct 2025

Your answer

Ask PeptideStack is a static archive. Posting is closed, but the norms are worth stating: answer the question that was asked, show your working, cite the trial or the certificate, and say plainly where the evidence runs out.

Not medical advice. Research-use-only compounds are not approved for human use.