PeptideStack
5.2kquestions
20kanswers
220users

What did the placebo arm of STEP 1 report for headache?

Asked 3 Oct 2024Modified 19 months agoViewed 35k times
28

The specifics, since they change the answer: STEP 1 · headache.

I have the document in front of me and I can read the numbers. What I cannot do is interpret them.

I am reasonably comfortable with statistics and completely uncomfortable with chromatography, or vice versa.

What does this actually establish, and what does it not?

clinical-trials
clinical-trials

Reading the primary literature properly: estimands, intention-to-treat versus per-protocol, confidence intervals, absolute versus relative…

745 questions
harm-reduction
harm-reduction

Reducing avoidable risk where a decision has already been made: independent verification before use, sterility practice, dose arithmetic checked…

472 questions
shareeditfollowflag
LM
askedleonid_marchuk19k273 Oct 2024
4Do you have the population it was measured in? The figure moves a lot between them. – esther_vandeVelde 6 months ago
add a comment

2 Answers

Accepted answer first, then by votes
104

Accepted answer

The STEP 1 placebo arm is the only thing that makes its treatment arm interpretable, and it is the row nobody quotes. Symptoms reported under placebo in these programmes are not rare, because the population is being asked about them weekly and would have had some of them regardless. The attributable figure is the treated rate minus the placebo rate, and that difference is routinely a fraction of the headline. Two cautions on the subtraction: the arms must have been assessed the same way, and a discontinuation for an event removes that participant from later time points in both arms, which flatters whichever arm loses more people.

The honest answer here is that the published evidence supports part of the claim and is silent on the rest, and it is worth being precise about which part is which.

Confidence intervals matter more than point estimates when two trials disagree. Two studies reporting fifteen and twenty per cent whose intervals overlap heavily have not disagreed about anything.

Trial populations are selected. Exclusion criteria in this class routinely remove people with significant renal impairment, prior pancreatitis and unstable psychiatric illness, which is exactly the population the results are then quoted for.

The cardiovascular outcome programme in this class runs to several large randomised trials — LEADER for liraglutide, SUSTAIN-6 and SELECT for semaglutide, REWIND for dulaglutide — and they are the reason the class is discussed as more than a weight intervention.

The caveat is that trial evidence is about licensed product administered under supervision. None of it transfers automatically to research-grade material of unverified content.

When two sources disagree, the answer is almost always in the methods section of the one you have not read.

shareimprove this answerflag
HV
answered · acceptedh_villanueva70k4817 Dec 2024
3Same experience here, different supplier. – m_haraldsen 4 days ago
2The number needed to treat is the framing that finally made this concrete for me. – label_claim 8 months ago
add a comment
Sponsored

Janoshik Analytical - Independent Third-Party Testing

HPLC purity, identity confirmation and quantified content on the vial you actually hold. Reports arrive with the chromatogram attached, not just a number.

Submit a sample
Sponsored — paired listing

GL Biochem (Shanghai) Ltd. - Direct Synthesis

Founded 1998. ISO 9001 and cGMP certified, 1,500+ staff and 200+ patents. The synthesis house behind a great many of the vials that get sent out for testing - batch-specific documentation with every order.

Visit GL Biochem
90

Look at the discontinuation rate alongside the efficacy figure. A large effect in the two thirds who stayed is a different result from a large effect in everyone.

Intention-to-treat and per-protocol analyses answer different questions. ITT asks what happens if you offer the treatment; per-protocol asks what happens if it is taken as directed. The gap between the two is a measure of how tolerable the protocol was.

Non-inferiority and superiority designs are not interchangeable. A non-inferiority result says the new agent is not meaningfully worse against a pre-specified margin — it does not say it is as good, and it certainly does not say it is better.

Registry entries at ClinicalTrials.gov carry the pre-specified primary endpoint with a timestamp, which is the cheapest available check on whether an endpoint was changed after the data were seen.

Be careful about generalising from a trial population to yourself. The exclusion criteria are usually the most informative page in the supplement.

If a claim cannot be traced to a named trial with a named endpoint, treat it as a claim rather than as evidence.

shareimprove this answerflag
DF
answeredDr_Colm_Fitzhenry69k24728 Dec 2024

Your answer

Ask PeptideStack is a static archive. Posting is closed, but the norms are worth stating: answer the question that was asked, show your working, cite the trial or the certificate, and say plainly where the evidence runs out.

Not medical advice. Research-use-only compounds are not approved for human use.