PeptideStack
5.2kquestions
20kanswers
220users

Does the STEP 3 population resemble anyone asking about a GLP-1 receptor agonist here?

Asked 14 Jul 2024Modified 21 months agoViewed 33k times
This question was marked as a duplicate of Does the SURMOUNT-3 population resemble anyone asking about tirzepatide here?Closed 17 Aug 2024. It remains here because the answers below are specific to how it was asked.
36

Setup, so nobody has to ask: STEP 3 · a GLP-1 receptor agonist.

I have read the primary source rather than the summary, which has left me with more questions.

I understand the headline. I do not understand the footnotes, and the footnotes look important.

How should I read this, and where are the traps?

clinical-trials
clinical-trials

Reading the primary literature properly: estimands, intention-to-treat versus per-protocol, confidence intervals, absolute versus relative…

745 questions
harm-reduction
harm-reduction

Reducing avoidable risk where a decision has already been made: independent verification before use, sterility practice, dose arithmetic checked…

472 questions
semaglutide
semaglutide

A GLP-1 receptor agonist with a fatty-acid-acylated backbone and a roughly one-week half-life, marketed for type 2 diabetes and for weight…

470 questions
shareeditfollowflag
SK
askeds_kalniete57k3814 Jul 2024
Add whether the comparator was placebo or an active agent. – Dr_Colm_Fitzhenry 8 months ago
Voting to keep this open — it is more specific than it first looks. – bac_or_bust 6 months ago
add a comment

4 Answers

Accepted answer first, then by votes
76

Accepted answer

Check the STEP 3 inclusion criteria against yourself in that order: entry BMI band, diabetes status, prior weight-loss attempts, and what the run-in excluded. Registration programmes recruit a population selected to show an effect if one exists, which is the right design and a poor basis for generalising. The run-in is the part that is easiest to miss: a programme that drops people during a placebo lead-in has already removed those least likely to tolerate or comply, and the published arms describe the survivors. External validity is not a property of the trial; it is a property of the distance between its population and yours, and that distance is yours to measure.

On the detail: the trial answers a narrower question than the headline suggests, and the narrowing is where the useful information is.

A composite endpoint is only as informative as its least serious component. Where a cardiovascular composite combines death, infarction and stroke, ask which component moved, because they are not interchangeable outcomes.

Open-label extensions are not the same evidence as the randomised phase. Once everyone knows what they are taking, the reported outcomes acquire a bias that no analysis fully removes.

Registry entries at ClinicalTrials.gov carry the pre-specified primary endpoint with a timestamp, which is the cheapest available check on whether an endpoint was changed after the data were seen.

The short version: check the endpoint, check the comparator, check who was excluded, then look at the number.

shareimprove this answerflag
DV
answered · acceptedDr_Ilse_Vandenberg113k2481 Nov 2024
This matches what I was told by a clinician, for whatever that is worth. – tandem_gradient 4 months ago
Is the open-label extension included in that figure, or just the randomised phase? – tess_amankwah 3 months ago
add a comment
Sponsored

Sigma-Aldrich - Certified Reference Materials

Analytical standards and reagents with traceable certificates. Every quantitative result you read inherits the accuracy of the standard behind it.

Shop standards
83

Start with what the trial was powered for. Everything else in the publication is secondary, exploratory, or a subgroup, and those three words mean three different things.

Placebo arms in this class are not nothing. Lifestyle-intervention placebo arms in the major obesity trials commonly lose two to three per cent of body weight, so an active-arm figure quoted without its comparator overstates the drug effect by roughly that much.

The part that matters: non-inferiority and superiority designs are not interchangeable. A non-inferiority result says the new agent is not meaningfully worse against a pre-specified margin — it does not say it is as good, and it certainly does not say it is better.

Meta-analyses in this area are dominated by whichever trial contributed the most participants, so read the forest plot rather than the summary estimate.

Quote the interval alongside the estimate and half the disagreements on this site would not start.

shareimprove this answerflag
TA
answeredtri_gly_ala24k3810 Oct 2024
55

Before comparing two trials, check whether they share an endpoint definition. Frequently they do not, and the numbers then are not comparable in any sense.

Duration decides what can be seen. A 68-week trial can measure weight and glycaemia; it cannot measure anything whose event rate is one per cent per year without enrolling tens of thousands.

Intention-to-treat and per-protocol analyses answer different questions. ITT asks what happens if you offer the treatment; per-protocol asks what happens if it is taken as directed. The gap between the two is a measure of how tolerable the protocol was.

One qualification: absence of a signal in a trial of this size is not evidence of absence for a rare event. It is evidence that the event is rarer than the trial could detect.

When two sources disagree, the answer is almost always in the methods section of the one you have not read.

shareimprove this answerflag
DV
answeredDr_Ilse_Vandenberg113k24821 Oct 2024
35

Specifically, this is answerable from the published record, but only if you take the placebo arm seriously rather than reading the active arm alone.

Trial populations are selected. Exclusion criteria in this class routinely remove people with significant renal impairment, prior pancreatitis and unstable psychiatric illness, which is exactly the population the results are then quoted for.

Where a result is quoted from a conference abstract rather than a peer-reviewed publication, the numbers routinely move between the two. It is worth checking which one you are reading.

The caveat is that trial evidence is about licensed product administered under supervision. None of it transfers automatically to research-grade material of unverified content.

Read the protocol and the statistical analysis plan if the result matters to you. Both are usually published alongside.

edited 6 Aug 2024 by Dr_Jonas_Halvorsen — added the placebo-arm figures

shareimprove this answerflag
DH
answeredDr_Jonas_Halvorsen28k3716 Jul 2024
2Adding a vote because this deserves more of them. – fresh_bac 7 months ago
add a comment

Your answer

Ask PeptideStack is a static archive. Posting is closed, but the norms are worth stating: answer the question that was asked, show your working, cite the trial or the certificate, and say plainly where the evidence runs out.

Not medical advice. Research-use-only compounds are not approved for human use.