Heterogeneity of treatment effect: additional difficulties

Share with your friends










Submit

An article by Diamond and Kaul in the American Journal of Cardiology outlines additional difficulties for the science of medical predictions.

Some of the problems related to HTE have been outlined by Kravitz et al.,  as we have previously seen, and Kent et al. offered a proposal to mitigate them.  But as we noted, the proposal by Kent et al. assumes a treatment that provides fixed relative risk reduction across the range of risks.  This is displayed in Panel A in the AJC paper:

Kaul and Diamond

The thin line is the hypothetical baseline risk-outcome relationship, the bold line is the post-treatment risk-outcome relationship.  In Panel A, the relative risk reduction is constant.  As one moves from lower risk to higher risk, the absolute benefit (vertical difference between the lines) increases.Continue reading “Heterogeneity of treatment effect: additional difficulties”

More on HTE

Share with your friends










Submit

I am very grateful to Dr. James Gaulte for pointing out the paper by Kravitz et al. on the vexing problem of heterogeneity of treatment effects (HTE).  The article indeed provides a very clear and comprehensive explanation of the issues, and it is apparent that the proposal by Kent et al. discussed in the last post was aimed at addressing some of the challenges described by Kravitz et al.  I agree with Dr. Gaulte that the article should be recommended reading for medical students (and we’re all medical students…), but I will present here additional comments about the specifics of the paper, as well as the general philosophy that the authors seem to espouse.  Interested readers are encouraged to review the paper first.Continue reading “More on HTE”

Dealing with variable risk

Share with your friends










Submit

I mentioned in the last post a recent proposal by Kent et al. that would improve clinical trial reporting and—in the authors’ words—lead to “actionable” clinical trial results.  The proposal addresses “heterogeneity of treatment effect (HTE)” and the relationship of that effect to the baseline risk of clinical trial enrollees.

HTE is the technical term used to reflect the fact that clinical trials (other than N-of-1 trials) are designed to reach a conclusion about an overall treatment effect, usually reported as relative or absolute risk reduction for the treated population when compared to the control group.  Clinical trial results tell nothing specific about an individual subject’s response to treatment.

Clearly, not everyone enrolled in the treatment arm of a given clinical trial benefits from (or is harmed by) the intervention.  Attempts to sort out who benefits most or least is usually done by dividing the trial population into subgroups, one characteristic at a time (eg. male vs female, old vs. young, hypertensive vs. normotensive, etc.), and by performing a statistical analysis on each subgroup.  Traditional subgroup analyses, however, are fraught with many well known limitations and are not practically useful to help identify those likely to benefit.

In this proposal, Continue reading “Dealing with variable risk”

“EBM” on the decline

Share with your friends










Submit

In August 2010, a group of eminent statisticians and clinical trial specialists (Drs. Kent, Rothwell, Ioannidis, Altman, and Hayward) published online a proposal to deal with a major short-coming of clinical trials, the so-called heterogeneity of treatment effect (HTE).  The authors offer a refinement in the way clinical trial results are analyzed and reported.

Perhaps sensing mounting dissatisfaction with the blunt tool of ‘evidence-based medicine,’ and perhaps in an attempt to dismiss any further rebuff, Kent et al. introduce their proposal by characterizing the critics of EBM as mere Luddites:Continue reading ““EBM” on the decline”

A brief history of official dietary recommendations

Share with your friends










Submit

1992

The USDA introduces its food guide pyramid

 

2005

The USDA modifies its food guide pyramid to more accurately reflect knowledge in nutrition science….Continue reading “A brief history of official dietary recommendations”

More reasons statin drugs are shunned

Share with your friends










Submit

A “reader’s comment” on an opinion piece by William C. Roberts in the American Journal of Cardiology, kindly published by the editor.  Roberts’ editorial focuses on the large body of evidence favoring the cholesterol hypothesis and laments what he considers the distracting effect of complementary hypotheses (eg. inflammation, “multifactorial” nature of atherosclerosis, etc.).  I offer a few points regarding the difficulties of dealing with strictly risk-based diagnoses that rely on arbitrary cut-off numbers and have no defining pathological correlates.  Unfortunately not free online, but I’m happy to provide reprints upon request.

The problem with transparency

Share with your friends










Submit

While the NIH is tightening its rules concerning what financial ties university researchers must disclose before getting public grants, the FDA may be loosening its own criteria for excluding potential advisors based on their industry connections.  It seems that as a consequence of the disclosure business, the only experts who would pass muster were no experts after all

Meanwhile a story in Cardiology News this month tags yet again Dr. Paul Ridker with the issue of conflict of interest.  It seems the inflammatologist felt obligated to elaborate once more on his “lengthy disclosure slide” before giving a lecture at a scientific meeting.  But Ridker is now taking a more offensive stance and arguesContinue reading “The problem with transparency”

“Intolerable” laissez-faire in medicine: the early years of the Mayo Clinic

Share with your friends










Submit

[Shortly after its initial posting on this site, this article was also cross-posted on the website the Ludwig von Mises Institute under the title “The Mayo Clinic and the Free Market.” I have made some very minor edits since then. MA. April 18, 2015.]

Neoclassical economists such as Kenneth Arrow and Joseph Stiglitz tell us that the health care market is imperfect (or “Pareto inefficient”), meaning that the allocation of services is not optimal from the standpoint of social welfare.   They point to information asymmetry as an important cause of this imperfection: patients cannot distinguish on their own the physician from the charlatan, the surgeon from the butcher, the remedy from the snake oil, the hospital from the coop.  This may lead to moral hazard where the party with the most knowledge can provide inferior service with impunity.

To provide the necessary counterbalance for this “knowledge gap,” experts must be in charge of social institutions that tell patients where to go, who to see, how to be treated, and how much it should cost.  This has been a principal and virtually unchallenged argument underpinning health care legislation in the last 100 years.  In a famous paper he wrote on the subject in 1963, Arrow declared that “It is the general social consensus, clearly, that the laissez-faire solution for medicine is intolerable.”

But for those who wonder how intolerable the “laissez-faire solution” really is, a short booklet published in 1926 may prove instructive.  Continue reading ““Intolerable” laissez-faire in medicine: the early years of the Mayo Clinic”

Quantophrenia in medicine and elsewhere

Share with your friends










Submit

Pitirim Sorokin had coined the term to criticize the misapplication of quantitative methods to sociology.  Murray Rothbard borrowed it from Sorokin to describe—in his usual lampooning style—the age-old fascination with mathematical modeling of economic phenomena.  In his Economic Thought Before Adam Smith he points back to Pythagoras to show the influence of number mysticism on the economic thought of Aristotle (who should have known better if we recall the quote from Ethics: “it is the mark of the educated man…”).  The same tendency grips Bacon and Petty who developed ‘political arithmetic’ in the 17th century.  Rothbard also identifies Bernoulli’s founding of ‘mathematical economics’ as leading the way to Walras’ ‘equilibrium theory,’ and so forth.

F.A. Hayek addressed the topic directly in The Counter-Revolution of Science, detailing the origin, thoughts, and influence of the “positivists” buoyed by a transcendent enthusiasm for the exact sciences.  Gilles Paquet recently published a paper titled “Quantophrenia” to review the influence of this form of numerology on public policy.

Emile Durkheim, intellectual heir to Auguste Comte and the positivists, was invoked to shed light on the theories of Geoffrey Rose, our public health maître-à-penser.  Continue reading “Quantophrenia in medicine and elsewhere”

Why N of 1 is enough…

Share with your friends










Submit

Of all the problems regarding large scale clinical trials cataloged by James Penston, the most compelling is the inverse relationship between practical value and trial size.  This could almost be formulated as a law:

The clinical value of a randomized controlled trial is inversely related to its size

Of course, clinical is used in the original sense, meaning at the bedside.

It is a testimony to the effect of propaganda promoting “powerful” clinical trials that this law may sound counter-intuitive when in fact it is so obvious: if it takes 18,000 patients to demonstrate an effect, how relevant or useful is the information likely to be for a clinician dealing with an individual patient?  And there is now some empirical evidence that the phenomenon of conducting, reporting, and inflating trials with “tiny effects” is getting more and more common.Continue reading “Why N of 1 is enough…”