Dustin Houchin: Reconsider the enthusiasm for problem-solving courts

The first problem-solving court, a drug court, was established 30 years ago. Since that time, and particularly over the last ten years, problem-solving courts have vastly proliferated.

Today, there are over 4,000 problem-solving courts throughout the country. Indiana, which is amid a problem-solving court expansion, has over 150.

Despite the enthusiasm for problem-solving courts, there is little solid evidence that they work any better than traditional courts.

A quick Google search will find many proclamations that problem-solving courts are effective. Proponents often give anecdotal accounts of success.

Good, empirical studies, however, do not support these claims.

University of Richmond School of Law professor, Erin Collins, published a 2021 article in the University of California, Davis Law Review entitled, “The Problem with Problem-Solving Courts.”

In her article, Collins points out the many issues with the data, or lack thereof, on problem-solving courts. She writes, “with the exception of drug courts, it is widely accepted that problem-solving courts have not been analyzed with rigor sufficient to form a conclusion about their impact.”

Even as to drug courts specifically, which have been extensively studied, Collins notes that, “the data regarding drug courts does not actually tell the unmitigated success story their proponents recite. For example, a recent analysis of drug court evaluations found mixed results. Some studies showed drug courts reduced recidivism (at ‘modest levels’), while others indicated they had no impact on recidivism, and one even found they increased recidivism. Thus, much of the available data about problem-solving court performance undermines or at least tempers the unqualified claims that this is an effective and efficient reform mechanism.”

Collins further points out that, “While some of the earliest studies of drug courts demonstrated recidivism reductions among their participants, it is now widely acknowledged that these studies were marred by methodological flaws that undermine their findings, such as sample size, lack of a meaningful comparison group, and selection bias.”

Collins concludes by noting that “drug court evaluations seem to demonstrate that some drug courts modestly reduce recidivism for some individuals, some of the time. And even for those studies that indicate recidivism reductions, very little is known about which aspect of drug courts lead to these reductions. Moreover, conclusions of efficacy on other metrics—such as cost savings or reducing substance use—are even more tentative.”

Thus, comprehensive reviews of the research literature on problem-solving courts, such as was performed by Collins, reveal that the data on performance is unclear and cannot be relied upon to support claims that they reduce recidivism.

Proponents of problem-solving courts cannot, in good faith, claim that research solidly supports their efficacy.

One of the reasons the research fails to yield reliable conclusions is that problem-solving courts are resistant to empirical study.

To meaningfully research problem-solving courts, one must push through the voluminous anecdotal accounts that make up much of the argument for the courts’ existence.

While anecdotal stories sound good, they do not provide actual data. Further, the anecdotal accounts come from “stakeholders” and participants, each of whom have an interest in saying good things about the courts.

Even when drug courts have been more systematically studied, there are no consistent criteria.

The first step in studying any problem is defining the terms. There are no standardized definitions in this area.

For instance, the big question is always recidivism rates. However, there is no agreed upon definition of recidivism.

Some places define recidivism as re-arrest. Some define it as new convictions. Some use the amorphous term “undesirable outcomes.”

There is also no consensus on the relevant length of time following graduation from the program for one to track recidivism. Does an undesirable outcome three years after graduation count as recidivism? Five years?

There is also no consistent definition of success or failure. If a participant fails every drug screen but the problem-solving court team votes to let him graduate anyway, is that success?

Also, incentives align to show “success” despite poor performance, further marring study.

Finally, there are no studies that follow participants for the length of time necessary to demonstrate real results. Logistical concerns and costs prevent such longitudinal studies, which are necessary to properly evaluate outcomes.

Problem-solving courts have multiplied despite a lack of solid evidence that they work. Indiana is producing not only drug courts, which have at least been studied, but a myriad of other problem-solving courts such as recovery courts and recently safe baby courts, which lack research backing altogether.

Those arguing for these courts most often point to stories of success rather than reliable data. There is a dearth of solid studies showing efficacy, and the studies that exist are plagued by methodological flaws. Because of these things, we should reconsider the current enthusiasm for problem-solving courts.•

__________

Dustin Houchin is the Washington County Superior Court judge in Salem. He also is the publisher of Judex, a Substack newsletter on conservative judicial issues at judex.substack.com. Opinions expressed are those of the author.