Data-driven “wellness rewards” programs allow covert discrimination

By | September 18, 2019
Image originally posted to Flickr by Muffet under the cc 2.0. https://www.flickr.com/photos/53133240@N00/4206360542

A grocery store produce shelf.

Access to care facilitates better health, and much of the work in Medical Care analyzes policy changes that affect insurance coverage both for the population as a whole and for disadvantaged groups (see examples, here, here, and here). Unfortunately, even as governments and researchers work on existing problems, technology is enabling new barriers. Wellness programs may use personal information such as disease history, seat belt use, and even grocery purchases in ways unexpected by employees. A recent Kaiser Family Foundation article focuses on substantial privacy risks while others have focused on fairness.

Aside from privacy, though, there is another crucial issue that is not discussed, particularly with respect to grocery-based wellness rewards programs. Grocery purchases can reveal information about race, social class, and even pre-existing conditions; basing health insurance prices on these attributes is possibly illegal and definitely unfair. It is impossible to implement grocery-based wellness rewards programs without implicit discrimination, even assuming companies act in good faith.

Let’s use race as an example. According to market research by Nielsen, in aggregate, race is statistically associated with grocery purchasing patterns. More to the point, healthy eating scores produced by well-meaning health researchers, with no intent to discriminate, still stratify people by race. For example, take a look at this study, a small-scale Washington D.C. effort including mostly Black and White older women. The raw data are not published, but some back-of-the-envelope calculations indicate that grocery information could separate Black and White participants with about 68% accuracy, subject to certain assumptions. For those wanting evidence on a broader scale, with more geographic, demographic, and topical diversity, a review [pdf] of more than 100 nutrition studies explains:

Accessing healthy food is a challenge for many Americans—particularly those living in low-income neighborhoods, communities of color, and rural areas.

Any honest attempt at grocery-based wellness rewards has a moral and legal responsibility to address these issues. Below, I argue this is impossible in theory given the state of the art about how to define “fairness” for a predictive algorithm, and impossible in practice given our incomplete understanding of health science.

On fairness pitfalls

Some people would object to this argument, saying that healthy eating scores are fair as long as they reflect the biological impact of diet on health. Why bring in complicated considerations about race, class, and pre-existing conditions when we could be having a simple discussion about rewarding people who make healthy choices of what to eat? This is the crux of the argument, and in fact, there are several reasons.

Fairness through unawareness does not work

First, the correlation between diet and health does not always indicate a biological effect: health effects of diet overlap confusingly with other possible causes. For example, a 2005 Medical Care article found higher rates of cardiac morbidity in Black patients, with Black study participants having over five times the rate of hypertension hospitalizations.

If eating habits drive this trend, shouldn’t that justify wellness rewards programs with different average rewards by race? Maybe, but in fact, eating habits explain only a fraction of the difference in health outcomes. The study attributes much of the difference to lower rates of revascularization surgeries in Black patients. In a situation like this, dietary proxies for Blackness may predict heart disease, and naive wellness rewards programs may follow suit in raising prices, even though diet differences are not causing the disease.

Fairness requires an impossible level of detail

Second, try to enter a room with a Black consumer and a White consumer and explain why it’s fair that the foods one of them grew up eating will now cost her extra in health insurance. If they object, their intuition matches a carefully reasoned criterion called counterfactual fairness. To be “fair” according to this work, predictions must remain unaffected by changes in someone’s “protected attributes,” which for purposes of this discussion should include someone’s race and their family’s races. Crucially, the paper also recommends avoiding any measurement that depends on protected attributes. Assessing whether a family’s food preferences depend on race would require a thorough family history project full of impossible counterfactual questions. Would your great-grandmother have borrowed that cookbook from her neighbor if she were White? Would she have even lived in that same neighborhood? Gone to that same market? Had the same amount of money to spend on food? Given the uncertainties involved, the only feasible, fair practice is to avoid using groceries for wellness rewards.

Fairness suffers from the legacy of racism

Third, health research — even completely reasonable and well-meaning health research — is affected by our perceptions about race. Consider this example, which is a large, geographically widespread, multi-racial study of the associations between race, geography, Southern-style diet, and stroke risk.

This is a careful and impressive piece of work. But, it prioritizes diet-associated disease in Black Americans, leaving other important questions unanswered. The first sentence of the paper makes the priorities clear: “Black Americans and residents of the Southeastern United States are at increased risk of stroke,” and the authors want to know why. Unfortunately for us, ignoring health outcomes besides stroke can lead to strange findings. Another unhealthy eating pattern that the authors’ name “Sweets/Fats” was more common in White Americans. Despite summarizing items such as candy and desserts, “Sweets/Fats” consumption correlated with a reduction in stroke risk. The authors did not expect this, and their best explanation is that eating Sweets/Fats “protects” people from strokes only by killing them with cancer or heart disease before a stroke can happen.

The implication: any wellness rewards program that responds to this study could take its well-meaning focus on Black Americans’ stroke risk and use that to impose higher health insurance prices, while essentially ignoring unhealthy choices common among White Americans. This could happen even if diet is guaranteed to be biologically causing strokes. (You can learn more about recent trends in stroke rates and risk factors here.) Again, the problem is not the study. Through no fault of the authors, our understanding of nutrition and health is incomplete, and it’s incomplete in ways that are deeply affected by race. Under these circumstances, designing a fair wellness rewards program is not feasible.

If we are going to charge some people more for health insurance, we have a moral and legal responsibility to ensure we are not penalizing them based on race, class, and pre-existing conditions. With a complicated grocery-based system, this is impossible: grocery purchases are wound up in our lives much too tightly for it to work. Even carefully designed healthy eating scores stratify people by race. Because correlation is not causation, “fairness through unawareness” is not enough to avoid unacceptable bias. People should not be penalized for cultural preferences, even those with a genuine causal effect on health. Even if well-meaning programs focus on causal effects of diet, the legacy of racism is baked into well-meaning health research, shaping whose diet and what health outcomes are scrutinized. Together, these problems make fair wellness rewards programs impossible.

This shouldn’t be a big surprise. Discrimination has arisen time and again through supposedly neutral decision criteria. You may not agree with every claim out there, but examples abound, ranging from redlining, predictive policing, and drug policy to IQ tests and college admissions.

Call to action

Ideally, health insurers should abandon grocery-based wellness rewards. Perhaps they could instead focus their efforts on making healthy food accessible and convenient for their members. If they choose to adopt wellness rewards programs, they should make their datasets, methods, and principles transparent so that we can decide for ourselves whether programs are fair.

In the Houston incident discussed by Kaiser Health News, the city government switched to a separate program after a backlash. Objections from the police union and other city employees were critical to that decision. The best way for consumers to regain power over their data is to organize: only labor unions or other large-scale associations have enough leverage to negotiate with large employers about institutional decisions on health benefits.

ekernf01
Eric Kernfeld is a bioinformatician at the University of Massachusetts Medical School, where he contributes to an interdisciplinary team focused on autoimmune disease, immune system development, stem cell biology, and single-cell genomics. He has degrees in mathematics and statistics, and he maintains an independent research blog.