A new study from the NYU College of Global Public Health and NYU Tandon School of Engineering, published in Nature Digital Medicine, used text message surveys to determine in real time how people used maternal health services during a recent Ebola outbreak and measured a drop in hospital-based births during the outbreak.
Public health emergencies profoundly affect local healthcare systems and—as seen in the 2014-2016 Ebola outbreak in West Africa—can overwhelm clinics, erode public trust, and decrease healthcare utilization.
Routine data collection systems, such as surveys of households or health facilities, can take months to collect and analyze and are often disrupted by emergencies in regions with weaker infrastructure.
Mobile technology has emerged as a promising tool for collecting data quickly, at a low cost, and across regions that are difficult to reach. While cell phones are prevalent around the world—including in Liberia, where 81% of the population had a cell phone subscription in 2015—questions nonetheless remain about the accuracy of the data generated by text polls. Cell phone users are often younger, more educated, and able to afford a phone, so may not be representative of the general population.
In this study, Rumi Chunara, assistant professor of computer science and engineering and global public health at NYU and the study’s senior author, and her colleagues conducted a poll via text message to ask Liberians about their health, focusing on maternal health services. Participants were asked 10 questions, including whether they knew anyone with Ebola, whether they recently gave birth, and if so, where they delivered (in a government hospital or clinic, a private hospital or clinic, at home or someone else’s home, or another location). Responses were collected from 6,694 individuals from March to June 2015.
Chunara and her colleagues then used a method called propensity score matching to make the data from their text message poll comparable with the 2013 Liberian Demographic Health Survey, the most recent national survey of women of reproductive age. The researchers matched cell phone poll participants who reported giving birth within the past year with women who reported a birth in the 2013 Demographic Health Survey.
Participants in the cell phone poll were generally more educated than the population in the Demographic Health Survey, but propensity score matching enabled the researchers to balance the populations across factors such as age, occupation, education, and location.
“Using these statistical methods to adjust for the populations being different, we were able to make sure we were comparing apples to apples and generating matched groups across which to compare outcomes,” Chunara said.
After matching, the researchers saw that hospital-based deliveries were significantly lower during the Ebola outbreak compared with after the outbreak. This was consistent with the findings of many retrospective studies of healthcare utilization in the Ebola outbreak.
Using text messages to directly assess behaviors also enabled the researchers to measure whether people were using public versus private hospitals. This has been a challenge in other studies of healthcare utilization, which rely mainly on government data sources that only capture public facilities.
The researchers observed similar drops in births in public and private facilities. After the outbreak, the proportion delivering in public hospitals returned to baseline levels; the proportion delivering in private facilities also increased.
