Publications

    Anna D Gage, Hannah H Leslie, Asaf Bitton, Gregory J Jerome, Jean Paul Joseph, Roody Thermidor, and Margaret E Kruk. 2018. “Does quality influence utilization of primary health care? Evidence from Haiti.” Global Health, 14, 1, Pp. 59.Abstract
    BACKGROUND: Expanding coverage of primary healthcare services such as antenatal care and vaccinations is a global health priority; however, many Haitians do not utilize these services. One reason may be that the population avoids low quality health facilities. We examined how facility infrastructure and the quality of primary health care service delivery were associated with community utilization of primary health care services in Haiti. METHODS: We constructed two composite measures of quality for all Haitian facilities using the 2013 Service Provision Assessment survey. We geographically linked population clusters from the Demographic and Health Surveys to nearby facilities offering primary health care services. We assessed the cross-sectional association between quality and utilization of four primary care services: antenatal care, postnatal care, vaccinations and sick child care, as well as one more complex service: facility delivery. RESULTS: Facilities performed poorly on both measures of quality, scoring 0.55 and 0.58 out of 1 on infrastructure and service delivery quality respectively. In rural areas, utilization of several primary cares services (antenatal care, postnatal care, and vaccination) was associated with both infrastructure and quality of service delivery, with stronger associations for service delivery. Facility delivery was associated with infrastructure quality, and there was no association for sick child care. In urban areas, care utilization was not associated with either quality measure. CONCLUSIONS: Poor quality of care may deter utilization of beneficial primary health care services in rural areas of Haiti. Improving health service quality may offer an opportunity not only to improve health outcomes for patients, but also to expand coverage of key primary health care services.
    Anna D Gage, Margaret E Kruk, Tsinuel Girma, and Ephrem T Lemango. 2018. “The know-do gap in sick child care in Ethiopia.” PLoS One, 13, 12, Pp. e0208898.Abstract
    BACKGROUND: While health care provider knowledge is a commonly used measure for process quality of care, evidence demonstrates that providers don't always perform as much as they know. We describe this know-do gap for malaria care for sick children among providers in Ethiopia and examine what may predict this gap. METHODS: We use a 2014 nationally-representative survey of Ethiopian providers that includes clinical knowledge vignettes of malaria care and observations of care provided to children in facilities. We compare knowledge and performance of assessment, treatment and counseling items and overall. We subtract performance scores from knowledge and use regression analysis to examine what facility and provider characteristics predict the gap. 512 providers that completed the malaria vignette and were observed providing care to sick children were included in the analysis. RESULTS: Vignette and observed performance were both low, with providers on average scoring 39% and 34% respectively. The know-do gap for assessment was only 1%, while the gap for treatment and counseling items was 39%. Doctors had the largest gap between knowledge and performance. Only provider type and availability of key equipment significantly predicted the know-do gap. CONCLUSIONS: While both provider knowledge and performance in sick child care are poor, there is a gap between knowledge and performance particularly with regard to treatment and counseling. Interventions to improve quality of care must address not only deficiencies in provider knowledge, but also the gap between knowledge and action.
    Mark D Huffman, Padinhare P Mohanan, Raji Devarajan, Abigail S Baldridge, Dimple Kondal, Lihui Zhao, Mumtaj Ali, Mangalath N Krishnan, Syam Natesan, Rajesh Gopinath, Sunitha Viswanathan, Joseph Stigi, Johny Joseph, Somanathan Chozhakkat, Donald M Lloyd-Jones, Dorairaj Prabhakaran, and Acute Coronary Syndrome Quality Improvement Kerala (ACS QUIK) in Investigators. 2018. “Effect of a Quality Improvement Intervention on Clinical Outcomes in Patients in India With Acute Myocardial Infarction: The ACS QUIK Randomized Clinical Trial.” JAMA, 319, 6, Pp. 567-578.Abstract
    Importance: Wide heterogeneity exists in acute myocardial infarction treatment and outcomes in India. Objective: To evaluate the effect of a locally adapted quality improvement tool kit on clinical outcomes and process measures in Kerala, a southern Indian state. Design, Setting, and Participants: Cluster randomized, stepped-wedge clinical trial conducted between November 10, 2014, and November 9, 2016, in 63 hospitals in Kerala, India, with a last date of follow-up of December 31, 2016. During 5 predefined steps over the study period, hospitals were randomly selected to move in a 1-way crossover from the control group to the intervention group. Consecutively presenting patients with acute myocardial infarction were offered participation. Interventions: Hospitals provided either usual care (control group; n = 10 066 participants [step 0: n = 2915; step 1: n = 2649; step 2: n = 2251; step 3: n = 1422; step 4; n = 829; step 5: n = 0]) or care using a quality improvement tool kit (intervention group; n = 11 308 participants [step 0: n = 0; step 1: n = 662; step 2: n = 1265; step 3: n = 2432; step 4: n = 3214; step 5: n = 3735]) that consisted of audit and feedback, checklists, patient education materials, and linkage to emergency cardiovascular care and quality improvement training. Main Outcomes and Measures: The primary outcome was the composite of all-cause death, reinfarction, stroke, or major bleeding using standardized definitions at 30 days. Secondary outcomes included the primary outcome's individual components, 30-day cardiovascular death, medication use, and tobacco cessation counseling. Mixed-effects logistic regression models were used to account for clustering and temporal trends. Results: Among 21 374 eligible randomized participants (mean age, 60.6 [SD, 12.0] years; n = 16 183 men [76%] ; n = 13 689 [64%] with ST-segment elevation myocardial infarction), 21 079 (99%) completed the trial. The primary composite outcome was observed in 5.3% of the intervention participants and 6.4% of the control participants. The observed difference in 30-day major adverse cardiovascular event rates between the groups was not statistically significant after adjustment (adjusted risk difference, -0.09% [95% CI, -1.32% to 1.14%]; adjusted odds ratio, 0.98 [95% CI, 0.80-1.21]). The intervention group had a higher rate of medication use including reperfusion but no effect on tobacco cessation counseling. There were no unexpected adverse events reported. Conclusions and Relevance: Among patients with acute myocardial infarction in Kerala, India, use of a quality improvement intervention compared with usual care did not decrease a composite of 30-day major adverse cardiovascular events. Further research is needed to understand the lack of efficacy. Trial Registration: clinicaltrials.gov Identifier: NCT02256657.
    Lisa R Hirschhorn, Rohit Ramaswamy, Mahesh Devnani, Abraham Wandersman, Lisa A Simpson, and Ezequiel Garcia-Elorrio. 2018. “Research versus practice in quality improvement? Understanding how we can bridge the gap.” Int J Qual Health Care, 30, suppl_1, Pp. 24-28.Abstract
    The gap between implementers and researchers of quality improvement (QI) has hampered the degree and speed of change needed to reduce avoidable suffering and harm in health care. Underlying causes of this gap include differences in goals and incentives, preferred methodologies, level and types of evidence prioritized and targeted audiences. The Salzburg Global Seminar on 'Better Health Care: How do we learn about improvement?' brought together researchers, policy makers, funders, implementers, evaluators from low-, middle- and high-income countries to explore how to increase the impact of QI. In this paper, we describe some of the reasons for this gap and offer suggestions to better bridge the chasm between researchers and implementers. Effectively bridging this gap can increase the generalizability of QI interventions, accelerate the spread of effective approaches while also strengthening the local work of implementers. Increasing the effectiveness of research and work in the field will support the knowledge translation needed to achieve quality Universal Health Coverage and the Sustainable Development Goals.
    Hannah H Leslie, Zeye Sun, and Margaret E Kruk. 2017. “Association between infrastructure and observed quality of care in 4 healthcare services: A cross-sectional study of 4,300 facilities in 8 countries.” PLoS Med, 14, 12, Pp. e1002464.Abstract
    BACKGROUND: It is increasingly apparent that access to healthcare without adequate quality of care is insufficient to improve population health outcomes. We assess whether the most commonly measured attribute of health facilities in low- and middle-income countries (LMICs)-the structural inputs to care-predicts the clinical quality of care provided to patients. METHODS AND FINDINGS: Service Provision Assessments are nationally representative health facility surveys conducted by the Demographic and Health Survey Program with support from the US Agency for International Development. These surveys assess health system capacity in LMICs. We drew data from assessments conducted in 8 countries between 2007 and 2015: Haiti, Kenya, Malawi, Namibia, Rwanda, Senegal, Tanzania, and Uganda. The surveys included an audit of facility infrastructure and direct observation of family planning, antenatal care (ANC), sick-child care, and (in 2 countries) labor and delivery. To measure structural inputs, we constructed indices that measured World Health Organization-recommended amenities, equipment, and medications in each service. For clinical quality, we used data from direct observations of care to calculate providers' adherence to evidence-based care guidelines. We assessed the correlation between these metrics and used spline models to test for the presence of a minimum input threshold associated with good clinical quality. Inclusion criteria were met by 32,531 observations of care in 4,354 facilities. Facilities demonstrated moderate levels of infrastructure, ranging from 0.63 of 1 in sick-child care to 0.75 of 1 for family planning on average. Adherence to evidence-based guidelines was low, with an average of 37% adherence in sick-child care, 46% in family planning, 60% in labor and delivery, and 61% in ANC. Correlation between infrastructure and evidence-based care was low (median 0.20, range from -0.03 for family planning in Senegal to 0.40 for ANC in Tanzania). Facilities with similar infrastructure scores delivered care of widely varying quality in each service. We did not detect a minimum level of infrastructure that was reliably associated with higher quality of care delivered in any service. These findings rely on cross-sectional data, preventing assessment of relationships between structural inputs and clinical quality over time; measurement error may attenuate the estimated associations. CONCLUSION: Inputs to care are poorly correlated with provision of evidence-based care in these 4 clinical services. Healthcare workers in well-equipped facilities often provided poor care and vice versa. While it is important to have strong infrastructure, it should not be used as a measure of quality. Insight into health system quality requires measurement of processes and outcomes of care.
    Hannah H Leslie, Address Malata, Youssoupha Ndiaye, and Margaret E Kruk. 2017. “Effective coverage of primary care services in eight high-mortality countries.” BMJ Glob Health, 2, 3, Pp. e000424.Abstract
    Introduction: Measurement of effective coverage (quality-corrected coverage) of essential health services is critical to monitoring progress towards the Sustainable Development Goal for health. We combine facility and household surveys from eight low-income and middle-income countries to examine effective coverage of maternal and child health services. Methods: We developed indices of essential clinical actions for antenatal care, family planning and care for sick children from existing guidelines and used data from direct observations of clinical visits conducted in Haiti, Kenya, Malawi, Namibia, Rwanda, Senegal, Tanzania and Uganda between 2007 and 2015 to measure quality of care delivered. We calculated healthcare coverage for each service from nationally representative household surveys and combined quality with utilisation estimates at the subnational level to quantify effective coverage. Results: Health facility and household surveys yielded over 40 000 direct clinical observations and over 100 000 individual reports of healthcare utilisation. Coverage varied between services, with much greater use of any antenatal care than family planning or sick-child care, as well as within countries. Quality of care was poor, with few regions demonstrating more than 60% average performance of basic clinical practices in any service. Effective coverage across all eight countries averaged 28% for antenatal care, 26% for family planning and 21% for sick-child care. Coverage and quality were not strongly correlated at the subnational level; effective coverage varied by as much as 20% between regions within a country. Conclusion: Effective coverage of three primary care services for women and children in eight countries was substantially lower than crude service coverage due to major deficiencies in care quality. Better performing regions can serve as examples for improvement. Systematic increases in the quality of care delivered-not just utilisation gains-will be necessary to progress towards truly beneficial universal health coverage.
    Maria Steenland, Paul Jacob Robyn, Philippe Compaore, Moussa Kabore, Boukary Tapsoba, Aloys Zongo, Ousmane Diadie Haidara, and Günther Fink. 2017. “Performance-based financing to increase utilization of maternal health services: Evidence from Burkina Faso.” SSM Popul Health, 3, Pp. 179-184.Abstract
    Performance-based financing (PBF) programs are increasingly implemented in low and middle-income countries to improve health service quality and utilization. In April 2011, a PBF pilot program was launched in Boulsa, Leo and Titao districts in Burkina Faso with the objective of increasing the provision and quality of maternal health services. We evaluate the impact of this program using facility-level administrative data from the national health management information system (HMIS). Primary outcomes were the number of antenatal care visits, the proportion of antenatal care visits that occurred during the first trimester of pregnancy, the number of institutional deliveries and the number of postnatal care visits. To assess program impact we use a difference-in-differences approach, comparing changes in health service provision post-introduction with changes in matched comparison areas. All models were estimated using ordinary least squares (OLS) regression models with standard errors clustered at the facility level. On average, PBF facilities had 2.3 more antenatal care visits (95% CI [0.446-4.225]), 2.1 more deliveries (95% CI [0.034-4.069]) and 9.5 more postnatal care visits (95% CI [6.099, 12.903]) each month after the introduction of PBF. Compared to the service provision levels prior to the interventions, this implies a relative increase of 27.7 percent for ANC, of 9.2 percent for deliveries, and of 118.7 percent for postnatal care. Given the positive results observed during the pre-pilot period and the limited resources available in the health sector, the PBF program in Burkina Faso may be a low-cost, high impact intervention to improve maternal and child health.
    Mohammed K Ali, Kavita Singh, Dimple Kondal, Raji Devarajan, Shivani A Patel, Roopa Shivashankar, Vamadevan S Ajay, AG Unnikrishnan, Usha V Menon, Premlata K Varthakavi, Vijay Viswanathan, Mala Dharmalingam, Ganapati Bantwal, Rakesh Kumar Sahay, Muhammad Qamar Masood, Rajesh Khadgawat, Ankush Desai, Bipin Sethi, Dorairaj Prabhakaran, Venkat KM Narayan, Nikhil Tandon, and Nikhil Tandon. 2016. “Effectiveness of a Multicomponent Quality Improvement Strategy to Improve Achievement of Diabetes Care Goals: A Randomized, Controlled Trial.” Ann Intern Med, 165, 6, Pp. 399-408.Abstract
    BACKGROUND: Achievement of diabetes care goals is suboptimal globally. Diabetes-focused quality improvement (QI) is effective but remains untested in South Asia. OBJECTIVE: To compare the effect of a multicomponent QI strategy versus usual care on cardiometabolic profiles in patients with poorly controlled diabetes. DESIGN: Parallel, open-label, pragmatic randomized, controlled trial. (ClinicalTrials.gov: NCT01212328). SETTING: Diabetes clinics in India and Pakistan. PATIENTS: 1146 patients (575 in the intervention group and 571 in the usual care group) with type 2 diabetes and poor cardiometabolic profiles (glycated hemoglobin [HbA1c] level ≥8% plus systolic blood pressure [BP] ≥140 mm Hg and/or low-density lipoprotein cholesterol [LDLc] level ≥130 mg/dL). INTERVENTION: Multicomponent QI strategy comprising nonphysician care coordinators and decision-support electronic health records. MEASUREMENTS: Proportions achieving HbA1c level less than 7% plus BP less than 130/80 mm Hg and/or LDLc level less than 100 mg/dL (primary outcome); mean risk factor reductions, health-related quality of life (HRQL), and treatment satisfaction (secondary outcomes). RESULTS: Baseline characteristics were similar between groups. Median diabetes duration was 7.0 years; 6.8% and 39.4% of participants had preexisting cardiovascular and microvascular disease, respectively; mean HbA1c level was 9.9%; mean BP was 143.3/81.7 mm Hg; and mean LDLc level was 122.4 mg/dL. Over a median of 28 months, a greater percentage of intervention participants achieved the primary outcome (18.2% vs. 8.1%; relative risk, 2.24 [95% CI, 1.71 to 2.92]). Compared with usual care, intervention participants achieved larger reductions in HbA1c level (-0.50% [CI, -0.69% to -0.32%]), systolic BP (-4.04 mm Hg [CI, -5.85 to -2.22 mm Hg]), diastolic BP (-2.03 mm Hg [CI, -3.00 to -1.05 mm Hg]), and LDLc level (-7.86 mg/dL [CI, -10.90 to -4.81 mg/dL]) and reported higher HRQL and treatment satisfaction. LIMITATION: Findings were confined to urban specialist diabetes clinics. CONCLUSION: Multicomponent QI improves achievement of diabetes care goals, even in resource-challenged clinics. PRIMARY FUNDING SOURCE: National Heart, Lung, and Blood Institute and UnitedHealth Group.

Pages