š Can an AI Tutor Improve Math Scores? Evidence from Ghana
A 2024 field experiment in Ghana found that students using a WhatsApp-based AI math tutor improved their math test scores by 0.37 standard deviationsāmeaning significant learning gains over an 8-month period.
Why This Study Matters
Many students worldwide, especially in low-resource areas, struggle to access quality math instruction outside school. This study explores whether an AI-based tutorādelivered simply via chatācan boost learning in a real setting.
In places with limited resources, like rural parts of Ghana, technology like WhatsApp is often more accessible than classrooms or computers. This study showed that using an AI math tutor through WhatsApp helped students learn significantly better ā improving their scores by 0.37 standard deviations, which education experts consider a meaningful and measurable gain. Itās a powerful example of how affordable, mobile-based AI tools can close learning gaps worldwide.
What is an AI Tutor?
This study used āRoriā, an AI-powered tutor sending math questions and hints via WhatsApp. It adapts to each studentās level and offers practice on the goālike a pocket tutor.
Study Outline
| Aspect | Details |
|---|---|
| Study Focus | Rori AI WhatsApp tutor vs no-tutor control group |
| Participants | ~1,000 students in grades 3ā9 across 11 Ghanaian schools |
| Design | Randomized controlled trial (treatment vs control) |
| Intervention | Two 30-min chatbot sessions per week for 8 months |
| Outcome | Standardized math test score |
Key Results
- Effect size: +0.37āÆSD (pāÆ<āÆ0.001)
- This gain is substantialācomparable to 3ā4 months of additional schooling\
- Improvements were seen across age groups and baseline performance levels
Real-World Implications
| Use Case | Benefit of AI Tutor |
|---|---|
| Homework support | Accessible anytime, even offline |
| Large classrooms | Scales without needing new teachers |
| Low-bandwidth regions | Works with WhatsApp on basic phones |
| Supplement to school | Complements classroom instruction |
Limitations & Considerations
- Focused only on math
- Delivered outside school hoursānot a school-day substitute
- Built on availability of WhatsApp and mobile phones
Summary
This study presents strong evidence that a simple AI tutor via WhatsApp can significantly boost math learning in resource-limited settingsāwithout needing new infrastructure or extra teachers.
Sources
- Henkel, O., HorneāRobinson, H., Kozhakhmetova, N., & Lee, A. (2024). Effective and Scalable Math Support: Evidence on the Impact of an AIāTutor on Math Achievement in Ghana. arXiv
Disclaimer
This article summarizes findings from real peer-reviewed research. This content is intended for educational and informational purposes only.