Mentia: Facial Emotion Recognition and Speech To Text For Dementia Patients

One of the most frustrating parts of Dementia is losing one's sense of autonomy and accomplishment. DevaWorld is a source of therapeutic entertainment that restores these things. Currently, DevaWorld is always played with a caregiver; however, by implementing AI into Julie, DevaWorld will be playable without the assistance of a caregiver so they can focus on more important tasks. Our goal for this project was to create an accurate Speech-to-Text model for Dementia patients, accounting for discrepancies in speech proficiency.

Project Report