AI / ML
GenAI VR Brain-Injury Rehabilitation
VR therapy scenarios and multi-agent LLM workflows that help brain-injury patients regain memory, focus and communication.
- 60%less setup time
- 80%patients improved
- 1paper under review
Problem
Brain-injury patients need repeated, engaging practice to rebuild memory, focus and communication. The existing VR scenarios were tied to one headset platform and slow to set up.
What I did
- Phase 1: resolved cross-platform issues and made the HTC focus and memory scenarios Meta-compatible, cutting patient setup time by 60%. 80% of patients improved with VR therapy.
- Phase 2: built a communication scenario using GenAI models, and experimented with custom models.
- Agent system: designed modular multi-agent workflows in Python: analyst agents, configuration/creation agents, manager agents and skill-based data-fetching agents, coordinated by orchestrator and router agents. Tuned performance through structured prompt design, tool integration and workflow monitoring.
Outcome
The work is written up in Virtual Reality Rehabilitation for a Post-ICU Hospitalized Patient with a Traumatic Brain Injury: A Case Report (under review at Neuropsychological Rehabilitation), in partnership with the Brain Injury Center of Ventura County.
Related: Dr. Kristen Linton’s post on AI Basecamp at CSU Channel Islands 2024.