Current Researchers: Michael Yeganyan, David Schramm, Meg Cramer, Monica Tentori and Gillian Hayes

Past Collaborators: Sen Hirano, Gabriela Marcu, Mohamad Monibi, David Nguyen

Project: Visual schedules and choice boards are tools used in current best practices for helping children with autism and other special needs. These non-verbal kids need help communicating their choices, understanding time and activities, and so on. We are working with Windows SmartPhone, Linux small displays, and large touchscreen-enabled platforms to develop solutions that ease these burdens, provide logging and visualizations of data, and help automate some of the features of using these communication techniques.

We are also investigating how novel recording technologies, like the Microsoft SenseCam can be used to augment communication between non-verbal children with autism and their caregivers – including both parents and teachers.

Watch a talk Gillian gave at Microsoft Research that covers some of the autism and FitBaby work:  http://research.microsoft.com/apps/video/default.aspx?id=121512

This work is supported in part by technical assistance and equipment through a collaboration with Microsoft Reserach Cambdridge.

This work is supported by AutismSpeaks Innovative Technologies For Autism program, a generous equipment donation from Nokia Research Palo Alto, and an NSF CAREER award.

The vSked and SenseCam for Autism projects will be presented at IMFAR 2008 in Chicago.

This work was presented at IDC as a poster at the main conference and at the Design for Children with Special Needs Workshop:

The vSked and SenseCam for Autism projects will be presented at IMFAR this year in Chicago.

This work was presented at IDC as a poster at the main conference and at the Design for Children with Special Needs Workshop:

vSked: Interactive Visual Scheduling Systems
Gillian R. Hayes
David Nguyen
Michael Yeganyan
Sen Hirano
Gabriela Marcu

SenseCam
Gillian R. Hayes
Gabriela Marcu

Mocotos:  Mobile Communications Tools for Children with Special Needs
Mohamad Monibi
Gillian R. Hayes

Interactive and Intelligent Visual Communication Systems
Gillian R. Hayes
Donald J. Patterson
Mohamad Monibi
Sam Kaufman

This work was also presented at the International Meeting for Autism Research as a poster:

Design of Interactive Visual Scheduling Systems
Sam Kaufman
Donald J. Patterson
Gillian R. Hayes

This highly competitive program comes with three years of funding.

Congratulations to all the winners!

Original Source

As a child, Gillian Hayes fainted a lot. Doctors asked her to write down how she felt and what she was doing each time she became woozy.

“I thought it was the most ridiculous thing I’d ever heard. The solution is to create and track a bunch of records?” says Hayes, UC Irvine informatics assistant professor. “There had to be a better way.”

The experience piqued her interest in computerized record-keeping, particularly in the areas of healthcare and education. Today, Hayes designs computerized devices that help teachers work with children who have autism.

Gillian Hayes, UCI informatics assistant professor, designs technology that helps teachers work with children who have autism.

One device, called Selective Archiving, records video of a classroom. If a child with disruptive or dangerous behavioral tendencies acts up, the teacher presses a button to save that section of video, as with TiVo. He or she can then watch the recording after hours, when there are fewer distractions. If the button is never pressed, nothing is saved, which protects privacy.

Teachers of children with autism are required to document and analyze disturbing behavior over weeks or even months to determine trends and monitor progress. “Using our system, teachers at a test school went from a nearly 74 percent undocumented rate to just above 41 percent, which is pretty good when you consider how much happens in a busy classroom,” Hayes says.

Another device, Visual Scheduler (vSked for short), takes children with autism through exercises in which they identify the day of the week, the month, the weather outside and other things a teacher might ask in a typical elementary school classroom. On a handheld touch screen, they press a button to choose an answer. If they pick the wrong one, the correct button shakes and turns colors, eliminating the need for a teacher to physically point to the right answer.

Previously, the children stuck answers to a laminated folder using Velcro – a system that wasn’t able to track trends like always choosing the option on the left. “Those kinds of patterns are really hard to see in the analog, paper-based world, but they’re easy to spot with a computer,” Hayes says.

She’s also interested in record-keeping for people with chronic illnesses or conditions such as asthma and obesity, which can occur episodically throughout an individual’s life.

“We need to start thinking about healthcare over a lifetime and not just the acute moments of having the flu or breaking a leg,” Hayes says. “If we have data when we’re healthy, we’ll know much more quickly when we start to decline. The earlier we’re diagnosed, the better the outcome is going to be.”

Computing, she says, can be applied to most problems.

“Everything has computers – your car, the lights in your house, your microwave,” Hayes says. “By combining the things computers do well with human ingenuity, we can address almost any societal issue, from education to healthcare to the environment.”

— Jennifer Fitzenberger, University Communications

Related Links

• Gillian Hayes faculty profile
• Department of Informatics
• Donald Bren School of Information & Computer Sciences