Navigation Bar Products R&D Education Support About Us Mobility Agents Mr. Vetro

Mobility Agents for People with Cognitive Disabilities

AgentSheets, Inc. is currently exploring the use of wireless handheld computers as customizable prompting devices that enable people with cognitive disabilities use public transportation. As a practical concequence, we developed a running prototype of the Mobility Agents architecture that recognizes and reacts to simple situations. For instance, if the desired bus is approaching a waiting traveler, the prototype generates an appropriate multi-modal prompt that notifies the traveler that their bus is approaching. As a theoretical contribution, we developed a novel theoretical framework called the Pragmatic Web to turn raw data available on the Web to personally meaningful information that is relevant to the individual user.

This work is done as part of a National Science Foundation (NSF) Phase I and Phase II Small Business Innovation Research (SBIR) Grant Award number DMI-0233028 and DMI-0349663.

The prototype: 3D visualization + wirelesly connected handheld prompting device

The Mobility Agents architecture is prototyped as a client-server system, with the server running a 3D visualization of the public transportation system and communicating with client handheld devices that serve as the traveler's prompting device.

The real-time 3D transportation visualization shows locations of travelers, buses and bus stops. It is a combination of a live information browser and an agent-based simulation. Buses are agents that, on average, receive real-time spatial information updates every two seconds. Between live updates the simulation estimates heading, position and speed information from previous values. This creates a continuous model in which Mobility Agents represent travelers, buses, and bus stops.

The client running on a handheld device (an HP iPAQ combined with a Sony Ericson T68i Bluetooth-enabled cell phone serving as a wireless modem and a Navman GPS module) presents the travelers with contextualized, just-in-time prompts that guide them by informing them when the right bus is approaching and when their bus is at the bus stop in a modality (voice, text, pictures) that is most appropriate for their needs. Customizable user profiles determine what the right modality is based on users abilities and what the right bus is for the particular user's current location and destination. These customizations enable the Mobility Agents to react to information, process it, and offer prompts in personalized ways that match the needs of the user, in the spirit of the Pragmatic Web.

The Mobility Agents running on the server track a traveler’s progress and can notify caregivers in case of a delay, unexpected detour, or emergency. The current architecture has the capabilities to enable caregivers or family members to securely access the 3D visualizations on the server to monitor trip progress and offer assistance to the traveler. This will give travelers confidence and a safety net when traveling alone or when on an unfamiliar route and give caregivers or family members the peace of mind that their loved one is safe.

An interactive flyer discribes this project with examples of the prompts appearing on the handheld. A PDF version of this flyer can be used for printing.

Scenario: Melanie goes home

In a scenario using the Mobility Agents architecture, Melanie, a person with cognitive disabilities is using a handheld device to help her travel using public transportation. She is being tracked in real-time using location information from the GPS module of her mobile device is and she is visualized on the 3D map (shown at a bus stop in the figure above).

Once Melanie chooses a destination from a menu (figure below, left), her handheld can show her a 2D map of where exactly she is (figure below, right).

Her customized Mobility Agents prompt her when her bus is approaching and urge her to get ready (figure below, left). The Agents give yet another prompt when the bus arrives at the bus stop (figure below, right).

When Melanie gets on the bus, the virtual person in the 3D visualization also appears to be traveling along with the bus until they exit it at their destination bus stop.

Benefits for people with cognitive disabilities

This population faces consequences ranging from social isolation and emotional problems to poverty and unemployment and they have a need to improve their quality of life by cultivating as close to a "normal" life as possible. Mobility Agents provide them with new access to public transportation, and as a consequence, the ability to get around town without constant supervision. In turn, this will potentially open the doors to employment opportunities and recreational activities that were previously out of reach. By using Mobility Agents and being able to work and safely enjoy activities outside of their home, people with cognitive disabilities could become more independent, empowered individuals.

Benefits for parents and caregivers

The Mobility Agents also benefit the caregivers of people with cognitive disabilities. Parents or professional caregivers often need to monitor travelers with cognitive disabilities, especially when the traveler starts using a new route. The 3D visualization of the Mobility Agents system enables parents and professional caregivers to track their loved one and be notified when problematic situations arise - for instance, when the traveler does not get off at the right bus stop.

A major role of the caregiver is to provide or assist with transportation. However, special transportation services must be scheduled far in advance and are inadequate when schedules change or emergencies occur. Mobility Agents applications and services will give caregivers the ability to train the target population to use public transportation on their own and therefore make their job more manageable.

Collaborators

Foundations and research groups:

Hardware manufacturers:

Caregivers and Disability communities:

Private wireless network providers (for bus GPS data)

Transportation companies

The opportunity

This project represents a powerful combination of newly available technology, cutting-edge software suited to mobile computing applications, new emerging tools and a uniquely experienced team. Currently in Phase II of NSF SBIR grant, AgentSheets Inc. is actively seeking commercialization partners to participate in and support Phase II (development) and Phase III (commercialization) of our SBIR project. Third-party investment in such SBIR projects enables the commercialization partners to leverage their research and development funds, as NSF provides matching funds for the investment. If you are interested in exploring a potential collaboration, please contact us.

site map | ©2003 AgentSheets, Inc. | contact us