AAC-RERC, Spread the Word graphic depicting ruler, compass
Projects D3

Projects Button Resources Button
Contact Us Button
About Button
Publications and Presentations Button
link to homepage

R1 | R2 | R3 | D1 | D2 | D3 | Training | Dissemination

D3-A: AAC WebCrawling-Communication Content from the Internet

The goal for this project is to integrate an autonomous WebCrawler with communication software to provide AAC users access to a domain appropriate communication materials. In Phase 1 , an AAC user will request vocabulary on a specific domain, either through pre-programmed buttons or through user-specified keywords. The search request will be transferred to a server hosting the WebCrawler, which will search the Internet for domain-appropriate texts. After collecting a pre-defined amount of text, a "distiller" program will convert the raw text into a format suitable for the communicator: 1) literacy access, 2) utterance-based communication, 3) word prediction, 4) biasing word predictors, 5) topic-related vocabulary, 6) topic specific - graphic image archiving, and 7) topic specific - sound file archiving. This information will be fed back to the communication device and presented to the AAC user in the form of domain-specific vocabulary, phrases, or sentences. As an example, an AAC user might request a vocabulary suited to a particular topic in school (e.g. biology or American history) or relevant to a conversation at hand (e.g., a popular movie or musical group).

In Phase 2 , the system will also attempt to automatically determine the domain via GPS information and conversation analysis. This information will be used to direct the crawler as if the user had initiated a domain request. In Phase 3 , the system will utilize additional search mechanisms to retrieve domain appropriate graphic and sound based communication media. These media will be used to supplement and/or replace text-based materials.

For more information about this project, contact Jeff Higginbotham.

D3-B: Enhancing the Role of Listeners in AAC Interactions

The purposes of this activity are to 1) develop AAC technology design specifications that integrate features to facilitate listener roles in co-creation of meaning (co-construction of messages) with the AAC user, 2) develop prototype AAC technology to support co-creation of meaning, and 3) evaluate the prototype, compared to low- and high- technology strategies without these features.

There are two primary activities. In Activity 1 , staff will develop design specs for prototype AAC systems. The design specs will be developed a) from a staff survey of the AAC literature regarding listener roles, b) from an advisory board (some onsite and some virtual) of primary AAC consumers, secondary consumers, AAC interventionists, and frequent communication partners who will report and describe the AAC message construction techniques for co-creation of meaning that they use, and c) from a technical advisory board of AAC-RERC partners and AT engineers and programmers.

In Activity 2 , staff will develop and evaluate prototypes that implement the design specifications created during Activity 1. These prototypes will be developed using remote computer control technology [e.g., Virtual Network Computing (VNC)] such that one computer can host an AAC program that can be accessed from this interface or from that of a remote (guest) computer. Possible features in the prototypes include: a) instructions to listeners for optimal ways to participate in co-creation of meaning, b) an interactive feedback screen containing messages as they are formulated by the user and the listener, c) organization and message options for listeners with availability under the AAC user's control (selection of organizational screens, message choices, and sets; message completion; onscreen drawing; etc.), d) a message formulation screen to support prediction and breakdown resolution (clarification), and e) control of vocabulary prediction options by listeners who will identify parameters such as topic, context, situation, environment, listener identity.

For more information about this project, contact David Beukelman.

Progress to Date

The design specification paper has been completed and is being finalized for publication.

The prototype has been developed that will support the primary listener roles that have been identified as important and commonly employed in low-tech AAC interactions.

The evaluation of the prototype is just beginning with children and adults who rely on AAC.