Berkeley Engineering Home
Volume 2, Issue 7
September 2002



Outline List

In This Issue
Open Sesame for Cells

Good Timing For Nanoscale Atomic Clocks

Seeing in the Dark

Intelligent Systems Research Finds Its Center

Berkeley Engineering History: Valerie Taylor

Archives

2002
August
July
May/June
April
Feb/March
January

2001
Nov/Dec
Sept/Oct
July/Aug

Dean's Digest
September
August
July

Lab Notes, Research from the College of Engineering


Seeing in the Dark
by David Pescovitz

Hesham Kamel

Hesham Kamel demonstrates the complete portability of IC2D. (Click for larger image.)
David Pescovitz photo

Hesham Kamel is drawing a scene of a lighthouse on his laptop computer that he will never see. That's because Kamel is blind.

But thanks to the Electrical Engineering and Computer Sciences PhD student's Integrated Communication 2 Draw (IC2D) software prototype, Kamel can create diagrams, pictures, even animations using just a keyboard and computer screen reader for the blind.

IC2D was born four years ago when Kamel became frustrated at his inability to complete a paper on time because the sighted person who was supposed to draw the accompanying illustrations was unavailable. Kamel discussed his unique problem with his adviser, computer science professor James Landay of Berkeley's Group for User Interface Research, part of the Center for Information Technology Research in the Interest of Society (CITRIS).

"Right away, Professor Landay suggested that my PhD research should be to figure out a way to draw by myself," says Kamel, 40, who was blinded seventeen years ago in a surgical accident.

When he gives presentations on IC2D, Kamel uses a simple exercise to illustrate the difficulty of drawing, or even using a mouse, when you can't see see. He stands in the center of the room and asks audience members to point at his hand. Then he instructs them to close their eyes, move their fingers to another point in the room, and then back to his hand. The task is nearly impossible.

lighthouse created using IC2D

This image was created by Victoria Hahn and Hesham Kamel using IC2D. When animated, the beam of light from the lighthouse flickers and the waves roll. (Click for larger image.)
Photo courtesy Hesham Kamel

Kamel tackled this navigational problem by designing a new interface for human-computer interaction. IC2D divides the computer screen into a 3-by-3 grid numbered like a telephone keypad. As the user moves a cursor from square to square, a computer voice announces the location point back to the user. Each of the nine squares can further be divided resulting in a grid of 727 total cells. All commands — including the selection of shapes to position in each square and color choices — are also selected using the telephone keypad-like interface and announced by the voice synthesizer.

"To help blind users see what I draw, I developed a technique to give the components of the picture a meaningful label," Kamel adds. For example, he might provide a verbal label for the rear passenger wheel in an image of an automobile. The wheel can be further described as consisting of a black rubber tread and silver hubcap.

During the four years he's been developing IC2D, Kamel has enlisted the aid of 22 volunteers who were sighted, blind, visually-impaired, or blindfolded.

Your Turn

How else can technology enable the impaired to express themselves creatively?

We want to hear from you...

"It takes a matter of minutes to pick up on the system, on how it works and how to use the different levels and access the different shapes and colors," blind user Victoria Hahn has said. "Each time you move your cursor, the program tells you what colors you have chosen. This makes it accessible to visually impaired or color blind or totally blind people."

Once he completes his nearly-finished dissertation, Kamel hopes to refine IC2D into a commercial product. He already has new features in mind, including the ability to import traditional images into the software for verbal description to blind users so they can imagine pre-existing images.

"There are many people out there who can't understand that blind people have imaginations, just as sighted people do," Kamel says. "For me, it's all about independence. More than anything though, I want to change the way people think when they develop technology for the visually impaired."



Related Sites

Hesham Kamel's home page

Integrated Communication 2 Draw

Group for User Interface Research

CITRIS


Lab Notes is published online by the Public Affairs Office of the UC Berkeley College of Engineering. The Lab Notes mission is to illuminate groundbreaking research underway today at the College of Engineering that will dramatically change our lives tomorrow.

Editor, Director of Public Affairs: Teresa Moore
Writer, Researcher: David Pescovitz
Designer: Robyn Altman

Subscribe or send comments to the Engineering Public Affairs Office: lab-notes@coe.berkeley.edu.

© 2002 UC Regents. Updated 8/28/02.