From: 3:51 PM Subject: Comtouch Meeting Minutes 1/18/01To: comtouch@media.mit.edu, zahra@media.mit.edu, verplank@media.mit.edu Hi everyone, just a reminder that we are meeting briefly today at 5PM to discuss comtouch implementations again. Below are last weeks minutes. Angela ----------------------- ComTouch Meeting 1/18/01 Summary www.media.mit.edu/~anjchang/ct11801.txt www.media.mit.edu/~anjchang/meeting.jpg Thank you to Bill Verplank, Sile, Rob, Hiroshi, Gian, Zahra for attending 1.0 Starting point Basic Goals: 1)Symbolic Language over a remote connection 2)Personal communication tool using vibration and touch Underlying design needs: Technology should "Piggyback on cellphone" so that the communication is easier Bidirectional One-handed Bill pointed out that the new technology should expand and fill a need. Needs-> Noisy situations, silence is needed, personal communication (without the broadcast of audio) 1.1 PRESENTION OF EXPLORATORY FORM FACTORS (thanks to Zahra): Pictures at (http://www.media.mit.edu/~anjchang/COMTOUCH/formfact.htm) Feedback points: There is concern that you inadvertently send hand signals without meaning to send signals The object is in the way of the normal function of the hand, causing unintentional communication Solution may be that a strap can help because then the user will not have to devote abilities to holding. Many of the form factors only were handheld. It was brought up that we might use the mouth's vibration, as in Taddama. Gian suggested we use a glove, because it allowed the device not to be in the way of normal function of the hand. 1.2 PRESENTION OF INPUT/OUTPUT (thanks to Gian): Current circuit was a simple demonstration of what holding and inputing to a vibrating object feels like. Later Implementation will be on PIC Chip-- using Pulse Width Modulation (PWM) to control intensity and maybe allow detection of discrete levels of vibration 1.3 FLOW CONTROL ISSUES: We can identify 3 different types of flow controls in communication Compose and send (e.g. email is asynchronous) (arbitrator is time in sending of message through network) Instant messaging (somewhat asynchronous) (arbitrator is the software) Telephone (realtime, turn-taking is bidirectional) (arbitrator is signals from the user) We are leaning toward a device that allows for: Overlapping Turn taking No arbitrator (Basically, the user can interrupt) 1.4 DISCUSSION ON THE PROTOCOL OF SIMPLE TOUCH Speed of transmission provides the syntax (pauses, vibrations per second) Syntax and Grammar of language by squeeze force/duration of force Language issue--what is the user sending, is it encoded and decoded by the device, or by the suser 1.4.1 DISCUSSION OF LANGUAGE Comparison Types of language Serial vs. expressive Serial-->ABC-->Alphabet not alphabetic-->ASL-->Concepts Alphabetic language devices-- Chording keyboards; jog dial High level languages capable of concepts- finger spelling Hiroshi suggested we compare devices on a Speed vs. Learning curve to delineate a design space of some sort. 1.4.2 Vibration levels Distinguishable channels-- How many distinguishable channels can the hand detect? Perhaps we need more than one degree of freedom? Hong Z. Tan did work on buzzers/levers/buttons, mentioned by Bill. Sile will be in Perdue in February, to talk to Hong. Ether phone gives one example of discrete audible tone (Bits per second can be superimposed to construct a concept that is communicated), mentioned by Rob. 1.5 SCIENTIFIC TESTS PROPOSED BY HIROSHI 1.5.1 Tests of technology- Does the Flow control work if we capture and send it? Recorder will allow user to send a message and replay, compose and send. 1.5.2 Test of Communication flow hypothesis In order to test our theory that asynchronous communication can be supported on this device, the ability to support both replay and continuous real-time is important. 1.6 OTHER TECHNOLOGIES TO LOOK AT: -Engelbart's chord keyboard encoding was sent to me by Rob http://www.media.mit.edu/~anjchang/COMTOUCH/chording.txt -They never built handjive. -Taddama is an interesting language that uses tactile feedback and the vibration of jawbones. -Maybe look at how headsets work. -The iFeel mouse by microsoft allows raise and lowered physical output depending on what the mouse is over. -Twiddler - a chording keyboard -The website Virtex.com demonstrates some virtual reality technology where gripping is used. -Taddama - User talks, vibration of the jawbones is output, finger feels vibration as input method. 1.7 OTHER NOTES AND RANDOM MUSINGS I got an email from a colleague about the way Japanese teens have learned to communicate quickly using cellphones (some might be so good as to send email without looking at their cell phones, by using tactile input alone (e.g. 3 jogs down is a 'J')) (http://chronicle.com/free/2001/01/2001011601t.htm), courtesy of my friend Howard Eglowstein. -- In later conversation with artist/designer Jay Lee, I mentioned a concern that it may seem awkward for a deaf-blind person to hold a cellphone to their ears to pretend it is a cell phone. Jay mentioned that we should really think carefully about the following: Design of the user- how would a deaf/blind person use the device? Device should identify the user- are we trying to hide the deaf/blindness of the person? These questions may be best answered by asking someone who is deaf-blind. Sile mentioned that we may be able to have the input of someone who can help us understand better the needs of a deaf-blind person. -- I realized after the meeting that the difference between this and LumiTouch is that we didn't design a feedback mode for the user, so that when they press they get some feedback of what they sent. Maybe this isn't necesary. Maybe the replay feature will allow one to give themself feedback. 1.8 WHERE WE STAND (SUMMARY): DESIRED NATURALNESS The device should not: Obstruct the Normal function of the hand Avoid inadvertent communication DESIRED FUNCTIONALITY The device should: Support syntax and grammar such that high-level of concepts are communicated Allows interruption, is bidirectional and asynchronous Support capture and replay (this might be implemented later) ADDITIONAL WISHES The device could: Piggyback on existing communication technology as much as possible Use the vibration of the jaws Support alphabetic language, such that specific details are transmitted To be presented at NEXT MEETING on Jan 23: 1)Better circuit- Hopefully have a circuit that has engages more digits of the hand, and has different levels of vibration. 2)New form factor- We're aiming at a device that has a strap, which clamps onto the back of a cell phone. We'll be meeting on Tuesday, E15-445, at 5PM. Please join us again, before Hiroshi leaves for a trip. Comments? Questions? Clarifcations? email Angela anjchang@media.mit.edu anj 1/21/01