A taxonomy for analysis of

tangible interface

-可觸知介面分析 -

By Kenneth P. Fishkin

Defining TUIs(可觸知使用者介面 )

At CHI 1997, Hiroshi Ishii & Brett Ullmer: “Tangible User Interfaces” (TUIs) =user interfaces that “augment the real physical world by coupling digital information to everyday physical objects and environments”.

-Narrower defination= No distinction between input and output.

Kenneth P. Fishkin’s FrameworkSome input event occurs. This input event is typically a

physical manipulation performed by a user with their hands on some “everyday physical object”, such as tilting, shaking, squeezing, pushing, or most often moving.

A computer system senses this input event, and alters its state.

The system provides feedback. This output event is via a change in the physical nature of some object – it alters its display surface, grows, shrinks, makes a sound, gives haptic feedback, etc.

A taxonomy for analysisUse metaphor(譬喻 ) and embodiment (體現 ) as it two axes

-Embodiment (體現 )1.Reflects how closely output is tied to input2.Does the user have the illusion of the system state being “inside” theobject that is manipulated?3.Fishkin proposes a four-level scale

Full Nearby Environmental Distant

A taxonomy for analysisUse metaphor(譬喻 ) and embodiment (體現 ) as it two axes

-Embodiment (體現 )1.Full-the output device is input device. The state of the divice is fully embodied in the device.2.Nearby-The output takes place near the input object3.Environment-The output is ’’around’’ the user , typically in audio.4.Distant- The output is ’’over there’’ , on another screen , or even another room.

A taxonomy for analysis-embodiment (體現 ) 1.Full-Gummi:bending

A taxonomy for analysis-embodiment (體現 )

1.Full-Platybus Amoeba: petting pet

Platypus Amoeba emits small noises and a faint glow until a hand is moved over the soft skin and Platy gives a pleasant coo. Petting Platy has made it happy. What will more petting do? Perhaps you excite Platy and are rewarded with a display of colors or maybe it is displeased and truculent. Platy's reactions give you information as you use petting to interface with Platy and understand how Platy wants to be petted.

A taxonomy for analysis-embodiment (體現 )

2.Nearby-I/O Brush: the world as the palette

A taxonomy for analysis-embodiment (體現 )

2.Nearby-I/O Brush: the world as the palette

Orientation sensingPressure sensing Paint historyRobust design Paint palette

A taxonomy for analysis-embodiment (體現 )

2.Nearby-I/O Brush: the world as the palette

http://tmg-video.media.mit.edu/iobrush/iobrush_350x240.mpg

A taxonomy for analysis-embodiment (體現 )

2.Nearby-metaDESK

“The Great Dome”

“PassiveLens” “ActiveLens”

“Phicon(物理像 )”“Instrument”http://tangible.media.mit.edu/projects/metadesk/metadesk_352x240.mpg

A taxonomy for analysis-embodiment (體現 )

2.Nearby-metaDESK

input: rotation and translationInput object: indicative of a buildingoutput : altered display of the workspaceoutput object : augmented desktop

A taxonomy for analysis-embodiment (體現 )2.Nearby-photo cube

A taxonomy for analysis-embodiment (體現 )

2.Nearby-photo cube

input: spatial motion with orientationInput object: one everyday objectoutput : altered displayoutput object : non-everyday object

A taxonomy for analysis-embodiment (體現 )

2.Nearby-Bricks

Ishii, 1995: Tangible Brickshttp://tmg-video.media.mit.edu/bricks/bricks_240x160.mpg

A taxonomy for analysis-embodiment (體現 )

3.Environmental -TooTown

http://tw.videos.search.yahoo.com/video/play?p=TooTown&ei=UTF-8&fr=yfp&fr2=tab-web&vid=0001311141943

A taxonomy for analysis-embodiment (體現 )

3.Environmental -TooTowninput: change of positionInput object: two representative objectsoutput : audio changes

A taxonomy for analysis-embodiment (體現 )

4.Distant –TV Remote Control, Doll’s Head

A taxonomy for analysis-embodiment (體現 )5. Nearby & Environmental–PingPongPlus(Ishii et al., 1999) Full & Environmental -Platypus Amoeba

Makes sounds EnvironmentalResponds to patting Full

http://tmg-video.media.mit.edu/pingpongplus/pingpongplus_240x160.mpg

A taxonomy for analysis-Metaphor (譬喻 )

“figure of speech in which a word or phrase literally denoting one kind of object oridea is used in place of another to suggest a likeness or analogy between them”(Merriam-Webster)

“drown in money”Can use a variety of attributes: shape, size, color, weight, smell, texture, …Here: Is the system effect of a user action analogous to the real-world effect ofsimilar actions?Fishkin proposes two sub-dimensions:

Shape of object “metaphor of noun” Motion of object “metaphor of verb”

A taxonomy for analysis-Metaphor (譬喻 )

-No metaphorAnalogy: command-line interface=no correlationExamples:

The BitBall Programmable Beads

A taxonomy for analysis-Metaphor (譬喻 )

-Noun metaphor

Analogy : An<X> in our system is like an <X>in the real word=Object looks like the real thingActions are at most weakly related to real-world actions=They sharethe same action

A taxonomy for analysis-Metaphor (譬喻 )

-Noun metaphor ex.1.Navigational blocks2.Tagged objects

A taxonomy for analysis-Metaphor (譬喻 )

-Verb metaphor

Analogy : <X>-ing in our system is <X>-ing in the real word=Object acts like the real thingShape of object irrelevant

A taxonomy for analysis-Metaphor (譬喻 )

-Verb metaphor ex.

1.Shakepad

Shaking erases screen

A taxonomy for analysis-Metaphor (譬喻 )

-Noun & Verb metaphor ex.Analogy : <X>-ing amn<A>in our system is like <X>-ing something<A>-ish in the real word

1.Urp2.TooTown3.Drag-and-Drop

A taxonomy for analysis-Metaphor (譬喻 )

-Full metaphor ex.Analogy : Really Direct Manipulation= The virtual system is the physical system

1.Illuminating Clay

A taxonomy for analysis-Metaphor (譬喻 )

-Applications May Span Several Levels.

1.Barney system- Peek-A-Boo2.Doll’s head3.Bookmark URL

Culture anthropology-The cognitive of color RED

Certain Western culture-danger (analogized to blood)China-vitality & happiness (analogized to fire)Japan-warmth & light (analogized to sun)India-none

Cognitive psychologyEvolution of cognitionIndustrial designPhilosophy of science

None Verb Nounandverb

Full

Full

NounMetaphor

Nearby

Environment

Distant

Embodiment

Utility of the taxonomy

Comparing with other taxonomies Increased understanding of the design space

Helps in comparing characteristics of different designsHelps in finding missed possibilitiesShows evolution of designs

Utility of the taxonomy

Containers: “generic objects used to move information betweendifferent devices or platforms.”Tools: “things which actively manipulate digital information.”Tokens: “objects that physically resemble the information theyrepresent.”

Utility of the taxonomy

33

None Verb Nounandverb

Full

Full

NounMetaphor

Nearby

Environment

Distant

Embodiment

TokensTokensTools

Tools ?

Containers ?

Calm Computing

34

No physical input from the userExamples (distant embodiment)

LiveWire Bus Mobile

Calm Computing

35

Metaphorical level More lower cognitive overhead Less increased reusability, fewer limitations

Do you need a physical gizmo for every virtual widget? Lose flexibility of virtual world Research question: how to find

the right mix ofphysical & virtual?

36

Scenario Children interact with a physical device

on a play mat. As they move the device about, and tell

a story out loud, the story is recorded. At a later time, the story can be played back, with the audio being reproduced, and

the video being done by a projected animation.Categorization

Embodiment of “environment” (the audio feedback) and “nearby” (the video) Metaphor of “noun and verb” (moving a toy in the physical world later moves a

projected replica of the toy in that same physical world).

Evolution of the field-StoryMat

37

Scenario As they move the device about, the motions are recorded. At a later time, the motion can be played back.

Categorization Embodiment of “full”(it reproduces its early motion) Metaphor of “noun and verb” (moving a toy in the physical world later ,the

toy move itself in that physical world).

Evolution of the field-Curlybot

38

1.Creating a programming tool for children(> 4 years)2.Tangibility3.Supports development of mathematical thinking4.Demonstrate creation of geometrical shapes fromsimple elements5.Supports immediate testing of ideas

Evolution of the field-Curlybot

39

Categorization Embodiment of “full” Metaphor of “full” (not just repeat a path ,to imitate– it

“learns to move”).

Evolution of the field-Tobobo

http://www.youtube.com/watch?v=EOl_iQAcVhY

Tangible workbench

40

The Actuated Workbench is a device that uses magnetic forces to move objects on a table in two dimensions. It is intended for use with existing tabletop tangible interfaces, providing an additional feedback loop for computer output, and helping to resolve inconsistencies that otherwise arise from the computer's inability to move objects on the table.

http://www.youtube.com/watch?v=y_BDtX4wxYY

41

Control widgets-ToolStone

Quantize possible positions and orientations out of full 6DOF space

8 Directions

On 6 different faces

Also track x,y position on tablet http://www.youtube.com/watch?v=V32SnUnAe2E

42

Control widgets-DataTiles

http://www.youtube.com/watch?v=7imqHEqszo8

43

Control widgets-DataTiles

http://www.youtube.com/watch?v=7imqHEqszo8

None Verb Nounandverb

Full

Full

NounMetaphor

Nearby

Environment

Distant

Embodiment

Evolution of the field

Referencehttp://tangible.media.mit.edu/projectshttp://portal.acm.org/citation.cfm?id=1023819/http://www.slideshare.net/adorepump/tangible-interfaces-presentation

Thanks for your attention!