Review 1 부분1

상 황 인 식 시 스 템기말 고사 Review

Architecture for a New Breed of Applications

1상황인식 2010 가을

Context-AwareArtiFacts

윤 용운

2

2010.10.14

상황인식 2010 가을

Context-Aware Artifacts : Smart things

Review examples of context-aware artifacts

• everyday objects, appliances, and handheld devices

• how they can be made context aware

• Sentient and smart, describing objects.

self-supported context awareness Vs infrastructure-supported context awareness

explore in detail of a software system for context-aware mobile phones

상황인식 2010 가을 7 주차 3

Aware ObjectsRobot : perform human-level tasks

Soft toy : responding and reacting to its user’s handling context or

hearing warm greetings

Intelligent shelves : self introducing and self marketing

Cell phones : automatically behaving in the right way under the right circumstances

Context-aware behavior in devices, appliances, and everyday objects are an emerging new experience.

Context-aware artifact, Smart artifacts

• Able to perceive the situation of a user and Reacts sensibly to it

• Promise to enhance the relationships among participants in distributed working groups, maintaining personal mobility while offering opportunities for the collaboration, informal communication, and social awareness that contribute to the synergy and cohesiveness inherent in collocated teams.

Galatea: Personalized Interaction with Augmented Objects, 2005 , Gatenby Master thesis, MIT


infrastructure-supported context-aware artifacts

Sensor added context-aware artifacts

• Limitations in the number and type of sensors that can be attached

• Limited computational and networking capabilities

limit the reasoning and prevent them to acquiring information from internet such as weather report or traffic condition

infrastructure-supported context-aware artifacts

• Utilizes a hardware and software infrastructure external to the artifact

• The idea shifts from the artifact perceiving situations

to an external party perceiving situations related to the artifact

• Complex reasoning with an infrastructure + Sensors in the artifact itself

EX) CUP situations

collection of sensors attached to the CUP

infrastructure observe the CUP & its situations from outside the CUP


2 approaches to Context-Aware Artifacts

Context-aware Artifacts : 2 development approaches, 2006. Loke

Self-supported context awareness

• H/W, S/W with ability to perceive context and utilize context in its behaviors

Infrastructure-supported context awareness

• acquires context-aware capabilities by utilizing H/W and S/W infrastructure external to the artifact

• Infrastructure - the environment of the artifact

and shared by other artifacts and applications


The relationship between context-aware artifacts and the context-awareness infrastructure. The infrastructure first receives the contextual information and, if appropriate, reasons with itThe infrastructure uses a feedback mechanism to determine the commands it issues and the context information it shares with various artifacts.

A Smart Wheelchair , 2006, Cascado, Spain

The Diet-Aware Dining Table: 2006, Chang, Taiwan

Smart couch, 2002, trinity colleage, Dublin

Intelligent Environments Using Smart Daily Objects, 2005, Nakajima, Japan

Chameleon tables, 2002, Selker et al, MIT

A History tablecloth, 2006, William Gaver, UK

The smart table, 2003, Steurer, UCLA

The sense table , 2001, Patten, MiT

Shelf with pressure sensors, 2005, Metzger

Smart furniture, 2003, Ito, Japan

Aware Mirror, 2005, Fujinami, japan

Mediacups, 2001, Beigl, Germany

chameleon mug, 2006, MiT

Context-Aware Pill Bottle with RFID, 2005, Agarawala

Intelligent spoon at MIT

Smart sink, 2005, Mit

Context-aware doll, , 2001, Yonezawa, Japan

context-aware camera, 2003, Hakansson et al., 2003

Smart wear - the SensVest, 2004, Knight


Self-Supported ContextAware Case studies

Self-Supported CA Case studies


Building Intelligent Environments Using Smart Daily Objects and Personal Devices , 2005, Tatsuo Nakajima, 와세다대학

Sentient ChairSitting on it, then the activity at the chair is narrowedsensors to detect a person, sitting or not, and his or her orientation

Aware mirror – detection a persondisplays information relevant to himsuggests an ideal interaction betweena person and a computer embedded into our daily lives

Sentient Personal devices (PDA)different types of sensors for a user’s contextcontrol some applications

Self-Supported CA Case studiesSmart Furniture: Improvising Ubiquitous Hot-spot Environment, 2003, Masaki Ito, Keio

SF2: Smart Furniture for Creating Ubiquitous Applications, 2004, Hideyuki Tokuda


Smart Furniture :Convert legacy non-smart space into a Smart Hot-Spot which can provide the accessibility to the Internet, location-based context-aware services, service roaming, and personalization services.Equipped with networked computers, sensors and various

I/O devicesPersonalized Message Board : displays commercial messages on a Smart FurnitureEnvironmental Monitor : keeps track of number of usersinside the sensing area, and changes the color of lamptype Smart Furniture accordinglymobile TV-phone : Display and Camera on Smart Furniture is enabled

Smart Spaces are characterized by following features; (1) Identification and detection of activity of users (2) Sensing users’ and devices’ location(3) control and coordination of devices.

Self-Supported CA Case studies


Aware Mirror: A Personalized Display Using a Mirror, 2005, Kaori Fujinami

A Mirror and Its Augmentation

A toothbrush : an identification tool by the owner of the toothbrush

proximity sensors have been utilized to detect a person’s position (in front of the mirror)

three types of information that can affect a user’s decision

•transportation information by his/her schedule•Weather forecasting at the destination•Time to leave and schedule

Context-aware mobile PhonesContext aware hand-held devices, 2000, Tuulari, VTT Finland

Tuulari‘s Sensor box (2000)

Personal technology devices for mobile users :

Wristwatch, Heart monitor, Mobile Phone, GPS-Navigator, MP3, Camera…

Key problem is user interface (small size keyboard, display)

Research questions

• What is the role of context-awareness in personal technology devices ?

• Why is context awareness of personal technology important ?

• What are the contexts that are associated with hand-held devices ?

• How can hand-held devices, with limited resources, identify these context ?

Prototype system : self-supported context-awareness mobile phone

• Sensor box with sensors for acceleration, temperature, humidity, light, conductance

• Exploit context-awareness in reducing the interaction in the user interface, modifying interaction to more suitable for mobile use.

• Implement rule-based behaviors such as “if the phone rings and it is picked up, it should stop ringing.”

. 상황인식 2010 가을 7 주차 11

Context-aware mobile Phones

ContextPhone: A Prototyping Platform for Context-Aware Mobile Applications, 2005, Raento, Helsinki Univ.

ContextPhone (2005, Raento) for Nokia Series 60 Smartphone platform & Symbian OS

Software platform with following design goals:

• Provide context as a resource for social interaction.

• incorporate existing applications.

• fast interaction and unobtrusiveness.

• Ensure robustness - automatically recover

• Emphasize timeliness for fast response

• Enable rapid development for adding new context data, building new application

상황인식 2010 가을7 주차 12

ContextPhone -2The ContextPhone platform. Four interconnected Modules

1. modules for sensing

• Location information (by GSM cell IDs, GPS via a bluetooth GPS receiver ),

• Phone information (charger status and alarm profile)

• Communication behavior(calls, call attempts & recording, SMS content)

• Optical marker recognition using a built-in phone camera

2. communications :

• Wide area network : Generalized Packet Radio Service (GPRS),

• Local : Bluetooth and infrared networking,

• SMS or MMS messaging

3. Customizable applications

• ContextLogger : Studying mobility patterns

logs details of the communication’s nature, timing, participants

• ContextContacts : Automatic context sharing

• ContextMedia : Sharing mobile media : situated annotating services

• The automatic annotation includes features such as location and nearby Bluetooth devices

4. background services, error logging and recovery, and the Status display



The ContextPhone platform. 4 interconnected Modules

ContextPhone-3

Context-Aware mobile Phones: An illustration

Self-supported context-aware mobile phones – previously described

Situation-Aware phone (Wang, 2004)

• Ontology-based approach to recognize & reason the context

• Using supporting infrastructure

Context-Aware Phone (Connelly, 2000)

• Using infrastructure representing the space in which the phone is situated in

• the space and phone would negotiate in determining suitable actions on the phone

Space control over the phone

• for compliance reasons : abide by some policy concerning phone usage and behavior

• for convenience reasons : the actions can be carried out on the phone automatically, reducing user intervention)


Situation-Aware phoneSemantic Space: An Infrastructure for Smart Spaces, 2004, Wang

Semantic Space : a context infrastructure for the following issues

• Explicit representation , Context querying, Context reasoning. :

Ex) Who is in the room with Yoon?

• Context-aware applications must adapt to changing situations,

they need a detailed model of users’ activities and surroundings that lets them share users’ perceptions of the real world

• Ontology : Smart spaces cover a range of environment types such as homes, offices, workplaces, classrooms, and vehicles

The context infrastructure consists of several context wrappers, an context aggregator, a knowledge base, a query engine, and a reasoner.


Rachel wishes to contact her friend Joey, so she instructs her mobile phone to arrange a call. Upon request, Joey’s mobile phone checks the calendar and realizes he’s currently attending a seminar. The phone determines on his behalf that he shouldn’t be interrupted and schedules a call back when the seminar ends. Soon after the seminar, Professor Geller asks Joey to have a discussion in his office. Before the phone reminds Joey of the missed call as scheduled earlier, it wants to know whether his current situation is suitable for receiving the call. Based on contextual information (Where are you? Who are you with? What is the noise level? Is the door open or closed?) gathered in the smart space, the Phone infers that Joey is in a conversation with his supervisor and decides to postpone the call until he’s available. A few minutes later, when the conversation ends and Joey leaves the office, the phone finally reminds him of the missed call.


An upper-level context ontology , extended context ontologies.

The Semantic Space context infrastructure.

Building a prototype: Networked sensors and devices the RFID indoor location system the GUI for configuring the response mode in each situation.

Context-Aware PhoneOn Negotiating Automatic Device Configuration in Smart Environments, 2004, Kay

Connelly and Ashraf Khalil

• Architecture for automatic device configuration in smart environments

• negotiating between the user’s wishes and owner of the smart environment

• User Intervention

• Agent-based negotiation : to decide the best negotiation strategy given the limitation (computing, battery, and memory) of mobile devices.

Another challenge is finding the correct metrics that quantify both the space and device preferences

• Where to reside resolution logic ?


Device modes on Cell phoneQuiet Mode: ringer should be disabledNoisy Mode: user is in a loud environmentDisable Mode: all incoming and outgoing

calls should be disabledDefault Mode: normal conditions

Overview of a Framework of The CAMP-UP System

CAMP-UP (Context-Aware Mobile Phone with User Preferences)

• the level of access (from external parties) to phone functionality can be adjusted, based on the context and user preferences

The architecture of the system :

A server side & A client side

two classes of users :

device (mobile phone) user

space administrator

two types of interactions

• The user and his mobile phone

- Set his preferences for the device

- Set the type of functionalities

, exposed and controlled by external parties

• The space administrator and the Space Manager component of the system

- Defines a space policy, which is a set of rules that determines certain device

functionalities to be set to certain modes based on current context


CAMP-UP System Interaction


Review 1 부분1

Technology

Transcript of Review 1 부분1