Ritsumeikan Univ.
College of Information Science and Engineering
Department of Media Technology


You need a player that can play mpeg movies.

[section]Themes of Research

Gr.3 Design and Implementation of Next Generation Human Interface

In the movie of "Minority Report", you will see John (played by Tom Cruise) uses gestures and body language to interact with a computer. The movie of "Ironman" portrays the scene of Tony (performed by Robert Downey, Jr) designing a suits of powered armor by means of gestures. We have proposed a number of the natural user interfaces to deal with tabletop system and mixed reality (MR) system, which will come into home and become popular in the future. The several systems have been developed as part of our research project. "WATARI system" enables users to interact with virtual objects projected on wall-screen and tabletop-screen, through the natural user interfaces such as gestures and real objects. We have developed casual tool resembling input devices named as "ToolDevice" for supposing to be widely used in mixed reality space. We also have been studying the relation between visual perception and haptic perception through use of MR technologies including how we feel when touching a real object while seeing virtual object is superimposed onto it, and we consider the manipulation of 3D virtual objects consisting of many parts in mixed reality space.

- WATARI System

WATARIシステム概観写真 ジェスチャの様子2

As one of Post-WIMP research, we have developed WATARI (WAll & TAble-based Reconfigurable Interaction) System which utilizes gestural interaction and real-world oriented interface in the wall and the table based working space. As tabletop interaction techniques, we propose "Candle (Card and Document File) on the Table", bringing cards and documents metaphor to the tabletop computing. Furthermore, we distinguish the table and the wall as 2D/3D workspaces according to their features. We introduced a map navigation system that links and handles the 2D Google Maps displayed on the tabletop and the 3D Google Earth map and Street View displayed on the wall.

"Map Navigation"

"Candle on the Table"



- Making virtual spatial work easier with ToolDevice


WoodWorkPlay Painting TODO
Started in 2006, this research is supported by the Precursory Research for Embryonic Science and Technology Program of Japan Science and Technology Agency. We strive to develop a mixed reality system (including Stereoscopic System, Wide Field System, Tabletop Sytem, etc.) that enables everyone to intuitively mimic real-life spatial work by using a set of tools called ToolDevice. ToolDevice is a set of tools to help people in designing three dimensional figures, an operation that proves to be difficult for some people when done with mouse and 2D display. We realize there are three basic operations for designing 3D figures, Select and Move, Cut and Join, and Paint. For each operation we developed one interactive device: Tweezers device for Select and Move, detachable Knife/Hammer device for Cut and Join, Brush device for Paint.

"Handcrafting and painting system"

"Metal working with ToolDevice"

"ToDO-WorkBoard system"


ToolDevice Project Page

- Psychophysical Influence on sense of touch by Mixed-Reality Visual Stimulation


syokakuhan syokakuhan2
In the research on sense of touch, we study mixed-reality (MR) with the sense of touch and sight. In a MR environment, the appearance of touchable objects can be changed by superimposing a computer-generated image (CGI) onto them (MR visual stimulation). We hypothesized that an object is changing appearance gives different sense of touch. So we study psychophysical influence of MR visual stimulation on sense of COG (center of gravity) and hardness.


"Psychophysical influence of mixed-reality visual stimulation on sense of hardness"

- Manipulation method for complex 3D virtual objects in mixed reality space


clipping metaphor
In this study, we consider the manipulation of 3D virtual objects consisting of many parts in mixed reality space. In general modeling software, parts of such a complex 3D object are grouped for efficient operation. We have proposed two methods by which users can pick up a part of an object that they need and observe its details or manipulate it.

"Movie1: Clipping from complex 3D objects"

"Movie2: Detach a parts from complex 3D objects"

- Mother-Mode User Interface


MMUI
In this research, we propose a novel ambient interface, Mother-Mode User Interface. MMUI (Mother-Mode User Interface) provides users maternal feelings such as "consideration" and "kindness." For example, our system supports users' accessible and comfortable digital work with a detection of a range of emotions from them while in use. First of all, we developed "Automatically keeping data neat and tidy" functions on digital document data in WATARI system.