Spatiotemporal Information ProcessingNo.8Information-oriented real space ～TelexistenceThe role of Spatiotemporal Information Processing

Kazuhiko HAMAMOTO

Dept. of Information Media Technology,

School of Information and Telecommunication Eng.,

Tokai University, Japan

Today’s topic

What world or space is created by VR/MR ? Telexistence

Master-slave robot Twister

Conclusions The role of spatiotemporal information processing What world or space is created ? (again) Spatiotemporal information processing as “Hyper-

distributed system”

VR application : 2 Virtual worlds Constructed world （ = virtual space in computer ）

Model of the real world The real space, but cannot perceive directly

Far, Small or Dangerous Used for education , training or design

Flight simulator, virtual prototyping Model of the hyper-real world

Not real, theoretical world The world of the theory of relativity The world of mathematics (vector field, etc.) Art or amusement

Transmitted world （ VR via Network=ubiquitous ） Telexistence Remote control of a robot

Telexistence

Telexistence enables people to act freely without any limitations of time and space.

It is “remote-control of robot”, but what the robot sees, what the robot feels, every sense is returned to a user

The user can feel high presence. The feeling is like carrying oneself to and existing in long-distanced place.

Telexistence 1st ptototype

operation

Visual infor.

Presented by Tachi Labo. in University of Tokyo

Master side Slave side

Mankind robot operated from “super cockpit” 2nd protytype

Mutual Telexistence3rd prototype

from Master to Slave Operation and

operator’s figure

from Slave to Master Visual and tactile infor.

Master

Slave

At master-cockpitStereo image

Mutual Telexistence

Retro-reflective materialAnd projector

Mutual Telexistence

Operation at master side

Expected image of mutual telexistence

Looks of slave side

Mutual Telexistence

In the future..

More familiar application of Telexistence

RobotPHONE New telephone by robot Gesture can be

transmitted via robot An example of “Robotics

User Interface (RUI)”

TWISTERglasses-less and wide-angle stereo system for mutual telexistence

Metaphor of future telephone booth

TWISTER

TWISTER

TWISTER

Simple system for mutual communication (camera and display)

360 degree, glasses-less 3D Movie communication in real time Head position is fixed One person uses only

TWISTER IV

The number of pixels perpendicular ： 600[pixel] horizontal (360 degree) : 3168[pixel]

View area radius :1000[mm] height :1200[mm]

Pitch of pixel : 2[mm] Rotation speed : 1.66[rps] Frame rate : 60[fps] Pixel depth : 10[bit] for each RGB

The role of spatiotemporal information processing

As 4-dimensional information processing Keyboard and mouse are used. acquisition, save, recognition, retrieve, etc. Algorithmism vs Dataism

By new modalities VR, wearable computer, telexistence The role of computer is being changed

From AI (Artificial Intelligence) to IA (Intelligence Amplification)

question

answer

Conventional InformationProcessing (AI)

Mass-communicationPath (VR)

Information processing unitby effective combination of Computer and user

Information Processing by New modality (IA)

The role of spatiotemporal information processing

Spatiotemporal Information Processing is realized by New Modality (=VR) Mass-communication path between computer

and user can be realized. Computer power is added to human power.

More large human power is produced. Information in the brain is output to computer.

The result is returned to the brain. This process can create “New Intelligence”.

What is “Spatiotemporal Information Processing” ?

What is “New Intelligence”?

New knowledge = “Transition of thought outside the brain” Output of a part of information in the brain Computer processes the information After the processing, the result is input to the brain. New intelligence is created

New intelligence created by interaction with the outside = affordance

New behavioral style Virtualization of the real space (Ubiquitous and hyper-

distributed processing), telexistence

VR application : 2 Virtual worlds Constructed world （ = New knowledge ）

Model of the real world The real space, but cannot perceive directly

Far, Small or Dangerous Used for education , training or design

Flight simulator, virtual prototyping Model of the hyper-real world

Not real, theoretical world The world of the theory of relativity The world of mathematics (vector field, etc.) Art or amusement

Transmitted world （ = New behavioral style ） Virtualization of the real space Telexistence (Remote control of a robot)

Example of “Transition of thought outside the brain”

Example of “Transition of thought outside the brain”

What space should be created ? Visualization of genome data

Analyzing space of genome data Analysis of function of gene

Interaction of a number of gene with many functions Visualization by color information after selection

High possibility of overlooking important data Visualization by only color is not enough for intuitive

understanding

No selection, direct presentation into 3D space. Selection and analysis after 3D visualization

Analyzing space of genome data

The University of Tokyo, CABIN

Tokyo electric power company (1990)

Automation of electrical power distribution by computer

Requirement of test of the computer and the software

Work flow of the software is visualized into 3D space

Visualization system of software

Example of “Transition of thought outside the brain”

What space should be created ?

History of programming languages

Example of “Transition of thought outside the brain”

What space should be created ?

New behavioral style

Another virtual world

Artificial space in computer

Transform the real space to virtual space The real space -> ubiquitous, Computer -> intimate Correspondence to “individual” ( example, mobile phone ) Correspondence to “dispersion” is more important than

“average”

The real world changes to Hyper-distributed system

on condition of large quantity of information

A metaphor of hyper distributed system ？Holonic System

Information system of organism The number of cell in human body is 60

trillion. A cell works autonomously, but the cells are

connected, the set of cells works as one system.

Although each cell has independent system, the cell keeps the rule as total system.

Holonic System An autonomous distributed information system

with fluctuation

How to use the space ?

With watch, GPS and mobile phone High identification ability of space and time Behavioral style with “fluctuation” is possible

Time Zoning like timetable disappears The space is used in “Ad-Hoc”

Active system design extemporaneously “Meeting and parting” of system ≒ Holonic system Information system of organism is the most efficiency,

therfore, the system becomes close to organism system.

Feature of hyper-distributed system

Sensing information in real time Larger knowledge in a terminal than a center Initiative of information flow will be moved to a

terminal side Example : Wearable computer application

Current situation Information flow from system (center) to user (terminal)

（ information according to position ）＝ average infor.

Future Real time information is sent to center computer

＝ pinpoint information processing is available in real time

If hyper-distributed system is realized..

If ubiquitous environment is realized by RFID, intimate computer, etc., very small scale and very low level information processing and control will be available.

Realization of spatiotemporal information processing on condition of huge number of information device distributed into the real world