Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its...

45
0 Copyright 2017 FUJITSU Intel Inside®. Powerful Productivity Outside. shaping tomorrow with you Fujitsu World Tour 2017 Fujitsu North America Technology Forum 2017

Transcript of Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its...

Page 1: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

0 Copyright 2017 FUJITSU

Intel Insidereg Powerful Productivity Outside

shaping tomorrow with you

Fujitsu World Tour 2017 Fujitsu North America Technology Forum 2017

1 Copyright 2017 FUJITSU

Applied Innovation Research - New Businesses Creation Initiatives

Shoji Suzuki Board member

Head of Applied Innovation Research Center

FUJITSU LABORATORIES LTD

2 Copyright 2017 FUJITSU

Agenda

What is Applied Innovation Research

3 Topics

Mobility

Sports

Robotics

3 Copyright 2017 FUJITSU

What is Applied Innovation Research

4 Copyright 2017 FUJITSU

Applied Innovation Research Overview

Objective To create new businesses by matching our cutting-edge technologies with social trends and market opportunities

Process To achieve rapid commercialization of the target technology in collaboration with our customers who provide valuable ldquoreal worldrdquo feedback on use cases

Social Concern

Idea

Technologies

Business Model

Practice with Customers

Business Start

Prototype

BUStartup

Marketing

Hypotheses

5 Copyright 2017 FUJITSU

Example Manhole Sensor

Manhole

Water level sensor

Sewer pipe

6 Copyright 2017 FUJITSU

Social Concern

gt50 mmh Source JMA HP

Freq

uen

cy o

f h

eavy

rai

n

(Aug 2008 Aichi)

(Oct 2015 South Carolina)

Example of flood damage

Localized torrential rain increases every year and the urban area flood damage also increases

Year

7 Copyright 2017 FUJITSU

Idea

Real time monitoring of the water level in sewer pipe with the sensor installed on the bottom of a manhole iron cover

Sensor Node

Water Flow

Gateway

Water-treatment Plant

Manhole

Visualization

Data Flow

Cloud

Data of water level in sewer pipe Wireless

Transmission

Analysis and notification of flood zone Decision of renewal program of drainage

Operator

8 Copyright 2017 FUJITSU

Technologies

Energy harvesting battery (Thermoelectric generator) Detecting symptom of drainage flood (Time-series data analysis)

Sensor Node

Water Flow

Gateway

Water-treatment Plant

Manhole

Visualization

Data Flow

Cloud

Data of water level in sewer pipe Wireless

Transmission

Analysis and notification of flood zone Decision of renewal program of drainage

Operator

Detecting Symptom of drainage flood

Energy Harvesting

9 Copyright 2017 FUJITSU

Business

System Integration (Hardware Software Installation etc) Services Maintenance Consulting and so on

Sensor Node

Water Flow

Water-treatment Plant

Manhole

Visualization

Data Flow

Cloud

Data of water level in sewer pipe Wireless

Transmission

Consulting Analysis and notification of flood zone Decision of renewal program of drainage

Operator

Manhole With sensor

Gateway

Installation

Service

Maintenance

Consulting

10 Copyright 2017 FUJITSU

Practice with Customer (Koriyama City)

Fukushima Prefecture

Koriyama City

Tokyo

Located about 200 km north of Tokyo Famous for beautiful sites 15 flood events (from 1986 to 2013)

Press release (Feb 2015)

11 Copyright 2017 FUJITSU

Practice with Customer (Koriyama City)

Gateway Box

Grating with water-level sensor

Sensor locations

Ochiaibori Storm Drain

① ②

Koriyama City Hall

Furukawa pumping station

Koriyama station

Succeeded in the real-time water-level measurement of the sewer pipe at heavy rain Detected a rapid water-level rise of 22 m (91 of full level) in only 20 min

Rainfall

Water-level

Water-level

Water-level

The water-level increased toward the downstream

The maximum rainfall intensity 78 mmh

The maximum rainfall intensity 48 mmh

Midstream

Downstream

Upstream

The maximum rainfall intensity 51 mmh

Full level of the pipe

Full level of the pipe

Full level of the pipe (5 m)

The lag time in upstream -downstream was about 15 minutes

After the rainfall the water-level was

the maximum in 15-30 minutes later

Wat

er-l

evel

(m

)

Rai

nfa

ll (m

mh

) 雨量

(m

mh

)

Wat

er-l

evel

(m

) W

ater

-lev

el (

m)

Rainfall

Rainfall

Rai

nfa

ll (m

mh

) R

ain

fall

(mm

h)

Time

Time

Time

12 Copyright 2017 FUJITSU

Business Start

Fujitsu BU decided to start business

Press release (Aug 2016)

13 Copyright 2017 FUJITSU

Mobility

14 Copyright 2017 FUJITSU

Social Concern and Future Mobility

Self-driving cars

Shared cars

Emerging transport System Ride sharing Car sharing

Self-driving Cars

Ship Performance Estimation

Dynamic Mobility Management

MaaS PF

M-IoT PF

Congestion Management

Customized Transportation

Measured rate Flat rate

Mobility service

Train Ship Aircraft Human

Concern(problems) Traffic jam Congestion Long waiting time Energy efficiency

Idea

15 Copyright 2017 FUJITSU

Practice Singapore CoE (Centre of Excellence)

Collaborative research center (5 years since Oct 2014) Fujitsu Limited Agency for Science Technology and Research (ASTAR) Singapore Management University (SMU)

Objective Develop solutions that address urban challenges for sustainable urbanization

Projects

Dynamic Mobility Management

Maritime and Port Optimization

Large-scale Data Processing

Urban Computing Platform

16 Copyright 2017 FUJITSU

Congestion Relief Challenges in Singapore

17 Copyright 2017 FUJITSU

The world first attempt to alleviate congestion by inducing peoples behavior change with AI technology

Technology Dynamic Mobility Management

SPATIOWL

Retail data

Event data

Data collection (congestion situation etc)

Activity recommendation (via smartphone)

Location data

Transport data

BUS

TRAIN

What should I do before leaving AI

Distribute people into different time slots transport mode

Transport Hub Large-scale Facility

I want to avoid congestionhellip When should I leave Which transport mode should I take

TAXI

How about dropping by your favorite shop before leaving (you can get coupon )

Why donrsquot you take a uncongested train leaving 1 hour later

Dining

Dining incentive

Shopping incentive

18 Copyright 2017 FUJITSU

Scale model Simplified material

and structure Limited conditions

on wind wave etc No ocean current

Social Concern in Ship Design and Operation

Design performance (in tank)

Full scale Actual material

and structure Effects of

wind wave current etc

Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO

Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea

Increasing needs for more energy-efficient ship design and operation

Gap between

performances Actual and wide-ranged conditions

Artificial and limited experiments

Actual performance(at sea)

19 Copyright 2017 FUJITSU

Idea Routing System Configuration and Operation

Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes

If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves

Operational data

Weather prediction

Weather prediction

Recommended route

20 Copyright 2017 FUJITSU

Technology Accurate Ship Performance Estimation

Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models

Ship performances are visualized in various conditions and estimated for planned routes

Performance visualization

in various conditions

cargo weight

wind direction

wave direction

wave height

wind speed

Ship

p

erfo

rma

nce

current speed current

direction

aging

ship design H

igh

-dim

ensi

on

al

sta

tist

ica

l a

na

lysi

s

hellip

Performance estimation

on any planed routes

Calm condition

Current

Beam sea

Head sea

Head wind

Beam wind

21 Copyright 2017 FUJITSU

Practice Weather Routing Simulation

With the accurate ship performance optimal route reducing fuel consumption is calculated

by a weather routing simulation

Gathered operational data from Japanese maritime

shipping companies

Ship performance is estimated through actual ship operational data

22 Copyright 2017 FUJITSU

Sports

23 Copyright 2017 FUJITSU

Why Fujitsu is Developing the Scoring Gymnastics

Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing

technologies and broaden its application

Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring

24 Copyright 2017 FUJITSU

Social Concern Scoring Gymnastics

example of marking in a scoring sheet

Difficulties with scoring gymnastics One must cope with the techniques

becoming more and more complicated every year Scoring rules are modified once in every

4 years

Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets

25 Copyright 2017 FUJITSU

Idea Scoring-support System

Present State Our Goal Manual Scoring

3D Laser sensor

Recognition Result of posture and techniques are displayed

technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg

Scoring with the support by ICT

Scoring is becoming more and more difficult with its techniques increasingly more complicated

The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges

26 Copyright 2017 FUJITSU

Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time

of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus

maintaining its ability to seize key point precisely regardless of the distance

distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)

Lasre emission (START)

Detection (STOP)

ΔT

Target

2 次元 MEMSミラー

Detector Detctor

distance measuring

circuit

Lasre Emittor

Lasre Pulse Emission Controller

Emission Circuit

lens with adjustable

emission angle

reflection from the target

Seizing the posture of a person by measuring its key points location

Technology 3D Laser Sensor

Adjustable emission angle

Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications

27 Copyright 2017 FUJITSU

Technology Recognition of Posture and Techniques

Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo

Recognition results are utilized for evaluating the completeness of techniques

Copyright 2017 FUJITSU

Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

The Mechanism of Scoring Support System

Fitting the Skelton

Data Processing

Recognizing Elements

Scoring Support Application

Sensing the action

3D Laser Sensor

High-speed Data matching

Element Database

Storing Model data

Copyright 2017 FUJITSU

31 Copyright 2017 FUJITSU

The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics

Copyright 2017 FUJITSU

32 Copyright 2017 FUJITSU

Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration

Copyright 2017 FUJITSU

33 Copyright 2017 FUJITSU

技術説明

We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far

Copyright 2017 FUJITSU

34 Copyright 2017 FUJITSU

Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle

The Details of System Demonstration

Copyright 2017 FUJITSU

35 Copyright 2017 FUJITSU

Skill of technician or traditional dancer

Support for medical care handicapped people Sports

Fitness

Future Plans

36 Copyright 2017 FUJITSU

Robotics

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 2: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

1 Copyright 2017 FUJITSU

Applied Innovation Research - New Businesses Creation Initiatives

Shoji Suzuki Board member

Head of Applied Innovation Research Center

FUJITSU LABORATORIES LTD

2 Copyright 2017 FUJITSU

Agenda

What is Applied Innovation Research

3 Topics

Mobility

Sports

Robotics

3 Copyright 2017 FUJITSU

What is Applied Innovation Research

4 Copyright 2017 FUJITSU

Applied Innovation Research Overview

Objective To create new businesses by matching our cutting-edge technologies with social trends and market opportunities

Process To achieve rapid commercialization of the target technology in collaboration with our customers who provide valuable ldquoreal worldrdquo feedback on use cases

Social Concern

Idea

Technologies

Business Model

Practice with Customers

Business Start

Prototype

BUStartup

Marketing

Hypotheses

5 Copyright 2017 FUJITSU

Example Manhole Sensor

Manhole

Water level sensor

Sewer pipe

6 Copyright 2017 FUJITSU

Social Concern

gt50 mmh Source JMA HP

Freq

uen

cy o

f h

eavy

rai

n

(Aug 2008 Aichi)

(Oct 2015 South Carolina)

Example of flood damage

Localized torrential rain increases every year and the urban area flood damage also increases

Year

7 Copyright 2017 FUJITSU

Idea

Real time monitoring of the water level in sewer pipe with the sensor installed on the bottom of a manhole iron cover

Sensor Node

Water Flow

Gateway

Water-treatment Plant

Manhole

Visualization

Data Flow

Cloud

Data of water level in sewer pipe Wireless

Transmission

Analysis and notification of flood zone Decision of renewal program of drainage

Operator

8 Copyright 2017 FUJITSU

Technologies

Energy harvesting battery (Thermoelectric generator) Detecting symptom of drainage flood (Time-series data analysis)

Sensor Node

Water Flow

Gateway

Water-treatment Plant

Manhole

Visualization

Data Flow

Cloud

Data of water level in sewer pipe Wireless

Transmission

Analysis and notification of flood zone Decision of renewal program of drainage

Operator

Detecting Symptom of drainage flood

Energy Harvesting

9 Copyright 2017 FUJITSU

Business

System Integration (Hardware Software Installation etc) Services Maintenance Consulting and so on

Sensor Node

Water Flow

Water-treatment Plant

Manhole

Visualization

Data Flow

Cloud

Data of water level in sewer pipe Wireless

Transmission

Consulting Analysis and notification of flood zone Decision of renewal program of drainage

Operator

Manhole With sensor

Gateway

Installation

Service

Maintenance

Consulting

10 Copyright 2017 FUJITSU

Practice with Customer (Koriyama City)

Fukushima Prefecture

Koriyama City

Tokyo

Located about 200 km north of Tokyo Famous for beautiful sites 15 flood events (from 1986 to 2013)

Press release (Feb 2015)

11 Copyright 2017 FUJITSU

Practice with Customer (Koriyama City)

Gateway Box

Grating with water-level sensor

Sensor locations

Ochiaibori Storm Drain

① ②

Koriyama City Hall

Furukawa pumping station

Koriyama station

Succeeded in the real-time water-level measurement of the sewer pipe at heavy rain Detected a rapid water-level rise of 22 m (91 of full level) in only 20 min

Rainfall

Water-level

Water-level

Water-level

The water-level increased toward the downstream

The maximum rainfall intensity 78 mmh

The maximum rainfall intensity 48 mmh

Midstream

Downstream

Upstream

The maximum rainfall intensity 51 mmh

Full level of the pipe

Full level of the pipe

Full level of the pipe (5 m)

The lag time in upstream -downstream was about 15 minutes

After the rainfall the water-level was

the maximum in 15-30 minutes later

Wat

er-l

evel

(m

)

Rai

nfa

ll (m

mh

) 雨量

(m

mh

)

Wat

er-l

evel

(m

) W

ater

-lev

el (

m)

Rainfall

Rainfall

Rai

nfa

ll (m

mh

) R

ain

fall

(mm

h)

Time

Time

Time

12 Copyright 2017 FUJITSU

Business Start

Fujitsu BU decided to start business

Press release (Aug 2016)

13 Copyright 2017 FUJITSU

Mobility

14 Copyright 2017 FUJITSU

Social Concern and Future Mobility

Self-driving cars

Shared cars

Emerging transport System Ride sharing Car sharing

Self-driving Cars

Ship Performance Estimation

Dynamic Mobility Management

MaaS PF

M-IoT PF

Congestion Management

Customized Transportation

Measured rate Flat rate

Mobility service

Train Ship Aircraft Human

Concern(problems) Traffic jam Congestion Long waiting time Energy efficiency

Idea

15 Copyright 2017 FUJITSU

Practice Singapore CoE (Centre of Excellence)

Collaborative research center (5 years since Oct 2014) Fujitsu Limited Agency for Science Technology and Research (ASTAR) Singapore Management University (SMU)

Objective Develop solutions that address urban challenges for sustainable urbanization

Projects

Dynamic Mobility Management

Maritime and Port Optimization

Large-scale Data Processing

Urban Computing Platform

16 Copyright 2017 FUJITSU

Congestion Relief Challenges in Singapore

17 Copyright 2017 FUJITSU

The world first attempt to alleviate congestion by inducing peoples behavior change with AI technology

Technology Dynamic Mobility Management

SPATIOWL

Retail data

Event data

Data collection (congestion situation etc)

Activity recommendation (via smartphone)

Location data

Transport data

BUS

TRAIN

What should I do before leaving AI

Distribute people into different time slots transport mode

Transport Hub Large-scale Facility

I want to avoid congestionhellip When should I leave Which transport mode should I take

TAXI

How about dropping by your favorite shop before leaving (you can get coupon )

Why donrsquot you take a uncongested train leaving 1 hour later

Dining

Dining incentive

Shopping incentive

18 Copyright 2017 FUJITSU

Scale model Simplified material

and structure Limited conditions

on wind wave etc No ocean current

Social Concern in Ship Design and Operation

Design performance (in tank)

Full scale Actual material

and structure Effects of

wind wave current etc

Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO

Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea

Increasing needs for more energy-efficient ship design and operation

Gap between

performances Actual and wide-ranged conditions

Artificial and limited experiments

Actual performance(at sea)

19 Copyright 2017 FUJITSU

Idea Routing System Configuration and Operation

Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes

If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves

Operational data

Weather prediction

Weather prediction

Recommended route

20 Copyright 2017 FUJITSU

Technology Accurate Ship Performance Estimation

Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models

Ship performances are visualized in various conditions and estimated for planned routes

Performance visualization

in various conditions

cargo weight

wind direction

wave direction

wave height

wind speed

Ship

p

erfo

rma

nce

current speed current

direction

aging

ship design H

igh

-dim

ensi

on

al

sta

tist

ica

l a

na

lysi

s

hellip

Performance estimation

on any planed routes

Calm condition

Current

Beam sea

Head sea

Head wind

Beam wind

21 Copyright 2017 FUJITSU

Practice Weather Routing Simulation

With the accurate ship performance optimal route reducing fuel consumption is calculated

by a weather routing simulation

Gathered operational data from Japanese maritime

shipping companies

Ship performance is estimated through actual ship operational data

22 Copyright 2017 FUJITSU

Sports

23 Copyright 2017 FUJITSU

Why Fujitsu is Developing the Scoring Gymnastics

Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing

technologies and broaden its application

Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring

24 Copyright 2017 FUJITSU

Social Concern Scoring Gymnastics

example of marking in a scoring sheet

Difficulties with scoring gymnastics One must cope with the techniques

becoming more and more complicated every year Scoring rules are modified once in every

4 years

Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets

25 Copyright 2017 FUJITSU

Idea Scoring-support System

Present State Our Goal Manual Scoring

3D Laser sensor

Recognition Result of posture and techniques are displayed

technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg

Scoring with the support by ICT

Scoring is becoming more and more difficult with its techniques increasingly more complicated

The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges

26 Copyright 2017 FUJITSU

Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time

of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus

maintaining its ability to seize key point precisely regardless of the distance

distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)

Lasre emission (START)

Detection (STOP)

ΔT

Target

2 次元 MEMSミラー

Detector Detctor

distance measuring

circuit

Lasre Emittor

Lasre Pulse Emission Controller

Emission Circuit

lens with adjustable

emission angle

reflection from the target

Seizing the posture of a person by measuring its key points location

Technology 3D Laser Sensor

Adjustable emission angle

Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications

27 Copyright 2017 FUJITSU

Technology Recognition of Posture and Techniques

Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo

Recognition results are utilized for evaluating the completeness of techniques

Copyright 2017 FUJITSU

Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

The Mechanism of Scoring Support System

Fitting the Skelton

Data Processing

Recognizing Elements

Scoring Support Application

Sensing the action

3D Laser Sensor

High-speed Data matching

Element Database

Storing Model data

Copyright 2017 FUJITSU

31 Copyright 2017 FUJITSU

The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics

Copyright 2017 FUJITSU

32 Copyright 2017 FUJITSU

Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration

Copyright 2017 FUJITSU

33 Copyright 2017 FUJITSU

技術説明

We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far

Copyright 2017 FUJITSU

34 Copyright 2017 FUJITSU

Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle

The Details of System Demonstration

Copyright 2017 FUJITSU

35 Copyright 2017 FUJITSU

Skill of technician or traditional dancer

Support for medical care handicapped people Sports

Fitness

Future Plans

36 Copyright 2017 FUJITSU

Robotics

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 3: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

2 Copyright 2017 FUJITSU

Agenda

What is Applied Innovation Research

3 Topics

Mobility

Sports

Robotics

3 Copyright 2017 FUJITSU

What is Applied Innovation Research

4 Copyright 2017 FUJITSU

Applied Innovation Research Overview

Objective To create new businesses by matching our cutting-edge technologies with social trends and market opportunities

Process To achieve rapid commercialization of the target technology in collaboration with our customers who provide valuable ldquoreal worldrdquo feedback on use cases

Social Concern

Idea

Technologies

Business Model

Practice with Customers

Business Start

Prototype

BUStartup

Marketing

Hypotheses

5 Copyright 2017 FUJITSU

Example Manhole Sensor

Manhole

Water level sensor

Sewer pipe

6 Copyright 2017 FUJITSU

Social Concern

gt50 mmh Source JMA HP

Freq

uen

cy o

f h

eavy

rai

n

(Aug 2008 Aichi)

(Oct 2015 South Carolina)

Example of flood damage

Localized torrential rain increases every year and the urban area flood damage also increases

Year

7 Copyright 2017 FUJITSU

Idea

Real time monitoring of the water level in sewer pipe with the sensor installed on the bottom of a manhole iron cover

Sensor Node

Water Flow

Gateway

Water-treatment Plant

Manhole

Visualization

Data Flow

Cloud

Data of water level in sewer pipe Wireless

Transmission

Analysis and notification of flood zone Decision of renewal program of drainage

Operator

8 Copyright 2017 FUJITSU

Technologies

Energy harvesting battery (Thermoelectric generator) Detecting symptom of drainage flood (Time-series data analysis)

Sensor Node

Water Flow

Gateway

Water-treatment Plant

Manhole

Visualization

Data Flow

Cloud

Data of water level in sewer pipe Wireless

Transmission

Analysis and notification of flood zone Decision of renewal program of drainage

Operator

Detecting Symptom of drainage flood

Energy Harvesting

9 Copyright 2017 FUJITSU

Business

System Integration (Hardware Software Installation etc) Services Maintenance Consulting and so on

Sensor Node

Water Flow

Water-treatment Plant

Manhole

Visualization

Data Flow

Cloud

Data of water level in sewer pipe Wireless

Transmission

Consulting Analysis and notification of flood zone Decision of renewal program of drainage

Operator

Manhole With sensor

Gateway

Installation

Service

Maintenance

Consulting

10 Copyright 2017 FUJITSU

Practice with Customer (Koriyama City)

Fukushima Prefecture

Koriyama City

Tokyo

Located about 200 km north of Tokyo Famous for beautiful sites 15 flood events (from 1986 to 2013)

Press release (Feb 2015)

11 Copyright 2017 FUJITSU

Practice with Customer (Koriyama City)

Gateway Box

Grating with water-level sensor

Sensor locations

Ochiaibori Storm Drain

① ②

Koriyama City Hall

Furukawa pumping station

Koriyama station

Succeeded in the real-time water-level measurement of the sewer pipe at heavy rain Detected a rapid water-level rise of 22 m (91 of full level) in only 20 min

Rainfall

Water-level

Water-level

Water-level

The water-level increased toward the downstream

The maximum rainfall intensity 78 mmh

The maximum rainfall intensity 48 mmh

Midstream

Downstream

Upstream

The maximum rainfall intensity 51 mmh

Full level of the pipe

Full level of the pipe

Full level of the pipe (5 m)

The lag time in upstream -downstream was about 15 minutes

After the rainfall the water-level was

the maximum in 15-30 minutes later

Wat

er-l

evel

(m

)

Rai

nfa

ll (m

mh

) 雨量

(m

mh

)

Wat

er-l

evel

(m

) W

ater

-lev

el (

m)

Rainfall

Rainfall

Rai

nfa

ll (m

mh

) R

ain

fall

(mm

h)

Time

Time

Time

12 Copyright 2017 FUJITSU

Business Start

Fujitsu BU decided to start business

Press release (Aug 2016)

13 Copyright 2017 FUJITSU

Mobility

14 Copyright 2017 FUJITSU

Social Concern and Future Mobility

Self-driving cars

Shared cars

Emerging transport System Ride sharing Car sharing

Self-driving Cars

Ship Performance Estimation

Dynamic Mobility Management

MaaS PF

M-IoT PF

Congestion Management

Customized Transportation

Measured rate Flat rate

Mobility service

Train Ship Aircraft Human

Concern(problems) Traffic jam Congestion Long waiting time Energy efficiency

Idea

15 Copyright 2017 FUJITSU

Practice Singapore CoE (Centre of Excellence)

Collaborative research center (5 years since Oct 2014) Fujitsu Limited Agency for Science Technology and Research (ASTAR) Singapore Management University (SMU)

Objective Develop solutions that address urban challenges for sustainable urbanization

Projects

Dynamic Mobility Management

Maritime and Port Optimization

Large-scale Data Processing

Urban Computing Platform

16 Copyright 2017 FUJITSU

Congestion Relief Challenges in Singapore

17 Copyright 2017 FUJITSU

The world first attempt to alleviate congestion by inducing peoples behavior change with AI technology

Technology Dynamic Mobility Management

SPATIOWL

Retail data

Event data

Data collection (congestion situation etc)

Activity recommendation (via smartphone)

Location data

Transport data

BUS

TRAIN

What should I do before leaving AI

Distribute people into different time slots transport mode

Transport Hub Large-scale Facility

I want to avoid congestionhellip When should I leave Which transport mode should I take

TAXI

How about dropping by your favorite shop before leaving (you can get coupon )

Why donrsquot you take a uncongested train leaving 1 hour later

Dining

Dining incentive

Shopping incentive

18 Copyright 2017 FUJITSU

Scale model Simplified material

and structure Limited conditions

on wind wave etc No ocean current

Social Concern in Ship Design and Operation

Design performance (in tank)

Full scale Actual material

and structure Effects of

wind wave current etc

Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO

Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea

Increasing needs for more energy-efficient ship design and operation

Gap between

performances Actual and wide-ranged conditions

Artificial and limited experiments

Actual performance(at sea)

19 Copyright 2017 FUJITSU

Idea Routing System Configuration and Operation

Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes

If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves

Operational data

Weather prediction

Weather prediction

Recommended route

20 Copyright 2017 FUJITSU

Technology Accurate Ship Performance Estimation

Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models

Ship performances are visualized in various conditions and estimated for planned routes

Performance visualization

in various conditions

cargo weight

wind direction

wave direction

wave height

wind speed

Ship

p

erfo

rma

nce

current speed current

direction

aging

ship design H

igh

-dim

ensi

on

al

sta

tist

ica

l a

na

lysi

s

hellip

Performance estimation

on any planed routes

Calm condition

Current

Beam sea

Head sea

Head wind

Beam wind

21 Copyright 2017 FUJITSU

Practice Weather Routing Simulation

With the accurate ship performance optimal route reducing fuel consumption is calculated

by a weather routing simulation

Gathered operational data from Japanese maritime

shipping companies

Ship performance is estimated through actual ship operational data

22 Copyright 2017 FUJITSU

Sports

23 Copyright 2017 FUJITSU

Why Fujitsu is Developing the Scoring Gymnastics

Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing

technologies and broaden its application

Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring

24 Copyright 2017 FUJITSU

Social Concern Scoring Gymnastics

example of marking in a scoring sheet

Difficulties with scoring gymnastics One must cope with the techniques

becoming more and more complicated every year Scoring rules are modified once in every

4 years

Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets

25 Copyright 2017 FUJITSU

Idea Scoring-support System

Present State Our Goal Manual Scoring

3D Laser sensor

Recognition Result of posture and techniques are displayed

technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg

Scoring with the support by ICT

Scoring is becoming more and more difficult with its techniques increasingly more complicated

The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges

26 Copyright 2017 FUJITSU

Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time

of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus

maintaining its ability to seize key point precisely regardless of the distance

distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)

Lasre emission (START)

Detection (STOP)

ΔT

Target

2 次元 MEMSミラー

Detector Detctor

distance measuring

circuit

Lasre Emittor

Lasre Pulse Emission Controller

Emission Circuit

lens with adjustable

emission angle

reflection from the target

Seizing the posture of a person by measuring its key points location

Technology 3D Laser Sensor

Adjustable emission angle

Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications

27 Copyright 2017 FUJITSU

Technology Recognition of Posture and Techniques

Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo

Recognition results are utilized for evaluating the completeness of techniques

Copyright 2017 FUJITSU

Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

The Mechanism of Scoring Support System

Fitting the Skelton

Data Processing

Recognizing Elements

Scoring Support Application

Sensing the action

3D Laser Sensor

High-speed Data matching

Element Database

Storing Model data

Copyright 2017 FUJITSU

31 Copyright 2017 FUJITSU

The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics

Copyright 2017 FUJITSU

32 Copyright 2017 FUJITSU

Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration

Copyright 2017 FUJITSU

33 Copyright 2017 FUJITSU

技術説明

We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far

Copyright 2017 FUJITSU

34 Copyright 2017 FUJITSU

Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle

The Details of System Demonstration

Copyright 2017 FUJITSU

35 Copyright 2017 FUJITSU

Skill of technician or traditional dancer

Support for medical care handicapped people Sports

Fitness

Future Plans

36 Copyright 2017 FUJITSU

Robotics

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 4: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

3 Copyright 2017 FUJITSU

What is Applied Innovation Research

4 Copyright 2017 FUJITSU

Applied Innovation Research Overview

Objective To create new businesses by matching our cutting-edge technologies with social trends and market opportunities

Process To achieve rapid commercialization of the target technology in collaboration with our customers who provide valuable ldquoreal worldrdquo feedback on use cases

Social Concern

Idea

Technologies

Business Model

Practice with Customers

Business Start

Prototype

BUStartup

Marketing

Hypotheses

5 Copyright 2017 FUJITSU

Example Manhole Sensor

Manhole

Water level sensor

Sewer pipe

6 Copyright 2017 FUJITSU

Social Concern

gt50 mmh Source JMA HP

Freq

uen

cy o

f h

eavy

rai

n

(Aug 2008 Aichi)

(Oct 2015 South Carolina)

Example of flood damage

Localized torrential rain increases every year and the urban area flood damage also increases

Year

7 Copyright 2017 FUJITSU

Idea

Real time monitoring of the water level in sewer pipe with the sensor installed on the bottom of a manhole iron cover

Sensor Node

Water Flow

Gateway

Water-treatment Plant

Manhole

Visualization

Data Flow

Cloud

Data of water level in sewer pipe Wireless

Transmission

Analysis and notification of flood zone Decision of renewal program of drainage

Operator

8 Copyright 2017 FUJITSU

Technologies

Energy harvesting battery (Thermoelectric generator) Detecting symptom of drainage flood (Time-series data analysis)

Sensor Node

Water Flow

Gateway

Water-treatment Plant

Manhole

Visualization

Data Flow

Cloud

Data of water level in sewer pipe Wireless

Transmission

Analysis and notification of flood zone Decision of renewal program of drainage

Operator

Detecting Symptom of drainage flood

Energy Harvesting

9 Copyright 2017 FUJITSU

Business

System Integration (Hardware Software Installation etc) Services Maintenance Consulting and so on

Sensor Node

Water Flow

Water-treatment Plant

Manhole

Visualization

Data Flow

Cloud

Data of water level in sewer pipe Wireless

Transmission

Consulting Analysis and notification of flood zone Decision of renewal program of drainage

Operator

Manhole With sensor

Gateway

Installation

Service

Maintenance

Consulting

10 Copyright 2017 FUJITSU

Practice with Customer (Koriyama City)

Fukushima Prefecture

Koriyama City

Tokyo

Located about 200 km north of Tokyo Famous for beautiful sites 15 flood events (from 1986 to 2013)

Press release (Feb 2015)

11 Copyright 2017 FUJITSU

Practice with Customer (Koriyama City)

Gateway Box

Grating with water-level sensor

Sensor locations

Ochiaibori Storm Drain

① ②

Koriyama City Hall

Furukawa pumping station

Koriyama station

Succeeded in the real-time water-level measurement of the sewer pipe at heavy rain Detected a rapid water-level rise of 22 m (91 of full level) in only 20 min

Rainfall

Water-level

Water-level

Water-level

The water-level increased toward the downstream

The maximum rainfall intensity 78 mmh

The maximum rainfall intensity 48 mmh

Midstream

Downstream

Upstream

The maximum rainfall intensity 51 mmh

Full level of the pipe

Full level of the pipe

Full level of the pipe (5 m)

The lag time in upstream -downstream was about 15 minutes

After the rainfall the water-level was

the maximum in 15-30 minutes later

Wat

er-l

evel

(m

)

Rai

nfa

ll (m

mh

) 雨量

(m

mh

)

Wat

er-l

evel

(m

) W

ater

-lev

el (

m)

Rainfall

Rainfall

Rai

nfa

ll (m

mh

) R

ain

fall

(mm

h)

Time

Time

Time

12 Copyright 2017 FUJITSU

Business Start

Fujitsu BU decided to start business

Press release (Aug 2016)

13 Copyright 2017 FUJITSU

Mobility

14 Copyright 2017 FUJITSU

Social Concern and Future Mobility

Self-driving cars

Shared cars

Emerging transport System Ride sharing Car sharing

Self-driving Cars

Ship Performance Estimation

Dynamic Mobility Management

MaaS PF

M-IoT PF

Congestion Management

Customized Transportation

Measured rate Flat rate

Mobility service

Train Ship Aircraft Human

Concern(problems) Traffic jam Congestion Long waiting time Energy efficiency

Idea

15 Copyright 2017 FUJITSU

Practice Singapore CoE (Centre of Excellence)

Collaborative research center (5 years since Oct 2014) Fujitsu Limited Agency for Science Technology and Research (ASTAR) Singapore Management University (SMU)

Objective Develop solutions that address urban challenges for sustainable urbanization

Projects

Dynamic Mobility Management

Maritime and Port Optimization

Large-scale Data Processing

Urban Computing Platform

16 Copyright 2017 FUJITSU

Congestion Relief Challenges in Singapore

17 Copyright 2017 FUJITSU

The world first attempt to alleviate congestion by inducing peoples behavior change with AI technology

Technology Dynamic Mobility Management

SPATIOWL

Retail data

Event data

Data collection (congestion situation etc)

Activity recommendation (via smartphone)

Location data

Transport data

BUS

TRAIN

What should I do before leaving AI

Distribute people into different time slots transport mode

Transport Hub Large-scale Facility

I want to avoid congestionhellip When should I leave Which transport mode should I take

TAXI

How about dropping by your favorite shop before leaving (you can get coupon )

Why donrsquot you take a uncongested train leaving 1 hour later

Dining

Dining incentive

Shopping incentive

18 Copyright 2017 FUJITSU

Scale model Simplified material

and structure Limited conditions

on wind wave etc No ocean current

Social Concern in Ship Design and Operation

Design performance (in tank)

Full scale Actual material

and structure Effects of

wind wave current etc

Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO

Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea

Increasing needs for more energy-efficient ship design and operation

Gap between

performances Actual and wide-ranged conditions

Artificial and limited experiments

Actual performance(at sea)

19 Copyright 2017 FUJITSU

Idea Routing System Configuration and Operation

Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes

If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves

Operational data

Weather prediction

Weather prediction

Recommended route

20 Copyright 2017 FUJITSU

Technology Accurate Ship Performance Estimation

Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models

Ship performances are visualized in various conditions and estimated for planned routes

Performance visualization

in various conditions

cargo weight

wind direction

wave direction

wave height

wind speed

Ship

p

erfo

rma

nce

current speed current

direction

aging

ship design H

igh

-dim

ensi

on

al

sta

tist

ica

l a

na

lysi

s

hellip

Performance estimation

on any planed routes

Calm condition

Current

Beam sea

Head sea

Head wind

Beam wind

21 Copyright 2017 FUJITSU

Practice Weather Routing Simulation

With the accurate ship performance optimal route reducing fuel consumption is calculated

by a weather routing simulation

Gathered operational data from Japanese maritime

shipping companies

Ship performance is estimated through actual ship operational data

22 Copyright 2017 FUJITSU

Sports

23 Copyright 2017 FUJITSU

Why Fujitsu is Developing the Scoring Gymnastics

Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing

technologies and broaden its application

Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring

24 Copyright 2017 FUJITSU

Social Concern Scoring Gymnastics

example of marking in a scoring sheet

Difficulties with scoring gymnastics One must cope with the techniques

becoming more and more complicated every year Scoring rules are modified once in every

4 years

Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets

25 Copyright 2017 FUJITSU

Idea Scoring-support System

Present State Our Goal Manual Scoring

3D Laser sensor

Recognition Result of posture and techniques are displayed

technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg

Scoring with the support by ICT

Scoring is becoming more and more difficult with its techniques increasingly more complicated

The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges

26 Copyright 2017 FUJITSU

Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time

of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus

maintaining its ability to seize key point precisely regardless of the distance

distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)

Lasre emission (START)

Detection (STOP)

ΔT

Target

2 次元 MEMSミラー

Detector Detctor

distance measuring

circuit

Lasre Emittor

Lasre Pulse Emission Controller

Emission Circuit

lens with adjustable

emission angle

reflection from the target

Seizing the posture of a person by measuring its key points location

Technology 3D Laser Sensor

Adjustable emission angle

Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications

27 Copyright 2017 FUJITSU

Technology Recognition of Posture and Techniques

Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo

Recognition results are utilized for evaluating the completeness of techniques

Copyright 2017 FUJITSU

Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

The Mechanism of Scoring Support System

Fitting the Skelton

Data Processing

Recognizing Elements

Scoring Support Application

Sensing the action

3D Laser Sensor

High-speed Data matching

Element Database

Storing Model data

Copyright 2017 FUJITSU

31 Copyright 2017 FUJITSU

The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics

Copyright 2017 FUJITSU

32 Copyright 2017 FUJITSU

Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration

Copyright 2017 FUJITSU

33 Copyright 2017 FUJITSU

技術説明

We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far

Copyright 2017 FUJITSU

34 Copyright 2017 FUJITSU

Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle

The Details of System Demonstration

Copyright 2017 FUJITSU

35 Copyright 2017 FUJITSU

Skill of technician or traditional dancer

Support for medical care handicapped people Sports

Fitness

Future Plans

36 Copyright 2017 FUJITSU

Robotics

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 5: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

4 Copyright 2017 FUJITSU

Applied Innovation Research Overview

Objective To create new businesses by matching our cutting-edge technologies with social trends and market opportunities

Process To achieve rapid commercialization of the target technology in collaboration with our customers who provide valuable ldquoreal worldrdquo feedback on use cases

Social Concern

Idea

Technologies

Business Model

Practice with Customers

Business Start

Prototype

BUStartup

Marketing

Hypotheses

5 Copyright 2017 FUJITSU

Example Manhole Sensor

Manhole

Water level sensor

Sewer pipe

6 Copyright 2017 FUJITSU

Social Concern

gt50 mmh Source JMA HP

Freq

uen

cy o

f h

eavy

rai

n

(Aug 2008 Aichi)

(Oct 2015 South Carolina)

Example of flood damage

Localized torrential rain increases every year and the urban area flood damage also increases

Year

7 Copyright 2017 FUJITSU

Idea

Real time monitoring of the water level in sewer pipe with the sensor installed on the bottom of a manhole iron cover

Sensor Node

Water Flow

Gateway

Water-treatment Plant

Manhole

Visualization

Data Flow

Cloud

Data of water level in sewer pipe Wireless

Transmission

Analysis and notification of flood zone Decision of renewal program of drainage

Operator

8 Copyright 2017 FUJITSU

Technologies

Energy harvesting battery (Thermoelectric generator) Detecting symptom of drainage flood (Time-series data analysis)

Sensor Node

Water Flow

Gateway

Water-treatment Plant

Manhole

Visualization

Data Flow

Cloud

Data of water level in sewer pipe Wireless

Transmission

Analysis and notification of flood zone Decision of renewal program of drainage

Operator

Detecting Symptom of drainage flood

Energy Harvesting

9 Copyright 2017 FUJITSU

Business

System Integration (Hardware Software Installation etc) Services Maintenance Consulting and so on

Sensor Node

Water Flow

Water-treatment Plant

Manhole

Visualization

Data Flow

Cloud

Data of water level in sewer pipe Wireless

Transmission

Consulting Analysis and notification of flood zone Decision of renewal program of drainage

Operator

Manhole With sensor

Gateway

Installation

Service

Maintenance

Consulting

10 Copyright 2017 FUJITSU

Practice with Customer (Koriyama City)

Fukushima Prefecture

Koriyama City

Tokyo

Located about 200 km north of Tokyo Famous for beautiful sites 15 flood events (from 1986 to 2013)

Press release (Feb 2015)

11 Copyright 2017 FUJITSU

Practice with Customer (Koriyama City)

Gateway Box

Grating with water-level sensor

Sensor locations

Ochiaibori Storm Drain

① ②

Koriyama City Hall

Furukawa pumping station

Koriyama station

Succeeded in the real-time water-level measurement of the sewer pipe at heavy rain Detected a rapid water-level rise of 22 m (91 of full level) in only 20 min

Rainfall

Water-level

Water-level

Water-level

The water-level increased toward the downstream

The maximum rainfall intensity 78 mmh

The maximum rainfall intensity 48 mmh

Midstream

Downstream

Upstream

The maximum rainfall intensity 51 mmh

Full level of the pipe

Full level of the pipe

Full level of the pipe (5 m)

The lag time in upstream -downstream was about 15 minutes

After the rainfall the water-level was

the maximum in 15-30 minutes later

Wat

er-l

evel

(m

)

Rai

nfa

ll (m

mh

) 雨量

(m

mh

)

Wat

er-l

evel

(m

) W

ater

-lev

el (

m)

Rainfall

Rainfall

Rai

nfa

ll (m

mh

) R

ain

fall

(mm

h)

Time

Time

Time

12 Copyright 2017 FUJITSU

Business Start

Fujitsu BU decided to start business

Press release (Aug 2016)

13 Copyright 2017 FUJITSU

Mobility

14 Copyright 2017 FUJITSU

Social Concern and Future Mobility

Self-driving cars

Shared cars

Emerging transport System Ride sharing Car sharing

Self-driving Cars

Ship Performance Estimation

Dynamic Mobility Management

MaaS PF

M-IoT PF

Congestion Management

Customized Transportation

Measured rate Flat rate

Mobility service

Train Ship Aircraft Human

Concern(problems) Traffic jam Congestion Long waiting time Energy efficiency

Idea

15 Copyright 2017 FUJITSU

Practice Singapore CoE (Centre of Excellence)

Collaborative research center (5 years since Oct 2014) Fujitsu Limited Agency for Science Technology and Research (ASTAR) Singapore Management University (SMU)

Objective Develop solutions that address urban challenges for sustainable urbanization

Projects

Dynamic Mobility Management

Maritime and Port Optimization

Large-scale Data Processing

Urban Computing Platform

16 Copyright 2017 FUJITSU

Congestion Relief Challenges in Singapore

17 Copyright 2017 FUJITSU

The world first attempt to alleviate congestion by inducing peoples behavior change with AI technology

Technology Dynamic Mobility Management

SPATIOWL

Retail data

Event data

Data collection (congestion situation etc)

Activity recommendation (via smartphone)

Location data

Transport data

BUS

TRAIN

What should I do before leaving AI

Distribute people into different time slots transport mode

Transport Hub Large-scale Facility

I want to avoid congestionhellip When should I leave Which transport mode should I take

TAXI

How about dropping by your favorite shop before leaving (you can get coupon )

Why donrsquot you take a uncongested train leaving 1 hour later

Dining

Dining incentive

Shopping incentive

18 Copyright 2017 FUJITSU

Scale model Simplified material

and structure Limited conditions

on wind wave etc No ocean current

Social Concern in Ship Design and Operation

Design performance (in tank)

Full scale Actual material

and structure Effects of

wind wave current etc

Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO

Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea

Increasing needs for more energy-efficient ship design and operation

Gap between

performances Actual and wide-ranged conditions

Artificial and limited experiments

Actual performance(at sea)

19 Copyright 2017 FUJITSU

Idea Routing System Configuration and Operation

Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes

If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves

Operational data

Weather prediction

Weather prediction

Recommended route

20 Copyright 2017 FUJITSU

Technology Accurate Ship Performance Estimation

Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models

Ship performances are visualized in various conditions and estimated for planned routes

Performance visualization

in various conditions

cargo weight

wind direction

wave direction

wave height

wind speed

Ship

p

erfo

rma

nce

current speed current

direction

aging

ship design H

igh

-dim

ensi

on

al

sta

tist

ica

l a

na

lysi

s

hellip

Performance estimation

on any planed routes

Calm condition

Current

Beam sea

Head sea

Head wind

Beam wind

21 Copyright 2017 FUJITSU

Practice Weather Routing Simulation

With the accurate ship performance optimal route reducing fuel consumption is calculated

by a weather routing simulation

Gathered operational data from Japanese maritime

shipping companies

Ship performance is estimated through actual ship operational data

22 Copyright 2017 FUJITSU

Sports

23 Copyright 2017 FUJITSU

Why Fujitsu is Developing the Scoring Gymnastics

Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing

technologies and broaden its application

Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring

24 Copyright 2017 FUJITSU

Social Concern Scoring Gymnastics

example of marking in a scoring sheet

Difficulties with scoring gymnastics One must cope with the techniques

becoming more and more complicated every year Scoring rules are modified once in every

4 years

Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets

25 Copyright 2017 FUJITSU

Idea Scoring-support System

Present State Our Goal Manual Scoring

3D Laser sensor

Recognition Result of posture and techniques are displayed

technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg

Scoring with the support by ICT

Scoring is becoming more and more difficult with its techniques increasingly more complicated

The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges

26 Copyright 2017 FUJITSU

Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time

of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus

maintaining its ability to seize key point precisely regardless of the distance

distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)

Lasre emission (START)

Detection (STOP)

ΔT

Target

2 次元 MEMSミラー

Detector Detctor

distance measuring

circuit

Lasre Emittor

Lasre Pulse Emission Controller

Emission Circuit

lens with adjustable

emission angle

reflection from the target

Seizing the posture of a person by measuring its key points location

Technology 3D Laser Sensor

Adjustable emission angle

Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications

27 Copyright 2017 FUJITSU

Technology Recognition of Posture and Techniques

Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo

Recognition results are utilized for evaluating the completeness of techniques

Copyright 2017 FUJITSU

Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

The Mechanism of Scoring Support System

Fitting the Skelton

Data Processing

Recognizing Elements

Scoring Support Application

Sensing the action

3D Laser Sensor

High-speed Data matching

Element Database

Storing Model data

Copyright 2017 FUJITSU

31 Copyright 2017 FUJITSU

The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics

Copyright 2017 FUJITSU

32 Copyright 2017 FUJITSU

Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration

Copyright 2017 FUJITSU

33 Copyright 2017 FUJITSU

技術説明

We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far

Copyright 2017 FUJITSU

34 Copyright 2017 FUJITSU

Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle

The Details of System Demonstration

Copyright 2017 FUJITSU

35 Copyright 2017 FUJITSU

Skill of technician or traditional dancer

Support for medical care handicapped people Sports

Fitness

Future Plans

36 Copyright 2017 FUJITSU

Robotics

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 6: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

5 Copyright 2017 FUJITSU

Example Manhole Sensor

Manhole

Water level sensor

Sewer pipe

6 Copyright 2017 FUJITSU

Social Concern

gt50 mmh Source JMA HP

Freq

uen

cy o

f h

eavy

rai

n

(Aug 2008 Aichi)

(Oct 2015 South Carolina)

Example of flood damage

Localized torrential rain increases every year and the urban area flood damage also increases

Year

7 Copyright 2017 FUJITSU

Idea

Real time monitoring of the water level in sewer pipe with the sensor installed on the bottom of a manhole iron cover

Sensor Node

Water Flow

Gateway

Water-treatment Plant

Manhole

Visualization

Data Flow

Cloud

Data of water level in sewer pipe Wireless

Transmission

Analysis and notification of flood zone Decision of renewal program of drainage

Operator

8 Copyright 2017 FUJITSU

Technologies

Energy harvesting battery (Thermoelectric generator) Detecting symptom of drainage flood (Time-series data analysis)

Sensor Node

Water Flow

Gateway

Water-treatment Plant

Manhole

Visualization

Data Flow

Cloud

Data of water level in sewer pipe Wireless

Transmission

Analysis and notification of flood zone Decision of renewal program of drainage

Operator

Detecting Symptom of drainage flood

Energy Harvesting

9 Copyright 2017 FUJITSU

Business

System Integration (Hardware Software Installation etc) Services Maintenance Consulting and so on

Sensor Node

Water Flow

Water-treatment Plant

Manhole

Visualization

Data Flow

Cloud

Data of water level in sewer pipe Wireless

Transmission

Consulting Analysis and notification of flood zone Decision of renewal program of drainage

Operator

Manhole With sensor

Gateway

Installation

Service

Maintenance

Consulting

10 Copyright 2017 FUJITSU

Practice with Customer (Koriyama City)

Fukushima Prefecture

Koriyama City

Tokyo

Located about 200 km north of Tokyo Famous for beautiful sites 15 flood events (from 1986 to 2013)

Press release (Feb 2015)

11 Copyright 2017 FUJITSU

Practice with Customer (Koriyama City)

Gateway Box

Grating with water-level sensor

Sensor locations

Ochiaibori Storm Drain

① ②

Koriyama City Hall

Furukawa pumping station

Koriyama station

Succeeded in the real-time water-level measurement of the sewer pipe at heavy rain Detected a rapid water-level rise of 22 m (91 of full level) in only 20 min

Rainfall

Water-level

Water-level

Water-level

The water-level increased toward the downstream

The maximum rainfall intensity 78 mmh

The maximum rainfall intensity 48 mmh

Midstream

Downstream

Upstream

The maximum rainfall intensity 51 mmh

Full level of the pipe

Full level of the pipe

Full level of the pipe (5 m)

The lag time in upstream -downstream was about 15 minutes

After the rainfall the water-level was

the maximum in 15-30 minutes later

Wat

er-l

evel

(m

)

Rai

nfa

ll (m

mh

) 雨量

(m

mh

)

Wat

er-l

evel

(m

) W

ater

-lev

el (

m)

Rainfall

Rainfall

Rai

nfa

ll (m

mh

) R

ain

fall

(mm

h)

Time

Time

Time

12 Copyright 2017 FUJITSU

Business Start

Fujitsu BU decided to start business

Press release (Aug 2016)

13 Copyright 2017 FUJITSU

Mobility

14 Copyright 2017 FUJITSU

Social Concern and Future Mobility

Self-driving cars

Shared cars

Emerging transport System Ride sharing Car sharing

Self-driving Cars

Ship Performance Estimation

Dynamic Mobility Management

MaaS PF

M-IoT PF

Congestion Management

Customized Transportation

Measured rate Flat rate

Mobility service

Train Ship Aircraft Human

Concern(problems) Traffic jam Congestion Long waiting time Energy efficiency

Idea

15 Copyright 2017 FUJITSU

Practice Singapore CoE (Centre of Excellence)

Collaborative research center (5 years since Oct 2014) Fujitsu Limited Agency for Science Technology and Research (ASTAR) Singapore Management University (SMU)

Objective Develop solutions that address urban challenges for sustainable urbanization

Projects

Dynamic Mobility Management

Maritime and Port Optimization

Large-scale Data Processing

Urban Computing Platform

16 Copyright 2017 FUJITSU

Congestion Relief Challenges in Singapore

17 Copyright 2017 FUJITSU

The world first attempt to alleviate congestion by inducing peoples behavior change with AI technology

Technology Dynamic Mobility Management

SPATIOWL

Retail data

Event data

Data collection (congestion situation etc)

Activity recommendation (via smartphone)

Location data

Transport data

BUS

TRAIN

What should I do before leaving AI

Distribute people into different time slots transport mode

Transport Hub Large-scale Facility

I want to avoid congestionhellip When should I leave Which transport mode should I take

TAXI

How about dropping by your favorite shop before leaving (you can get coupon )

Why donrsquot you take a uncongested train leaving 1 hour later

Dining

Dining incentive

Shopping incentive

18 Copyright 2017 FUJITSU

Scale model Simplified material

and structure Limited conditions

on wind wave etc No ocean current

Social Concern in Ship Design and Operation

Design performance (in tank)

Full scale Actual material

and structure Effects of

wind wave current etc

Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO

Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea

Increasing needs for more energy-efficient ship design and operation

Gap between

performances Actual and wide-ranged conditions

Artificial and limited experiments

Actual performance(at sea)

19 Copyright 2017 FUJITSU

Idea Routing System Configuration and Operation

Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes

If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves

Operational data

Weather prediction

Weather prediction

Recommended route

20 Copyright 2017 FUJITSU

Technology Accurate Ship Performance Estimation

Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models

Ship performances are visualized in various conditions and estimated for planned routes

Performance visualization

in various conditions

cargo weight

wind direction

wave direction

wave height

wind speed

Ship

p

erfo

rma

nce

current speed current

direction

aging

ship design H

igh

-dim

ensi

on

al

sta

tist

ica

l a

na

lysi

s

hellip

Performance estimation

on any planed routes

Calm condition

Current

Beam sea

Head sea

Head wind

Beam wind

21 Copyright 2017 FUJITSU

Practice Weather Routing Simulation

With the accurate ship performance optimal route reducing fuel consumption is calculated

by a weather routing simulation

Gathered operational data from Japanese maritime

shipping companies

Ship performance is estimated through actual ship operational data

22 Copyright 2017 FUJITSU

Sports

23 Copyright 2017 FUJITSU

Why Fujitsu is Developing the Scoring Gymnastics

Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing

technologies and broaden its application

Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring

24 Copyright 2017 FUJITSU

Social Concern Scoring Gymnastics

example of marking in a scoring sheet

Difficulties with scoring gymnastics One must cope with the techniques

becoming more and more complicated every year Scoring rules are modified once in every

4 years

Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets

25 Copyright 2017 FUJITSU

Idea Scoring-support System

Present State Our Goal Manual Scoring

3D Laser sensor

Recognition Result of posture and techniques are displayed

technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg

Scoring with the support by ICT

Scoring is becoming more and more difficult with its techniques increasingly more complicated

The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges

26 Copyright 2017 FUJITSU

Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time

of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus

maintaining its ability to seize key point precisely regardless of the distance

distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)

Lasre emission (START)

Detection (STOP)

ΔT

Target

2 次元 MEMSミラー

Detector Detctor

distance measuring

circuit

Lasre Emittor

Lasre Pulse Emission Controller

Emission Circuit

lens with adjustable

emission angle

reflection from the target

Seizing the posture of a person by measuring its key points location

Technology 3D Laser Sensor

Adjustable emission angle

Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications

27 Copyright 2017 FUJITSU

Technology Recognition of Posture and Techniques

Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo

Recognition results are utilized for evaluating the completeness of techniques

Copyright 2017 FUJITSU

Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

The Mechanism of Scoring Support System

Fitting the Skelton

Data Processing

Recognizing Elements

Scoring Support Application

Sensing the action

3D Laser Sensor

High-speed Data matching

Element Database

Storing Model data

Copyright 2017 FUJITSU

31 Copyright 2017 FUJITSU

The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics

Copyright 2017 FUJITSU

32 Copyright 2017 FUJITSU

Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration

Copyright 2017 FUJITSU

33 Copyright 2017 FUJITSU

技術説明

We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far

Copyright 2017 FUJITSU

34 Copyright 2017 FUJITSU

Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle

The Details of System Demonstration

Copyright 2017 FUJITSU

35 Copyright 2017 FUJITSU

Skill of technician or traditional dancer

Support for medical care handicapped people Sports

Fitness

Future Plans

36 Copyright 2017 FUJITSU

Robotics

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 7: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

6 Copyright 2017 FUJITSU

Social Concern

gt50 mmh Source JMA HP

Freq

uen

cy o

f h

eavy

rai

n

(Aug 2008 Aichi)

(Oct 2015 South Carolina)

Example of flood damage

Localized torrential rain increases every year and the urban area flood damage also increases

Year

7 Copyright 2017 FUJITSU

Idea

Real time monitoring of the water level in sewer pipe with the sensor installed on the bottom of a manhole iron cover

Sensor Node

Water Flow

Gateway

Water-treatment Plant

Manhole

Visualization

Data Flow

Cloud

Data of water level in sewer pipe Wireless

Transmission

Analysis and notification of flood zone Decision of renewal program of drainage

Operator

8 Copyright 2017 FUJITSU

Technologies

Energy harvesting battery (Thermoelectric generator) Detecting symptom of drainage flood (Time-series data analysis)

Sensor Node

Water Flow

Gateway

Water-treatment Plant

Manhole

Visualization

Data Flow

Cloud

Data of water level in sewer pipe Wireless

Transmission

Analysis and notification of flood zone Decision of renewal program of drainage

Operator

Detecting Symptom of drainage flood

Energy Harvesting

9 Copyright 2017 FUJITSU

Business

System Integration (Hardware Software Installation etc) Services Maintenance Consulting and so on

Sensor Node

Water Flow

Water-treatment Plant

Manhole

Visualization

Data Flow

Cloud

Data of water level in sewer pipe Wireless

Transmission

Consulting Analysis and notification of flood zone Decision of renewal program of drainage

Operator

Manhole With sensor

Gateway

Installation

Service

Maintenance

Consulting

10 Copyright 2017 FUJITSU

Practice with Customer (Koriyama City)

Fukushima Prefecture

Koriyama City

Tokyo

Located about 200 km north of Tokyo Famous for beautiful sites 15 flood events (from 1986 to 2013)

Press release (Feb 2015)

11 Copyright 2017 FUJITSU

Practice with Customer (Koriyama City)

Gateway Box

Grating with water-level sensor

Sensor locations

Ochiaibori Storm Drain

① ②

Koriyama City Hall

Furukawa pumping station

Koriyama station

Succeeded in the real-time water-level measurement of the sewer pipe at heavy rain Detected a rapid water-level rise of 22 m (91 of full level) in only 20 min

Rainfall

Water-level

Water-level

Water-level

The water-level increased toward the downstream

The maximum rainfall intensity 78 mmh

The maximum rainfall intensity 48 mmh

Midstream

Downstream

Upstream

The maximum rainfall intensity 51 mmh

Full level of the pipe

Full level of the pipe

Full level of the pipe (5 m)

The lag time in upstream -downstream was about 15 minutes

After the rainfall the water-level was

the maximum in 15-30 minutes later

Wat

er-l

evel

(m

)

Rai

nfa

ll (m

mh

) 雨量

(m

mh

)

Wat

er-l

evel

(m

) W

ater

-lev

el (

m)

Rainfall

Rainfall

Rai

nfa

ll (m

mh

) R

ain

fall

(mm

h)

Time

Time

Time

12 Copyright 2017 FUJITSU

Business Start

Fujitsu BU decided to start business

Press release (Aug 2016)

13 Copyright 2017 FUJITSU

Mobility

14 Copyright 2017 FUJITSU

Social Concern and Future Mobility

Self-driving cars

Shared cars

Emerging transport System Ride sharing Car sharing

Self-driving Cars

Ship Performance Estimation

Dynamic Mobility Management

MaaS PF

M-IoT PF

Congestion Management

Customized Transportation

Measured rate Flat rate

Mobility service

Train Ship Aircraft Human

Concern(problems) Traffic jam Congestion Long waiting time Energy efficiency

Idea

15 Copyright 2017 FUJITSU

Practice Singapore CoE (Centre of Excellence)

Collaborative research center (5 years since Oct 2014) Fujitsu Limited Agency for Science Technology and Research (ASTAR) Singapore Management University (SMU)

Objective Develop solutions that address urban challenges for sustainable urbanization

Projects

Dynamic Mobility Management

Maritime and Port Optimization

Large-scale Data Processing

Urban Computing Platform

16 Copyright 2017 FUJITSU

Congestion Relief Challenges in Singapore

17 Copyright 2017 FUJITSU

The world first attempt to alleviate congestion by inducing peoples behavior change with AI technology

Technology Dynamic Mobility Management

SPATIOWL

Retail data

Event data

Data collection (congestion situation etc)

Activity recommendation (via smartphone)

Location data

Transport data

BUS

TRAIN

What should I do before leaving AI

Distribute people into different time slots transport mode

Transport Hub Large-scale Facility

I want to avoid congestionhellip When should I leave Which transport mode should I take

TAXI

How about dropping by your favorite shop before leaving (you can get coupon )

Why donrsquot you take a uncongested train leaving 1 hour later

Dining

Dining incentive

Shopping incentive

18 Copyright 2017 FUJITSU

Scale model Simplified material

and structure Limited conditions

on wind wave etc No ocean current

Social Concern in Ship Design and Operation

Design performance (in tank)

Full scale Actual material

and structure Effects of

wind wave current etc

Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO

Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea

Increasing needs for more energy-efficient ship design and operation

Gap between

performances Actual and wide-ranged conditions

Artificial and limited experiments

Actual performance(at sea)

19 Copyright 2017 FUJITSU

Idea Routing System Configuration and Operation

Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes

If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves

Operational data

Weather prediction

Weather prediction

Recommended route

20 Copyright 2017 FUJITSU

Technology Accurate Ship Performance Estimation

Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models

Ship performances are visualized in various conditions and estimated for planned routes

Performance visualization

in various conditions

cargo weight

wind direction

wave direction

wave height

wind speed

Ship

p

erfo

rma

nce

current speed current

direction

aging

ship design H

igh

-dim

ensi

on

al

sta

tist

ica

l a

na

lysi

s

hellip

Performance estimation

on any planed routes

Calm condition

Current

Beam sea

Head sea

Head wind

Beam wind

21 Copyright 2017 FUJITSU

Practice Weather Routing Simulation

With the accurate ship performance optimal route reducing fuel consumption is calculated

by a weather routing simulation

Gathered operational data from Japanese maritime

shipping companies

Ship performance is estimated through actual ship operational data

22 Copyright 2017 FUJITSU

Sports

23 Copyright 2017 FUJITSU

Why Fujitsu is Developing the Scoring Gymnastics

Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing

technologies and broaden its application

Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring

24 Copyright 2017 FUJITSU

Social Concern Scoring Gymnastics

example of marking in a scoring sheet

Difficulties with scoring gymnastics One must cope with the techniques

becoming more and more complicated every year Scoring rules are modified once in every

4 years

Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets

25 Copyright 2017 FUJITSU

Idea Scoring-support System

Present State Our Goal Manual Scoring

3D Laser sensor

Recognition Result of posture and techniques are displayed

technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg

Scoring with the support by ICT

Scoring is becoming more and more difficult with its techniques increasingly more complicated

The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges

26 Copyright 2017 FUJITSU

Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time

of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus

maintaining its ability to seize key point precisely regardless of the distance

distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)

Lasre emission (START)

Detection (STOP)

ΔT

Target

2 次元 MEMSミラー

Detector Detctor

distance measuring

circuit

Lasre Emittor

Lasre Pulse Emission Controller

Emission Circuit

lens with adjustable

emission angle

reflection from the target

Seizing the posture of a person by measuring its key points location

Technology 3D Laser Sensor

Adjustable emission angle

Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications

27 Copyright 2017 FUJITSU

Technology Recognition of Posture and Techniques

Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo

Recognition results are utilized for evaluating the completeness of techniques

Copyright 2017 FUJITSU

Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

The Mechanism of Scoring Support System

Fitting the Skelton

Data Processing

Recognizing Elements

Scoring Support Application

Sensing the action

3D Laser Sensor

High-speed Data matching

Element Database

Storing Model data

Copyright 2017 FUJITSU

31 Copyright 2017 FUJITSU

The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics

Copyright 2017 FUJITSU

32 Copyright 2017 FUJITSU

Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration

Copyright 2017 FUJITSU

33 Copyright 2017 FUJITSU

技術説明

We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far

Copyright 2017 FUJITSU

34 Copyright 2017 FUJITSU

Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle

The Details of System Demonstration

Copyright 2017 FUJITSU

35 Copyright 2017 FUJITSU

Skill of technician or traditional dancer

Support for medical care handicapped people Sports

Fitness

Future Plans

36 Copyright 2017 FUJITSU

Robotics

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 8: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

7 Copyright 2017 FUJITSU

Idea

Real time monitoring of the water level in sewer pipe with the sensor installed on the bottom of a manhole iron cover

Sensor Node

Water Flow

Gateway

Water-treatment Plant

Manhole

Visualization

Data Flow

Cloud

Data of water level in sewer pipe Wireless

Transmission

Analysis and notification of flood zone Decision of renewal program of drainage

Operator

8 Copyright 2017 FUJITSU

Technologies

Energy harvesting battery (Thermoelectric generator) Detecting symptom of drainage flood (Time-series data analysis)

Sensor Node

Water Flow

Gateway

Water-treatment Plant

Manhole

Visualization

Data Flow

Cloud

Data of water level in sewer pipe Wireless

Transmission

Analysis and notification of flood zone Decision of renewal program of drainage

Operator

Detecting Symptom of drainage flood

Energy Harvesting

9 Copyright 2017 FUJITSU

Business

System Integration (Hardware Software Installation etc) Services Maintenance Consulting and so on

Sensor Node

Water Flow

Water-treatment Plant

Manhole

Visualization

Data Flow

Cloud

Data of water level in sewer pipe Wireless

Transmission

Consulting Analysis and notification of flood zone Decision of renewal program of drainage

Operator

Manhole With sensor

Gateway

Installation

Service

Maintenance

Consulting

10 Copyright 2017 FUJITSU

Practice with Customer (Koriyama City)

Fukushima Prefecture

Koriyama City

Tokyo

Located about 200 km north of Tokyo Famous for beautiful sites 15 flood events (from 1986 to 2013)

Press release (Feb 2015)

11 Copyright 2017 FUJITSU

Practice with Customer (Koriyama City)

Gateway Box

Grating with water-level sensor

Sensor locations

Ochiaibori Storm Drain

① ②

Koriyama City Hall

Furukawa pumping station

Koriyama station

Succeeded in the real-time water-level measurement of the sewer pipe at heavy rain Detected a rapid water-level rise of 22 m (91 of full level) in only 20 min

Rainfall

Water-level

Water-level

Water-level

The water-level increased toward the downstream

The maximum rainfall intensity 78 mmh

The maximum rainfall intensity 48 mmh

Midstream

Downstream

Upstream

The maximum rainfall intensity 51 mmh

Full level of the pipe

Full level of the pipe

Full level of the pipe (5 m)

The lag time in upstream -downstream was about 15 minutes

After the rainfall the water-level was

the maximum in 15-30 minutes later

Wat

er-l

evel

(m

)

Rai

nfa

ll (m

mh

) 雨量

(m

mh

)

Wat

er-l

evel

(m

) W

ater

-lev

el (

m)

Rainfall

Rainfall

Rai

nfa

ll (m

mh

) R

ain

fall

(mm

h)

Time

Time

Time

12 Copyright 2017 FUJITSU

Business Start

Fujitsu BU decided to start business

Press release (Aug 2016)

13 Copyright 2017 FUJITSU

Mobility

14 Copyright 2017 FUJITSU

Social Concern and Future Mobility

Self-driving cars

Shared cars

Emerging transport System Ride sharing Car sharing

Self-driving Cars

Ship Performance Estimation

Dynamic Mobility Management

MaaS PF

M-IoT PF

Congestion Management

Customized Transportation

Measured rate Flat rate

Mobility service

Train Ship Aircraft Human

Concern(problems) Traffic jam Congestion Long waiting time Energy efficiency

Idea

15 Copyright 2017 FUJITSU

Practice Singapore CoE (Centre of Excellence)

Collaborative research center (5 years since Oct 2014) Fujitsu Limited Agency for Science Technology and Research (ASTAR) Singapore Management University (SMU)

Objective Develop solutions that address urban challenges for sustainable urbanization

Projects

Dynamic Mobility Management

Maritime and Port Optimization

Large-scale Data Processing

Urban Computing Platform

16 Copyright 2017 FUJITSU

Congestion Relief Challenges in Singapore

17 Copyright 2017 FUJITSU

The world first attempt to alleviate congestion by inducing peoples behavior change with AI technology

Technology Dynamic Mobility Management

SPATIOWL

Retail data

Event data

Data collection (congestion situation etc)

Activity recommendation (via smartphone)

Location data

Transport data

BUS

TRAIN

What should I do before leaving AI

Distribute people into different time slots transport mode

Transport Hub Large-scale Facility

I want to avoid congestionhellip When should I leave Which transport mode should I take

TAXI

How about dropping by your favorite shop before leaving (you can get coupon )

Why donrsquot you take a uncongested train leaving 1 hour later

Dining

Dining incentive

Shopping incentive

18 Copyright 2017 FUJITSU

Scale model Simplified material

and structure Limited conditions

on wind wave etc No ocean current

Social Concern in Ship Design and Operation

Design performance (in tank)

Full scale Actual material

and structure Effects of

wind wave current etc

Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO

Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea

Increasing needs for more energy-efficient ship design and operation

Gap between

performances Actual and wide-ranged conditions

Artificial and limited experiments

Actual performance(at sea)

19 Copyright 2017 FUJITSU

Idea Routing System Configuration and Operation

Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes

If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves

Operational data

Weather prediction

Weather prediction

Recommended route

20 Copyright 2017 FUJITSU

Technology Accurate Ship Performance Estimation

Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models

Ship performances are visualized in various conditions and estimated for planned routes

Performance visualization

in various conditions

cargo weight

wind direction

wave direction

wave height

wind speed

Ship

p

erfo

rma

nce

current speed current

direction

aging

ship design H

igh

-dim

ensi

on

al

sta

tist

ica

l a

na

lysi

s

hellip

Performance estimation

on any planed routes

Calm condition

Current

Beam sea

Head sea

Head wind

Beam wind

21 Copyright 2017 FUJITSU

Practice Weather Routing Simulation

With the accurate ship performance optimal route reducing fuel consumption is calculated

by a weather routing simulation

Gathered operational data from Japanese maritime

shipping companies

Ship performance is estimated through actual ship operational data

22 Copyright 2017 FUJITSU

Sports

23 Copyright 2017 FUJITSU

Why Fujitsu is Developing the Scoring Gymnastics

Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing

technologies and broaden its application

Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring

24 Copyright 2017 FUJITSU

Social Concern Scoring Gymnastics

example of marking in a scoring sheet

Difficulties with scoring gymnastics One must cope with the techniques

becoming more and more complicated every year Scoring rules are modified once in every

4 years

Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets

25 Copyright 2017 FUJITSU

Idea Scoring-support System

Present State Our Goal Manual Scoring

3D Laser sensor

Recognition Result of posture and techniques are displayed

technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg

Scoring with the support by ICT

Scoring is becoming more and more difficult with its techniques increasingly more complicated

The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges

26 Copyright 2017 FUJITSU

Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time

of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus

maintaining its ability to seize key point precisely regardless of the distance

distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)

Lasre emission (START)

Detection (STOP)

ΔT

Target

2 次元 MEMSミラー

Detector Detctor

distance measuring

circuit

Lasre Emittor

Lasre Pulse Emission Controller

Emission Circuit

lens with adjustable

emission angle

reflection from the target

Seizing the posture of a person by measuring its key points location

Technology 3D Laser Sensor

Adjustable emission angle

Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications

27 Copyright 2017 FUJITSU

Technology Recognition of Posture and Techniques

Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo

Recognition results are utilized for evaluating the completeness of techniques

Copyright 2017 FUJITSU

Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

The Mechanism of Scoring Support System

Fitting the Skelton

Data Processing

Recognizing Elements

Scoring Support Application

Sensing the action

3D Laser Sensor

High-speed Data matching

Element Database

Storing Model data

Copyright 2017 FUJITSU

31 Copyright 2017 FUJITSU

The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics

Copyright 2017 FUJITSU

32 Copyright 2017 FUJITSU

Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration

Copyright 2017 FUJITSU

33 Copyright 2017 FUJITSU

技術説明

We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far

Copyright 2017 FUJITSU

34 Copyright 2017 FUJITSU

Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle

The Details of System Demonstration

Copyright 2017 FUJITSU

35 Copyright 2017 FUJITSU

Skill of technician or traditional dancer

Support for medical care handicapped people Sports

Fitness

Future Plans

36 Copyright 2017 FUJITSU

Robotics

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 9: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

8 Copyright 2017 FUJITSU

Technologies

Energy harvesting battery (Thermoelectric generator) Detecting symptom of drainage flood (Time-series data analysis)

Sensor Node

Water Flow

Gateway

Water-treatment Plant

Manhole

Visualization

Data Flow

Cloud

Data of water level in sewer pipe Wireless

Transmission

Analysis and notification of flood zone Decision of renewal program of drainage

Operator

Detecting Symptom of drainage flood

Energy Harvesting

9 Copyright 2017 FUJITSU

Business

System Integration (Hardware Software Installation etc) Services Maintenance Consulting and so on

Sensor Node

Water Flow

Water-treatment Plant

Manhole

Visualization

Data Flow

Cloud

Data of water level in sewer pipe Wireless

Transmission

Consulting Analysis and notification of flood zone Decision of renewal program of drainage

Operator

Manhole With sensor

Gateway

Installation

Service

Maintenance

Consulting

10 Copyright 2017 FUJITSU

Practice with Customer (Koriyama City)

Fukushima Prefecture

Koriyama City

Tokyo

Located about 200 km north of Tokyo Famous for beautiful sites 15 flood events (from 1986 to 2013)

Press release (Feb 2015)

11 Copyright 2017 FUJITSU

Practice with Customer (Koriyama City)

Gateway Box

Grating with water-level sensor

Sensor locations

Ochiaibori Storm Drain

① ②

Koriyama City Hall

Furukawa pumping station

Koriyama station

Succeeded in the real-time water-level measurement of the sewer pipe at heavy rain Detected a rapid water-level rise of 22 m (91 of full level) in only 20 min

Rainfall

Water-level

Water-level

Water-level

The water-level increased toward the downstream

The maximum rainfall intensity 78 mmh

The maximum rainfall intensity 48 mmh

Midstream

Downstream

Upstream

The maximum rainfall intensity 51 mmh

Full level of the pipe

Full level of the pipe

Full level of the pipe (5 m)

The lag time in upstream -downstream was about 15 minutes

After the rainfall the water-level was

the maximum in 15-30 minutes later

Wat

er-l

evel

(m

)

Rai

nfa

ll (m

mh

) 雨量

(m

mh

)

Wat

er-l

evel

(m

) W

ater

-lev

el (

m)

Rainfall

Rainfall

Rai

nfa

ll (m

mh

) R

ain

fall

(mm

h)

Time

Time

Time

12 Copyright 2017 FUJITSU

Business Start

Fujitsu BU decided to start business

Press release (Aug 2016)

13 Copyright 2017 FUJITSU

Mobility

14 Copyright 2017 FUJITSU

Social Concern and Future Mobility

Self-driving cars

Shared cars

Emerging transport System Ride sharing Car sharing

Self-driving Cars

Ship Performance Estimation

Dynamic Mobility Management

MaaS PF

M-IoT PF

Congestion Management

Customized Transportation

Measured rate Flat rate

Mobility service

Train Ship Aircraft Human

Concern(problems) Traffic jam Congestion Long waiting time Energy efficiency

Idea

15 Copyright 2017 FUJITSU

Practice Singapore CoE (Centre of Excellence)

Collaborative research center (5 years since Oct 2014) Fujitsu Limited Agency for Science Technology and Research (ASTAR) Singapore Management University (SMU)

Objective Develop solutions that address urban challenges for sustainable urbanization

Projects

Dynamic Mobility Management

Maritime and Port Optimization

Large-scale Data Processing

Urban Computing Platform

16 Copyright 2017 FUJITSU

Congestion Relief Challenges in Singapore

17 Copyright 2017 FUJITSU

The world first attempt to alleviate congestion by inducing peoples behavior change with AI technology

Technology Dynamic Mobility Management

SPATIOWL

Retail data

Event data

Data collection (congestion situation etc)

Activity recommendation (via smartphone)

Location data

Transport data

BUS

TRAIN

What should I do before leaving AI

Distribute people into different time slots transport mode

Transport Hub Large-scale Facility

I want to avoid congestionhellip When should I leave Which transport mode should I take

TAXI

How about dropping by your favorite shop before leaving (you can get coupon )

Why donrsquot you take a uncongested train leaving 1 hour later

Dining

Dining incentive

Shopping incentive

18 Copyright 2017 FUJITSU

Scale model Simplified material

and structure Limited conditions

on wind wave etc No ocean current

Social Concern in Ship Design and Operation

Design performance (in tank)

Full scale Actual material

and structure Effects of

wind wave current etc

Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO

Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea

Increasing needs for more energy-efficient ship design and operation

Gap between

performances Actual and wide-ranged conditions

Artificial and limited experiments

Actual performance(at sea)

19 Copyright 2017 FUJITSU

Idea Routing System Configuration and Operation

Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes

If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves

Operational data

Weather prediction

Weather prediction

Recommended route

20 Copyright 2017 FUJITSU

Technology Accurate Ship Performance Estimation

Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models

Ship performances are visualized in various conditions and estimated for planned routes

Performance visualization

in various conditions

cargo weight

wind direction

wave direction

wave height

wind speed

Ship

p

erfo

rma

nce

current speed current

direction

aging

ship design H

igh

-dim

ensi

on

al

sta

tist

ica

l a

na

lysi

s

hellip

Performance estimation

on any planed routes

Calm condition

Current

Beam sea

Head sea

Head wind

Beam wind

21 Copyright 2017 FUJITSU

Practice Weather Routing Simulation

With the accurate ship performance optimal route reducing fuel consumption is calculated

by a weather routing simulation

Gathered operational data from Japanese maritime

shipping companies

Ship performance is estimated through actual ship operational data

22 Copyright 2017 FUJITSU

Sports

23 Copyright 2017 FUJITSU

Why Fujitsu is Developing the Scoring Gymnastics

Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing

technologies and broaden its application

Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring

24 Copyright 2017 FUJITSU

Social Concern Scoring Gymnastics

example of marking in a scoring sheet

Difficulties with scoring gymnastics One must cope with the techniques

becoming more and more complicated every year Scoring rules are modified once in every

4 years

Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets

25 Copyright 2017 FUJITSU

Idea Scoring-support System

Present State Our Goal Manual Scoring

3D Laser sensor

Recognition Result of posture and techniques are displayed

technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg

Scoring with the support by ICT

Scoring is becoming more and more difficult with its techniques increasingly more complicated

The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges

26 Copyright 2017 FUJITSU

Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time

of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus

maintaining its ability to seize key point precisely regardless of the distance

distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)

Lasre emission (START)

Detection (STOP)

ΔT

Target

2 次元 MEMSミラー

Detector Detctor

distance measuring

circuit

Lasre Emittor

Lasre Pulse Emission Controller

Emission Circuit

lens with adjustable

emission angle

reflection from the target

Seizing the posture of a person by measuring its key points location

Technology 3D Laser Sensor

Adjustable emission angle

Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications

27 Copyright 2017 FUJITSU

Technology Recognition of Posture and Techniques

Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo

Recognition results are utilized for evaluating the completeness of techniques

Copyright 2017 FUJITSU

Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

The Mechanism of Scoring Support System

Fitting the Skelton

Data Processing

Recognizing Elements

Scoring Support Application

Sensing the action

3D Laser Sensor

High-speed Data matching

Element Database

Storing Model data

Copyright 2017 FUJITSU

31 Copyright 2017 FUJITSU

The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics

Copyright 2017 FUJITSU

32 Copyright 2017 FUJITSU

Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration

Copyright 2017 FUJITSU

33 Copyright 2017 FUJITSU

技術説明

We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far

Copyright 2017 FUJITSU

34 Copyright 2017 FUJITSU

Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle

The Details of System Demonstration

Copyright 2017 FUJITSU

35 Copyright 2017 FUJITSU

Skill of technician or traditional dancer

Support for medical care handicapped people Sports

Fitness

Future Plans

36 Copyright 2017 FUJITSU

Robotics

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 10: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

9 Copyright 2017 FUJITSU

Business

System Integration (Hardware Software Installation etc) Services Maintenance Consulting and so on

Sensor Node

Water Flow

Water-treatment Plant

Manhole

Visualization

Data Flow

Cloud

Data of water level in sewer pipe Wireless

Transmission

Consulting Analysis and notification of flood zone Decision of renewal program of drainage

Operator

Manhole With sensor

Gateway

Installation

Service

Maintenance

Consulting

10 Copyright 2017 FUJITSU

Practice with Customer (Koriyama City)

Fukushima Prefecture

Koriyama City

Tokyo

Located about 200 km north of Tokyo Famous for beautiful sites 15 flood events (from 1986 to 2013)

Press release (Feb 2015)

11 Copyright 2017 FUJITSU

Practice with Customer (Koriyama City)

Gateway Box

Grating with water-level sensor

Sensor locations

Ochiaibori Storm Drain

① ②

Koriyama City Hall

Furukawa pumping station

Koriyama station

Succeeded in the real-time water-level measurement of the sewer pipe at heavy rain Detected a rapid water-level rise of 22 m (91 of full level) in only 20 min

Rainfall

Water-level

Water-level

Water-level

The water-level increased toward the downstream

The maximum rainfall intensity 78 mmh

The maximum rainfall intensity 48 mmh

Midstream

Downstream

Upstream

The maximum rainfall intensity 51 mmh

Full level of the pipe

Full level of the pipe

Full level of the pipe (5 m)

The lag time in upstream -downstream was about 15 minutes

After the rainfall the water-level was

the maximum in 15-30 minutes later

Wat

er-l

evel

(m

)

Rai

nfa

ll (m

mh

) 雨量

(m

mh

)

Wat

er-l

evel

(m

) W

ater

-lev

el (

m)

Rainfall

Rainfall

Rai

nfa

ll (m

mh

) R

ain

fall

(mm

h)

Time

Time

Time

12 Copyright 2017 FUJITSU

Business Start

Fujitsu BU decided to start business

Press release (Aug 2016)

13 Copyright 2017 FUJITSU

Mobility

14 Copyright 2017 FUJITSU

Social Concern and Future Mobility

Self-driving cars

Shared cars

Emerging transport System Ride sharing Car sharing

Self-driving Cars

Ship Performance Estimation

Dynamic Mobility Management

MaaS PF

M-IoT PF

Congestion Management

Customized Transportation

Measured rate Flat rate

Mobility service

Train Ship Aircraft Human

Concern(problems) Traffic jam Congestion Long waiting time Energy efficiency

Idea

15 Copyright 2017 FUJITSU

Practice Singapore CoE (Centre of Excellence)

Collaborative research center (5 years since Oct 2014) Fujitsu Limited Agency for Science Technology and Research (ASTAR) Singapore Management University (SMU)

Objective Develop solutions that address urban challenges for sustainable urbanization

Projects

Dynamic Mobility Management

Maritime and Port Optimization

Large-scale Data Processing

Urban Computing Platform

16 Copyright 2017 FUJITSU

Congestion Relief Challenges in Singapore

17 Copyright 2017 FUJITSU

The world first attempt to alleviate congestion by inducing peoples behavior change with AI technology

Technology Dynamic Mobility Management

SPATIOWL

Retail data

Event data

Data collection (congestion situation etc)

Activity recommendation (via smartphone)

Location data

Transport data

BUS

TRAIN

What should I do before leaving AI

Distribute people into different time slots transport mode

Transport Hub Large-scale Facility

I want to avoid congestionhellip When should I leave Which transport mode should I take

TAXI

How about dropping by your favorite shop before leaving (you can get coupon )

Why donrsquot you take a uncongested train leaving 1 hour later

Dining

Dining incentive

Shopping incentive

18 Copyright 2017 FUJITSU

Scale model Simplified material

and structure Limited conditions

on wind wave etc No ocean current

Social Concern in Ship Design and Operation

Design performance (in tank)

Full scale Actual material

and structure Effects of

wind wave current etc

Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO

Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea

Increasing needs for more energy-efficient ship design and operation

Gap between

performances Actual and wide-ranged conditions

Artificial and limited experiments

Actual performance(at sea)

19 Copyright 2017 FUJITSU

Idea Routing System Configuration and Operation

Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes

If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves

Operational data

Weather prediction

Weather prediction

Recommended route

20 Copyright 2017 FUJITSU

Technology Accurate Ship Performance Estimation

Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models

Ship performances are visualized in various conditions and estimated for planned routes

Performance visualization

in various conditions

cargo weight

wind direction

wave direction

wave height

wind speed

Ship

p

erfo

rma

nce

current speed current

direction

aging

ship design H

igh

-dim

ensi

on

al

sta

tist

ica

l a

na

lysi

s

hellip

Performance estimation

on any planed routes

Calm condition

Current

Beam sea

Head sea

Head wind

Beam wind

21 Copyright 2017 FUJITSU

Practice Weather Routing Simulation

With the accurate ship performance optimal route reducing fuel consumption is calculated

by a weather routing simulation

Gathered operational data from Japanese maritime

shipping companies

Ship performance is estimated through actual ship operational data

22 Copyright 2017 FUJITSU

Sports

23 Copyright 2017 FUJITSU

Why Fujitsu is Developing the Scoring Gymnastics

Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing

technologies and broaden its application

Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring

24 Copyright 2017 FUJITSU

Social Concern Scoring Gymnastics

example of marking in a scoring sheet

Difficulties with scoring gymnastics One must cope with the techniques

becoming more and more complicated every year Scoring rules are modified once in every

4 years

Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets

25 Copyright 2017 FUJITSU

Idea Scoring-support System

Present State Our Goal Manual Scoring

3D Laser sensor

Recognition Result of posture and techniques are displayed

technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg

Scoring with the support by ICT

Scoring is becoming more and more difficult with its techniques increasingly more complicated

The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges

26 Copyright 2017 FUJITSU

Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time

of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus

maintaining its ability to seize key point precisely regardless of the distance

distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)

Lasre emission (START)

Detection (STOP)

ΔT

Target

2 次元 MEMSミラー

Detector Detctor

distance measuring

circuit

Lasre Emittor

Lasre Pulse Emission Controller

Emission Circuit

lens with adjustable

emission angle

reflection from the target

Seizing the posture of a person by measuring its key points location

Technology 3D Laser Sensor

Adjustable emission angle

Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications

27 Copyright 2017 FUJITSU

Technology Recognition of Posture and Techniques

Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo

Recognition results are utilized for evaluating the completeness of techniques

Copyright 2017 FUJITSU

Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

The Mechanism of Scoring Support System

Fitting the Skelton

Data Processing

Recognizing Elements

Scoring Support Application

Sensing the action

3D Laser Sensor

High-speed Data matching

Element Database

Storing Model data

Copyright 2017 FUJITSU

31 Copyright 2017 FUJITSU

The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics

Copyright 2017 FUJITSU

32 Copyright 2017 FUJITSU

Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration

Copyright 2017 FUJITSU

33 Copyright 2017 FUJITSU

技術説明

We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far

Copyright 2017 FUJITSU

34 Copyright 2017 FUJITSU

Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle

The Details of System Demonstration

Copyright 2017 FUJITSU

35 Copyright 2017 FUJITSU

Skill of technician or traditional dancer

Support for medical care handicapped people Sports

Fitness

Future Plans

36 Copyright 2017 FUJITSU

Robotics

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 11: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

10 Copyright 2017 FUJITSU

Practice with Customer (Koriyama City)

Fukushima Prefecture

Koriyama City

Tokyo

Located about 200 km north of Tokyo Famous for beautiful sites 15 flood events (from 1986 to 2013)

Press release (Feb 2015)

11 Copyright 2017 FUJITSU

Practice with Customer (Koriyama City)

Gateway Box

Grating with water-level sensor

Sensor locations

Ochiaibori Storm Drain

① ②

Koriyama City Hall

Furukawa pumping station

Koriyama station

Succeeded in the real-time water-level measurement of the sewer pipe at heavy rain Detected a rapid water-level rise of 22 m (91 of full level) in only 20 min

Rainfall

Water-level

Water-level

Water-level

The water-level increased toward the downstream

The maximum rainfall intensity 78 mmh

The maximum rainfall intensity 48 mmh

Midstream

Downstream

Upstream

The maximum rainfall intensity 51 mmh

Full level of the pipe

Full level of the pipe

Full level of the pipe (5 m)

The lag time in upstream -downstream was about 15 minutes

After the rainfall the water-level was

the maximum in 15-30 minutes later

Wat

er-l

evel

(m

)

Rai

nfa

ll (m

mh

) 雨量

(m

mh

)

Wat

er-l

evel

(m

) W

ater

-lev

el (

m)

Rainfall

Rainfall

Rai

nfa

ll (m

mh

) R

ain

fall

(mm

h)

Time

Time

Time

12 Copyright 2017 FUJITSU

Business Start

Fujitsu BU decided to start business

Press release (Aug 2016)

13 Copyright 2017 FUJITSU

Mobility

14 Copyright 2017 FUJITSU

Social Concern and Future Mobility

Self-driving cars

Shared cars

Emerging transport System Ride sharing Car sharing

Self-driving Cars

Ship Performance Estimation

Dynamic Mobility Management

MaaS PF

M-IoT PF

Congestion Management

Customized Transportation

Measured rate Flat rate

Mobility service

Train Ship Aircraft Human

Concern(problems) Traffic jam Congestion Long waiting time Energy efficiency

Idea

15 Copyright 2017 FUJITSU

Practice Singapore CoE (Centre of Excellence)

Collaborative research center (5 years since Oct 2014) Fujitsu Limited Agency for Science Technology and Research (ASTAR) Singapore Management University (SMU)

Objective Develop solutions that address urban challenges for sustainable urbanization

Projects

Dynamic Mobility Management

Maritime and Port Optimization

Large-scale Data Processing

Urban Computing Platform

16 Copyright 2017 FUJITSU

Congestion Relief Challenges in Singapore

17 Copyright 2017 FUJITSU

The world first attempt to alleviate congestion by inducing peoples behavior change with AI technology

Technology Dynamic Mobility Management

SPATIOWL

Retail data

Event data

Data collection (congestion situation etc)

Activity recommendation (via smartphone)

Location data

Transport data

BUS

TRAIN

What should I do before leaving AI

Distribute people into different time slots transport mode

Transport Hub Large-scale Facility

I want to avoid congestionhellip When should I leave Which transport mode should I take

TAXI

How about dropping by your favorite shop before leaving (you can get coupon )

Why donrsquot you take a uncongested train leaving 1 hour later

Dining

Dining incentive

Shopping incentive

18 Copyright 2017 FUJITSU

Scale model Simplified material

and structure Limited conditions

on wind wave etc No ocean current

Social Concern in Ship Design and Operation

Design performance (in tank)

Full scale Actual material

and structure Effects of

wind wave current etc

Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO

Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea

Increasing needs for more energy-efficient ship design and operation

Gap between

performances Actual and wide-ranged conditions

Artificial and limited experiments

Actual performance(at sea)

19 Copyright 2017 FUJITSU

Idea Routing System Configuration and Operation

Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes

If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves

Operational data

Weather prediction

Weather prediction

Recommended route

20 Copyright 2017 FUJITSU

Technology Accurate Ship Performance Estimation

Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models

Ship performances are visualized in various conditions and estimated for planned routes

Performance visualization

in various conditions

cargo weight

wind direction

wave direction

wave height

wind speed

Ship

p

erfo

rma

nce

current speed current

direction

aging

ship design H

igh

-dim

ensi

on

al

sta

tist

ica

l a

na

lysi

s

hellip

Performance estimation

on any planed routes

Calm condition

Current

Beam sea

Head sea

Head wind

Beam wind

21 Copyright 2017 FUJITSU

Practice Weather Routing Simulation

With the accurate ship performance optimal route reducing fuel consumption is calculated

by a weather routing simulation

Gathered operational data from Japanese maritime

shipping companies

Ship performance is estimated through actual ship operational data

22 Copyright 2017 FUJITSU

Sports

23 Copyright 2017 FUJITSU

Why Fujitsu is Developing the Scoring Gymnastics

Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing

technologies and broaden its application

Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring

24 Copyright 2017 FUJITSU

Social Concern Scoring Gymnastics

example of marking in a scoring sheet

Difficulties with scoring gymnastics One must cope with the techniques

becoming more and more complicated every year Scoring rules are modified once in every

4 years

Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets

25 Copyright 2017 FUJITSU

Idea Scoring-support System

Present State Our Goal Manual Scoring

3D Laser sensor

Recognition Result of posture and techniques are displayed

technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg

Scoring with the support by ICT

Scoring is becoming more and more difficult with its techniques increasingly more complicated

The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges

26 Copyright 2017 FUJITSU

Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time

of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus

maintaining its ability to seize key point precisely regardless of the distance

distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)

Lasre emission (START)

Detection (STOP)

ΔT

Target

2 次元 MEMSミラー

Detector Detctor

distance measuring

circuit

Lasre Emittor

Lasre Pulse Emission Controller

Emission Circuit

lens with adjustable

emission angle

reflection from the target

Seizing the posture of a person by measuring its key points location

Technology 3D Laser Sensor

Adjustable emission angle

Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications

27 Copyright 2017 FUJITSU

Technology Recognition of Posture and Techniques

Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo

Recognition results are utilized for evaluating the completeness of techniques

Copyright 2017 FUJITSU

Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

The Mechanism of Scoring Support System

Fitting the Skelton

Data Processing

Recognizing Elements

Scoring Support Application

Sensing the action

3D Laser Sensor

High-speed Data matching

Element Database

Storing Model data

Copyright 2017 FUJITSU

31 Copyright 2017 FUJITSU

The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics

Copyright 2017 FUJITSU

32 Copyright 2017 FUJITSU

Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration

Copyright 2017 FUJITSU

33 Copyright 2017 FUJITSU

技術説明

We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far

Copyright 2017 FUJITSU

34 Copyright 2017 FUJITSU

Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle

The Details of System Demonstration

Copyright 2017 FUJITSU

35 Copyright 2017 FUJITSU

Skill of technician or traditional dancer

Support for medical care handicapped people Sports

Fitness

Future Plans

36 Copyright 2017 FUJITSU

Robotics

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 12: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

11 Copyright 2017 FUJITSU

Practice with Customer (Koriyama City)

Gateway Box

Grating with water-level sensor

Sensor locations

Ochiaibori Storm Drain

① ②

Koriyama City Hall

Furukawa pumping station

Koriyama station

Succeeded in the real-time water-level measurement of the sewer pipe at heavy rain Detected a rapid water-level rise of 22 m (91 of full level) in only 20 min

Rainfall

Water-level

Water-level

Water-level

The water-level increased toward the downstream

The maximum rainfall intensity 78 mmh

The maximum rainfall intensity 48 mmh

Midstream

Downstream

Upstream

The maximum rainfall intensity 51 mmh

Full level of the pipe

Full level of the pipe

Full level of the pipe (5 m)

The lag time in upstream -downstream was about 15 minutes

After the rainfall the water-level was

the maximum in 15-30 minutes later

Wat

er-l

evel

(m

)

Rai

nfa

ll (m

mh

) 雨量

(m

mh

)

Wat

er-l

evel

(m

) W

ater

-lev

el (

m)

Rainfall

Rainfall

Rai

nfa

ll (m

mh

) R

ain

fall

(mm

h)

Time

Time

Time

12 Copyright 2017 FUJITSU

Business Start

Fujitsu BU decided to start business

Press release (Aug 2016)

13 Copyright 2017 FUJITSU

Mobility

14 Copyright 2017 FUJITSU

Social Concern and Future Mobility

Self-driving cars

Shared cars

Emerging transport System Ride sharing Car sharing

Self-driving Cars

Ship Performance Estimation

Dynamic Mobility Management

MaaS PF

M-IoT PF

Congestion Management

Customized Transportation

Measured rate Flat rate

Mobility service

Train Ship Aircraft Human

Concern(problems) Traffic jam Congestion Long waiting time Energy efficiency

Idea

15 Copyright 2017 FUJITSU

Practice Singapore CoE (Centre of Excellence)

Collaborative research center (5 years since Oct 2014) Fujitsu Limited Agency for Science Technology and Research (ASTAR) Singapore Management University (SMU)

Objective Develop solutions that address urban challenges for sustainable urbanization

Projects

Dynamic Mobility Management

Maritime and Port Optimization

Large-scale Data Processing

Urban Computing Platform

16 Copyright 2017 FUJITSU

Congestion Relief Challenges in Singapore

17 Copyright 2017 FUJITSU

The world first attempt to alleviate congestion by inducing peoples behavior change with AI technology

Technology Dynamic Mobility Management

SPATIOWL

Retail data

Event data

Data collection (congestion situation etc)

Activity recommendation (via smartphone)

Location data

Transport data

BUS

TRAIN

What should I do before leaving AI

Distribute people into different time slots transport mode

Transport Hub Large-scale Facility

I want to avoid congestionhellip When should I leave Which transport mode should I take

TAXI

How about dropping by your favorite shop before leaving (you can get coupon )

Why donrsquot you take a uncongested train leaving 1 hour later

Dining

Dining incentive

Shopping incentive

18 Copyright 2017 FUJITSU

Scale model Simplified material

and structure Limited conditions

on wind wave etc No ocean current

Social Concern in Ship Design and Operation

Design performance (in tank)

Full scale Actual material

and structure Effects of

wind wave current etc

Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO

Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea

Increasing needs for more energy-efficient ship design and operation

Gap between

performances Actual and wide-ranged conditions

Artificial and limited experiments

Actual performance(at sea)

19 Copyright 2017 FUJITSU

Idea Routing System Configuration and Operation

Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes

If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves

Operational data

Weather prediction

Weather prediction

Recommended route

20 Copyright 2017 FUJITSU

Technology Accurate Ship Performance Estimation

Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models

Ship performances are visualized in various conditions and estimated for planned routes

Performance visualization

in various conditions

cargo weight

wind direction

wave direction

wave height

wind speed

Ship

p

erfo

rma

nce

current speed current

direction

aging

ship design H

igh

-dim

ensi

on

al

sta

tist

ica

l a

na

lysi

s

hellip

Performance estimation

on any planed routes

Calm condition

Current

Beam sea

Head sea

Head wind

Beam wind

21 Copyright 2017 FUJITSU

Practice Weather Routing Simulation

With the accurate ship performance optimal route reducing fuel consumption is calculated

by a weather routing simulation

Gathered operational data from Japanese maritime

shipping companies

Ship performance is estimated through actual ship operational data

22 Copyright 2017 FUJITSU

Sports

23 Copyright 2017 FUJITSU

Why Fujitsu is Developing the Scoring Gymnastics

Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing

technologies and broaden its application

Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring

24 Copyright 2017 FUJITSU

Social Concern Scoring Gymnastics

example of marking in a scoring sheet

Difficulties with scoring gymnastics One must cope with the techniques

becoming more and more complicated every year Scoring rules are modified once in every

4 years

Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets

25 Copyright 2017 FUJITSU

Idea Scoring-support System

Present State Our Goal Manual Scoring

3D Laser sensor

Recognition Result of posture and techniques are displayed

technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg

Scoring with the support by ICT

Scoring is becoming more and more difficult with its techniques increasingly more complicated

The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges

26 Copyright 2017 FUJITSU

Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time

of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus

maintaining its ability to seize key point precisely regardless of the distance

distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)

Lasre emission (START)

Detection (STOP)

ΔT

Target

2 次元 MEMSミラー

Detector Detctor

distance measuring

circuit

Lasre Emittor

Lasre Pulse Emission Controller

Emission Circuit

lens with adjustable

emission angle

reflection from the target

Seizing the posture of a person by measuring its key points location

Technology 3D Laser Sensor

Adjustable emission angle

Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications

27 Copyright 2017 FUJITSU

Technology Recognition of Posture and Techniques

Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo

Recognition results are utilized for evaluating the completeness of techniques

Copyright 2017 FUJITSU

Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

The Mechanism of Scoring Support System

Fitting the Skelton

Data Processing

Recognizing Elements

Scoring Support Application

Sensing the action

3D Laser Sensor

High-speed Data matching

Element Database

Storing Model data

Copyright 2017 FUJITSU

31 Copyright 2017 FUJITSU

The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics

Copyright 2017 FUJITSU

32 Copyright 2017 FUJITSU

Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration

Copyright 2017 FUJITSU

33 Copyright 2017 FUJITSU

技術説明

We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far

Copyright 2017 FUJITSU

34 Copyright 2017 FUJITSU

Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle

The Details of System Demonstration

Copyright 2017 FUJITSU

35 Copyright 2017 FUJITSU

Skill of technician or traditional dancer

Support for medical care handicapped people Sports

Fitness

Future Plans

36 Copyright 2017 FUJITSU

Robotics

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 13: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

12 Copyright 2017 FUJITSU

Business Start

Fujitsu BU decided to start business

Press release (Aug 2016)

13 Copyright 2017 FUJITSU

Mobility

14 Copyright 2017 FUJITSU

Social Concern and Future Mobility

Self-driving cars

Shared cars

Emerging transport System Ride sharing Car sharing

Self-driving Cars

Ship Performance Estimation

Dynamic Mobility Management

MaaS PF

M-IoT PF

Congestion Management

Customized Transportation

Measured rate Flat rate

Mobility service

Train Ship Aircraft Human

Concern(problems) Traffic jam Congestion Long waiting time Energy efficiency

Idea

15 Copyright 2017 FUJITSU

Practice Singapore CoE (Centre of Excellence)

Collaborative research center (5 years since Oct 2014) Fujitsu Limited Agency for Science Technology and Research (ASTAR) Singapore Management University (SMU)

Objective Develop solutions that address urban challenges for sustainable urbanization

Projects

Dynamic Mobility Management

Maritime and Port Optimization

Large-scale Data Processing

Urban Computing Platform

16 Copyright 2017 FUJITSU

Congestion Relief Challenges in Singapore

17 Copyright 2017 FUJITSU

The world first attempt to alleviate congestion by inducing peoples behavior change with AI technology

Technology Dynamic Mobility Management

SPATIOWL

Retail data

Event data

Data collection (congestion situation etc)

Activity recommendation (via smartphone)

Location data

Transport data

BUS

TRAIN

What should I do before leaving AI

Distribute people into different time slots transport mode

Transport Hub Large-scale Facility

I want to avoid congestionhellip When should I leave Which transport mode should I take

TAXI

How about dropping by your favorite shop before leaving (you can get coupon )

Why donrsquot you take a uncongested train leaving 1 hour later

Dining

Dining incentive

Shopping incentive

18 Copyright 2017 FUJITSU

Scale model Simplified material

and structure Limited conditions

on wind wave etc No ocean current

Social Concern in Ship Design and Operation

Design performance (in tank)

Full scale Actual material

and structure Effects of

wind wave current etc

Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO

Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea

Increasing needs for more energy-efficient ship design and operation

Gap between

performances Actual and wide-ranged conditions

Artificial and limited experiments

Actual performance(at sea)

19 Copyright 2017 FUJITSU

Idea Routing System Configuration and Operation

Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes

If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves

Operational data

Weather prediction

Weather prediction

Recommended route

20 Copyright 2017 FUJITSU

Technology Accurate Ship Performance Estimation

Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models

Ship performances are visualized in various conditions and estimated for planned routes

Performance visualization

in various conditions

cargo weight

wind direction

wave direction

wave height

wind speed

Ship

p

erfo

rma

nce

current speed current

direction

aging

ship design H

igh

-dim

ensi

on

al

sta

tist

ica

l a

na

lysi

s

hellip

Performance estimation

on any planed routes

Calm condition

Current

Beam sea

Head sea

Head wind

Beam wind

21 Copyright 2017 FUJITSU

Practice Weather Routing Simulation

With the accurate ship performance optimal route reducing fuel consumption is calculated

by a weather routing simulation

Gathered operational data from Japanese maritime

shipping companies

Ship performance is estimated through actual ship operational data

22 Copyright 2017 FUJITSU

Sports

23 Copyright 2017 FUJITSU

Why Fujitsu is Developing the Scoring Gymnastics

Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing

technologies and broaden its application

Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring

24 Copyright 2017 FUJITSU

Social Concern Scoring Gymnastics

example of marking in a scoring sheet

Difficulties with scoring gymnastics One must cope with the techniques

becoming more and more complicated every year Scoring rules are modified once in every

4 years

Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets

25 Copyright 2017 FUJITSU

Idea Scoring-support System

Present State Our Goal Manual Scoring

3D Laser sensor

Recognition Result of posture and techniques are displayed

technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg

Scoring with the support by ICT

Scoring is becoming more and more difficult with its techniques increasingly more complicated

The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges

26 Copyright 2017 FUJITSU

Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time

of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus

maintaining its ability to seize key point precisely regardless of the distance

distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)

Lasre emission (START)

Detection (STOP)

ΔT

Target

2 次元 MEMSミラー

Detector Detctor

distance measuring

circuit

Lasre Emittor

Lasre Pulse Emission Controller

Emission Circuit

lens with adjustable

emission angle

reflection from the target

Seizing the posture of a person by measuring its key points location

Technology 3D Laser Sensor

Adjustable emission angle

Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications

27 Copyright 2017 FUJITSU

Technology Recognition of Posture and Techniques

Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo

Recognition results are utilized for evaluating the completeness of techniques

Copyright 2017 FUJITSU

Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

The Mechanism of Scoring Support System

Fitting the Skelton

Data Processing

Recognizing Elements

Scoring Support Application

Sensing the action

3D Laser Sensor

High-speed Data matching

Element Database

Storing Model data

Copyright 2017 FUJITSU

31 Copyright 2017 FUJITSU

The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics

Copyright 2017 FUJITSU

32 Copyright 2017 FUJITSU

Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration

Copyright 2017 FUJITSU

33 Copyright 2017 FUJITSU

技術説明

We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far

Copyright 2017 FUJITSU

34 Copyright 2017 FUJITSU

Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle

The Details of System Demonstration

Copyright 2017 FUJITSU

35 Copyright 2017 FUJITSU

Skill of technician or traditional dancer

Support for medical care handicapped people Sports

Fitness

Future Plans

36 Copyright 2017 FUJITSU

Robotics

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 14: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

13 Copyright 2017 FUJITSU

Mobility

14 Copyright 2017 FUJITSU

Social Concern and Future Mobility

Self-driving cars

Shared cars

Emerging transport System Ride sharing Car sharing

Self-driving Cars

Ship Performance Estimation

Dynamic Mobility Management

MaaS PF

M-IoT PF

Congestion Management

Customized Transportation

Measured rate Flat rate

Mobility service

Train Ship Aircraft Human

Concern(problems) Traffic jam Congestion Long waiting time Energy efficiency

Idea

15 Copyright 2017 FUJITSU

Practice Singapore CoE (Centre of Excellence)

Collaborative research center (5 years since Oct 2014) Fujitsu Limited Agency for Science Technology and Research (ASTAR) Singapore Management University (SMU)

Objective Develop solutions that address urban challenges for sustainable urbanization

Projects

Dynamic Mobility Management

Maritime and Port Optimization

Large-scale Data Processing

Urban Computing Platform

16 Copyright 2017 FUJITSU

Congestion Relief Challenges in Singapore

17 Copyright 2017 FUJITSU

The world first attempt to alleviate congestion by inducing peoples behavior change with AI technology

Technology Dynamic Mobility Management

SPATIOWL

Retail data

Event data

Data collection (congestion situation etc)

Activity recommendation (via smartphone)

Location data

Transport data

BUS

TRAIN

What should I do before leaving AI

Distribute people into different time slots transport mode

Transport Hub Large-scale Facility

I want to avoid congestionhellip When should I leave Which transport mode should I take

TAXI

How about dropping by your favorite shop before leaving (you can get coupon )

Why donrsquot you take a uncongested train leaving 1 hour later

Dining

Dining incentive

Shopping incentive

18 Copyright 2017 FUJITSU

Scale model Simplified material

and structure Limited conditions

on wind wave etc No ocean current

Social Concern in Ship Design and Operation

Design performance (in tank)

Full scale Actual material

and structure Effects of

wind wave current etc

Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO

Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea

Increasing needs for more energy-efficient ship design and operation

Gap between

performances Actual and wide-ranged conditions

Artificial and limited experiments

Actual performance(at sea)

19 Copyright 2017 FUJITSU

Idea Routing System Configuration and Operation

Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes

If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves

Operational data

Weather prediction

Weather prediction

Recommended route

20 Copyright 2017 FUJITSU

Technology Accurate Ship Performance Estimation

Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models

Ship performances are visualized in various conditions and estimated for planned routes

Performance visualization

in various conditions

cargo weight

wind direction

wave direction

wave height

wind speed

Ship

p

erfo

rma

nce

current speed current

direction

aging

ship design H

igh

-dim

ensi

on

al

sta

tist

ica

l a

na

lysi

s

hellip

Performance estimation

on any planed routes

Calm condition

Current

Beam sea

Head sea

Head wind

Beam wind

21 Copyright 2017 FUJITSU

Practice Weather Routing Simulation

With the accurate ship performance optimal route reducing fuel consumption is calculated

by a weather routing simulation

Gathered operational data from Japanese maritime

shipping companies

Ship performance is estimated through actual ship operational data

22 Copyright 2017 FUJITSU

Sports

23 Copyright 2017 FUJITSU

Why Fujitsu is Developing the Scoring Gymnastics

Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing

technologies and broaden its application

Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring

24 Copyright 2017 FUJITSU

Social Concern Scoring Gymnastics

example of marking in a scoring sheet

Difficulties with scoring gymnastics One must cope with the techniques

becoming more and more complicated every year Scoring rules are modified once in every

4 years

Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets

25 Copyright 2017 FUJITSU

Idea Scoring-support System

Present State Our Goal Manual Scoring

3D Laser sensor

Recognition Result of posture and techniques are displayed

technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg

Scoring with the support by ICT

Scoring is becoming more and more difficult with its techniques increasingly more complicated

The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges

26 Copyright 2017 FUJITSU

Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time

of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus

maintaining its ability to seize key point precisely regardless of the distance

distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)

Lasre emission (START)

Detection (STOP)

ΔT

Target

2 次元 MEMSミラー

Detector Detctor

distance measuring

circuit

Lasre Emittor

Lasre Pulse Emission Controller

Emission Circuit

lens with adjustable

emission angle

reflection from the target

Seizing the posture of a person by measuring its key points location

Technology 3D Laser Sensor

Adjustable emission angle

Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications

27 Copyright 2017 FUJITSU

Technology Recognition of Posture and Techniques

Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo

Recognition results are utilized for evaluating the completeness of techniques

Copyright 2017 FUJITSU

Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

The Mechanism of Scoring Support System

Fitting the Skelton

Data Processing

Recognizing Elements

Scoring Support Application

Sensing the action

3D Laser Sensor

High-speed Data matching

Element Database

Storing Model data

Copyright 2017 FUJITSU

31 Copyright 2017 FUJITSU

The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics

Copyright 2017 FUJITSU

32 Copyright 2017 FUJITSU

Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration

Copyright 2017 FUJITSU

33 Copyright 2017 FUJITSU

技術説明

We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far

Copyright 2017 FUJITSU

34 Copyright 2017 FUJITSU

Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle

The Details of System Demonstration

Copyright 2017 FUJITSU

35 Copyright 2017 FUJITSU

Skill of technician or traditional dancer

Support for medical care handicapped people Sports

Fitness

Future Plans

36 Copyright 2017 FUJITSU

Robotics

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 15: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

14 Copyright 2017 FUJITSU

Social Concern and Future Mobility

Self-driving cars

Shared cars

Emerging transport System Ride sharing Car sharing

Self-driving Cars

Ship Performance Estimation

Dynamic Mobility Management

MaaS PF

M-IoT PF

Congestion Management

Customized Transportation

Measured rate Flat rate

Mobility service

Train Ship Aircraft Human

Concern(problems) Traffic jam Congestion Long waiting time Energy efficiency

Idea

15 Copyright 2017 FUJITSU

Practice Singapore CoE (Centre of Excellence)

Collaborative research center (5 years since Oct 2014) Fujitsu Limited Agency for Science Technology and Research (ASTAR) Singapore Management University (SMU)

Objective Develop solutions that address urban challenges for sustainable urbanization

Projects

Dynamic Mobility Management

Maritime and Port Optimization

Large-scale Data Processing

Urban Computing Platform

16 Copyright 2017 FUJITSU

Congestion Relief Challenges in Singapore

17 Copyright 2017 FUJITSU

The world first attempt to alleviate congestion by inducing peoples behavior change with AI technology

Technology Dynamic Mobility Management

SPATIOWL

Retail data

Event data

Data collection (congestion situation etc)

Activity recommendation (via smartphone)

Location data

Transport data

BUS

TRAIN

What should I do before leaving AI

Distribute people into different time slots transport mode

Transport Hub Large-scale Facility

I want to avoid congestionhellip When should I leave Which transport mode should I take

TAXI

How about dropping by your favorite shop before leaving (you can get coupon )

Why donrsquot you take a uncongested train leaving 1 hour later

Dining

Dining incentive

Shopping incentive

18 Copyright 2017 FUJITSU

Scale model Simplified material

and structure Limited conditions

on wind wave etc No ocean current

Social Concern in Ship Design and Operation

Design performance (in tank)

Full scale Actual material

and structure Effects of

wind wave current etc

Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO

Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea

Increasing needs for more energy-efficient ship design and operation

Gap between

performances Actual and wide-ranged conditions

Artificial and limited experiments

Actual performance(at sea)

19 Copyright 2017 FUJITSU

Idea Routing System Configuration and Operation

Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes

If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves

Operational data

Weather prediction

Weather prediction

Recommended route

20 Copyright 2017 FUJITSU

Technology Accurate Ship Performance Estimation

Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models

Ship performances are visualized in various conditions and estimated for planned routes

Performance visualization

in various conditions

cargo weight

wind direction

wave direction

wave height

wind speed

Ship

p

erfo

rma

nce

current speed current

direction

aging

ship design H

igh

-dim

ensi

on

al

sta

tist

ica

l a

na

lysi

s

hellip

Performance estimation

on any planed routes

Calm condition

Current

Beam sea

Head sea

Head wind

Beam wind

21 Copyright 2017 FUJITSU

Practice Weather Routing Simulation

With the accurate ship performance optimal route reducing fuel consumption is calculated

by a weather routing simulation

Gathered operational data from Japanese maritime

shipping companies

Ship performance is estimated through actual ship operational data

22 Copyright 2017 FUJITSU

Sports

23 Copyright 2017 FUJITSU

Why Fujitsu is Developing the Scoring Gymnastics

Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing

technologies and broaden its application

Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring

24 Copyright 2017 FUJITSU

Social Concern Scoring Gymnastics

example of marking in a scoring sheet

Difficulties with scoring gymnastics One must cope with the techniques

becoming more and more complicated every year Scoring rules are modified once in every

4 years

Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets

25 Copyright 2017 FUJITSU

Idea Scoring-support System

Present State Our Goal Manual Scoring

3D Laser sensor

Recognition Result of posture and techniques are displayed

technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg

Scoring with the support by ICT

Scoring is becoming more and more difficult with its techniques increasingly more complicated

The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges

26 Copyright 2017 FUJITSU

Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time

of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus

maintaining its ability to seize key point precisely regardless of the distance

distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)

Lasre emission (START)

Detection (STOP)

ΔT

Target

2 次元 MEMSミラー

Detector Detctor

distance measuring

circuit

Lasre Emittor

Lasre Pulse Emission Controller

Emission Circuit

lens with adjustable

emission angle

reflection from the target

Seizing the posture of a person by measuring its key points location

Technology 3D Laser Sensor

Adjustable emission angle

Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications

27 Copyright 2017 FUJITSU

Technology Recognition of Posture and Techniques

Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo

Recognition results are utilized for evaluating the completeness of techniques

Copyright 2017 FUJITSU

Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

The Mechanism of Scoring Support System

Fitting the Skelton

Data Processing

Recognizing Elements

Scoring Support Application

Sensing the action

3D Laser Sensor

High-speed Data matching

Element Database

Storing Model data

Copyright 2017 FUJITSU

31 Copyright 2017 FUJITSU

The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics

Copyright 2017 FUJITSU

32 Copyright 2017 FUJITSU

Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration

Copyright 2017 FUJITSU

33 Copyright 2017 FUJITSU

技術説明

We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far

Copyright 2017 FUJITSU

34 Copyright 2017 FUJITSU

Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle

The Details of System Demonstration

Copyright 2017 FUJITSU

35 Copyright 2017 FUJITSU

Skill of technician or traditional dancer

Support for medical care handicapped people Sports

Fitness

Future Plans

36 Copyright 2017 FUJITSU

Robotics

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 16: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

15 Copyright 2017 FUJITSU

Practice Singapore CoE (Centre of Excellence)

Collaborative research center (5 years since Oct 2014) Fujitsu Limited Agency for Science Technology and Research (ASTAR) Singapore Management University (SMU)

Objective Develop solutions that address urban challenges for sustainable urbanization

Projects

Dynamic Mobility Management

Maritime and Port Optimization

Large-scale Data Processing

Urban Computing Platform

16 Copyright 2017 FUJITSU

Congestion Relief Challenges in Singapore

17 Copyright 2017 FUJITSU

The world first attempt to alleviate congestion by inducing peoples behavior change with AI technology

Technology Dynamic Mobility Management

SPATIOWL

Retail data

Event data

Data collection (congestion situation etc)

Activity recommendation (via smartphone)

Location data

Transport data

BUS

TRAIN

What should I do before leaving AI

Distribute people into different time slots transport mode

Transport Hub Large-scale Facility

I want to avoid congestionhellip When should I leave Which transport mode should I take

TAXI

How about dropping by your favorite shop before leaving (you can get coupon )

Why donrsquot you take a uncongested train leaving 1 hour later

Dining

Dining incentive

Shopping incentive

18 Copyright 2017 FUJITSU

Scale model Simplified material

and structure Limited conditions

on wind wave etc No ocean current

Social Concern in Ship Design and Operation

Design performance (in tank)

Full scale Actual material

and structure Effects of

wind wave current etc

Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO

Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea

Increasing needs for more energy-efficient ship design and operation

Gap between

performances Actual and wide-ranged conditions

Artificial and limited experiments

Actual performance(at sea)

19 Copyright 2017 FUJITSU

Idea Routing System Configuration and Operation

Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes

If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves

Operational data

Weather prediction

Weather prediction

Recommended route

20 Copyright 2017 FUJITSU

Technology Accurate Ship Performance Estimation

Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models

Ship performances are visualized in various conditions and estimated for planned routes

Performance visualization

in various conditions

cargo weight

wind direction

wave direction

wave height

wind speed

Ship

p

erfo

rma

nce

current speed current

direction

aging

ship design H

igh

-dim

ensi

on

al

sta

tist

ica

l a

na

lysi

s

hellip

Performance estimation

on any planed routes

Calm condition

Current

Beam sea

Head sea

Head wind

Beam wind

21 Copyright 2017 FUJITSU

Practice Weather Routing Simulation

With the accurate ship performance optimal route reducing fuel consumption is calculated

by a weather routing simulation

Gathered operational data from Japanese maritime

shipping companies

Ship performance is estimated through actual ship operational data

22 Copyright 2017 FUJITSU

Sports

23 Copyright 2017 FUJITSU

Why Fujitsu is Developing the Scoring Gymnastics

Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing

technologies and broaden its application

Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring

24 Copyright 2017 FUJITSU

Social Concern Scoring Gymnastics

example of marking in a scoring sheet

Difficulties with scoring gymnastics One must cope with the techniques

becoming more and more complicated every year Scoring rules are modified once in every

4 years

Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets

25 Copyright 2017 FUJITSU

Idea Scoring-support System

Present State Our Goal Manual Scoring

3D Laser sensor

Recognition Result of posture and techniques are displayed

technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg

Scoring with the support by ICT

Scoring is becoming more and more difficult with its techniques increasingly more complicated

The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges

26 Copyright 2017 FUJITSU

Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time

of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus

maintaining its ability to seize key point precisely regardless of the distance

distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)

Lasre emission (START)

Detection (STOP)

ΔT

Target

2 次元 MEMSミラー

Detector Detctor

distance measuring

circuit

Lasre Emittor

Lasre Pulse Emission Controller

Emission Circuit

lens with adjustable

emission angle

reflection from the target

Seizing the posture of a person by measuring its key points location

Technology 3D Laser Sensor

Adjustable emission angle

Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications

27 Copyright 2017 FUJITSU

Technology Recognition of Posture and Techniques

Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo

Recognition results are utilized for evaluating the completeness of techniques

Copyright 2017 FUJITSU

Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

The Mechanism of Scoring Support System

Fitting the Skelton

Data Processing

Recognizing Elements

Scoring Support Application

Sensing the action

3D Laser Sensor

High-speed Data matching

Element Database

Storing Model data

Copyright 2017 FUJITSU

31 Copyright 2017 FUJITSU

The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics

Copyright 2017 FUJITSU

32 Copyright 2017 FUJITSU

Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration

Copyright 2017 FUJITSU

33 Copyright 2017 FUJITSU

技術説明

We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far

Copyright 2017 FUJITSU

34 Copyright 2017 FUJITSU

Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle

The Details of System Demonstration

Copyright 2017 FUJITSU

35 Copyright 2017 FUJITSU

Skill of technician or traditional dancer

Support for medical care handicapped people Sports

Fitness

Future Plans

36 Copyright 2017 FUJITSU

Robotics

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 17: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

16 Copyright 2017 FUJITSU

Congestion Relief Challenges in Singapore

17 Copyright 2017 FUJITSU

The world first attempt to alleviate congestion by inducing peoples behavior change with AI technology

Technology Dynamic Mobility Management

SPATIOWL

Retail data

Event data

Data collection (congestion situation etc)

Activity recommendation (via smartphone)

Location data

Transport data

BUS

TRAIN

What should I do before leaving AI

Distribute people into different time slots transport mode

Transport Hub Large-scale Facility

I want to avoid congestionhellip When should I leave Which transport mode should I take

TAXI

How about dropping by your favorite shop before leaving (you can get coupon )

Why donrsquot you take a uncongested train leaving 1 hour later

Dining

Dining incentive

Shopping incentive

18 Copyright 2017 FUJITSU

Scale model Simplified material

and structure Limited conditions

on wind wave etc No ocean current

Social Concern in Ship Design and Operation

Design performance (in tank)

Full scale Actual material

and structure Effects of

wind wave current etc

Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO

Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea

Increasing needs for more energy-efficient ship design and operation

Gap between

performances Actual and wide-ranged conditions

Artificial and limited experiments

Actual performance(at sea)

19 Copyright 2017 FUJITSU

Idea Routing System Configuration and Operation

Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes

If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves

Operational data

Weather prediction

Weather prediction

Recommended route

20 Copyright 2017 FUJITSU

Technology Accurate Ship Performance Estimation

Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models

Ship performances are visualized in various conditions and estimated for planned routes

Performance visualization

in various conditions

cargo weight

wind direction

wave direction

wave height

wind speed

Ship

p

erfo

rma

nce

current speed current

direction

aging

ship design H

igh

-dim

ensi

on

al

sta

tist

ica

l a

na

lysi

s

hellip

Performance estimation

on any planed routes

Calm condition

Current

Beam sea

Head sea

Head wind

Beam wind

21 Copyright 2017 FUJITSU

Practice Weather Routing Simulation

With the accurate ship performance optimal route reducing fuel consumption is calculated

by a weather routing simulation

Gathered operational data from Japanese maritime

shipping companies

Ship performance is estimated through actual ship operational data

22 Copyright 2017 FUJITSU

Sports

23 Copyright 2017 FUJITSU

Why Fujitsu is Developing the Scoring Gymnastics

Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing

technologies and broaden its application

Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring

24 Copyright 2017 FUJITSU

Social Concern Scoring Gymnastics

example of marking in a scoring sheet

Difficulties with scoring gymnastics One must cope with the techniques

becoming more and more complicated every year Scoring rules are modified once in every

4 years

Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets

25 Copyright 2017 FUJITSU

Idea Scoring-support System

Present State Our Goal Manual Scoring

3D Laser sensor

Recognition Result of posture and techniques are displayed

technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg

Scoring with the support by ICT

Scoring is becoming more and more difficult with its techniques increasingly more complicated

The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges

26 Copyright 2017 FUJITSU

Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time

of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus

maintaining its ability to seize key point precisely regardless of the distance

distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)

Lasre emission (START)

Detection (STOP)

ΔT

Target

2 次元 MEMSミラー

Detector Detctor

distance measuring

circuit

Lasre Emittor

Lasre Pulse Emission Controller

Emission Circuit

lens with adjustable

emission angle

reflection from the target

Seizing the posture of a person by measuring its key points location

Technology 3D Laser Sensor

Adjustable emission angle

Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications

27 Copyright 2017 FUJITSU

Technology Recognition of Posture and Techniques

Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo

Recognition results are utilized for evaluating the completeness of techniques

Copyright 2017 FUJITSU

Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

The Mechanism of Scoring Support System

Fitting the Skelton

Data Processing

Recognizing Elements

Scoring Support Application

Sensing the action

3D Laser Sensor

High-speed Data matching

Element Database

Storing Model data

Copyright 2017 FUJITSU

31 Copyright 2017 FUJITSU

The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics

Copyright 2017 FUJITSU

32 Copyright 2017 FUJITSU

Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration

Copyright 2017 FUJITSU

33 Copyright 2017 FUJITSU

技術説明

We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far

Copyright 2017 FUJITSU

34 Copyright 2017 FUJITSU

Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle

The Details of System Demonstration

Copyright 2017 FUJITSU

35 Copyright 2017 FUJITSU

Skill of technician or traditional dancer

Support for medical care handicapped people Sports

Fitness

Future Plans

36 Copyright 2017 FUJITSU

Robotics

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 18: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

17 Copyright 2017 FUJITSU

The world first attempt to alleviate congestion by inducing peoples behavior change with AI technology

Technology Dynamic Mobility Management

SPATIOWL

Retail data

Event data

Data collection (congestion situation etc)

Activity recommendation (via smartphone)

Location data

Transport data

BUS

TRAIN

What should I do before leaving AI

Distribute people into different time slots transport mode

Transport Hub Large-scale Facility

I want to avoid congestionhellip When should I leave Which transport mode should I take

TAXI

How about dropping by your favorite shop before leaving (you can get coupon )

Why donrsquot you take a uncongested train leaving 1 hour later

Dining

Dining incentive

Shopping incentive

18 Copyright 2017 FUJITSU

Scale model Simplified material

and structure Limited conditions

on wind wave etc No ocean current

Social Concern in Ship Design and Operation

Design performance (in tank)

Full scale Actual material

and structure Effects of

wind wave current etc

Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO

Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea

Increasing needs for more energy-efficient ship design and operation

Gap between

performances Actual and wide-ranged conditions

Artificial and limited experiments

Actual performance(at sea)

19 Copyright 2017 FUJITSU

Idea Routing System Configuration and Operation

Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes

If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves

Operational data

Weather prediction

Weather prediction

Recommended route

20 Copyright 2017 FUJITSU

Technology Accurate Ship Performance Estimation

Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models

Ship performances are visualized in various conditions and estimated for planned routes

Performance visualization

in various conditions

cargo weight

wind direction

wave direction

wave height

wind speed

Ship

p

erfo

rma

nce

current speed current

direction

aging

ship design H

igh

-dim

ensi

on

al

sta

tist

ica

l a

na

lysi

s

hellip

Performance estimation

on any planed routes

Calm condition

Current

Beam sea

Head sea

Head wind

Beam wind

21 Copyright 2017 FUJITSU

Practice Weather Routing Simulation

With the accurate ship performance optimal route reducing fuel consumption is calculated

by a weather routing simulation

Gathered operational data from Japanese maritime

shipping companies

Ship performance is estimated through actual ship operational data

22 Copyright 2017 FUJITSU

Sports

23 Copyright 2017 FUJITSU

Why Fujitsu is Developing the Scoring Gymnastics

Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing

technologies and broaden its application

Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring

24 Copyright 2017 FUJITSU

Social Concern Scoring Gymnastics

example of marking in a scoring sheet

Difficulties with scoring gymnastics One must cope with the techniques

becoming more and more complicated every year Scoring rules are modified once in every

4 years

Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets

25 Copyright 2017 FUJITSU

Idea Scoring-support System

Present State Our Goal Manual Scoring

3D Laser sensor

Recognition Result of posture and techniques are displayed

technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg

Scoring with the support by ICT

Scoring is becoming more and more difficult with its techniques increasingly more complicated

The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges

26 Copyright 2017 FUJITSU

Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time

of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus

maintaining its ability to seize key point precisely regardless of the distance

distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)

Lasre emission (START)

Detection (STOP)

ΔT

Target

2 次元 MEMSミラー

Detector Detctor

distance measuring

circuit

Lasre Emittor

Lasre Pulse Emission Controller

Emission Circuit

lens with adjustable

emission angle

reflection from the target

Seizing the posture of a person by measuring its key points location

Technology 3D Laser Sensor

Adjustable emission angle

Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications

27 Copyright 2017 FUJITSU

Technology Recognition of Posture and Techniques

Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo

Recognition results are utilized for evaluating the completeness of techniques

Copyright 2017 FUJITSU

Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

The Mechanism of Scoring Support System

Fitting the Skelton

Data Processing

Recognizing Elements

Scoring Support Application

Sensing the action

3D Laser Sensor

High-speed Data matching

Element Database

Storing Model data

Copyright 2017 FUJITSU

31 Copyright 2017 FUJITSU

The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics

Copyright 2017 FUJITSU

32 Copyright 2017 FUJITSU

Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration

Copyright 2017 FUJITSU

33 Copyright 2017 FUJITSU

技術説明

We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far

Copyright 2017 FUJITSU

34 Copyright 2017 FUJITSU

Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle

The Details of System Demonstration

Copyright 2017 FUJITSU

35 Copyright 2017 FUJITSU

Skill of technician or traditional dancer

Support for medical care handicapped people Sports

Fitness

Future Plans

36 Copyright 2017 FUJITSU

Robotics

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 19: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

18 Copyright 2017 FUJITSU

Scale model Simplified material

and structure Limited conditions

on wind wave etc No ocean current

Social Concern in Ship Design and Operation

Design performance (in tank)

Full scale Actual material

and structure Effects of

wind wave current etc

Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO

Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea

Increasing needs for more energy-efficient ship design and operation

Gap between

performances Actual and wide-ranged conditions

Artificial and limited experiments

Actual performance(at sea)

19 Copyright 2017 FUJITSU

Idea Routing System Configuration and Operation

Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes

If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves

Operational data

Weather prediction

Weather prediction

Recommended route

20 Copyright 2017 FUJITSU

Technology Accurate Ship Performance Estimation

Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models

Ship performances are visualized in various conditions and estimated for planned routes

Performance visualization

in various conditions

cargo weight

wind direction

wave direction

wave height

wind speed

Ship

p

erfo

rma

nce

current speed current

direction

aging

ship design H

igh

-dim

ensi

on

al

sta

tist

ica

l a

na

lysi

s

hellip

Performance estimation

on any planed routes

Calm condition

Current

Beam sea

Head sea

Head wind

Beam wind

21 Copyright 2017 FUJITSU

Practice Weather Routing Simulation

With the accurate ship performance optimal route reducing fuel consumption is calculated

by a weather routing simulation

Gathered operational data from Japanese maritime

shipping companies

Ship performance is estimated through actual ship operational data

22 Copyright 2017 FUJITSU

Sports

23 Copyright 2017 FUJITSU

Why Fujitsu is Developing the Scoring Gymnastics

Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing

technologies and broaden its application

Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring

24 Copyright 2017 FUJITSU

Social Concern Scoring Gymnastics

example of marking in a scoring sheet

Difficulties with scoring gymnastics One must cope with the techniques

becoming more and more complicated every year Scoring rules are modified once in every

4 years

Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets

25 Copyright 2017 FUJITSU

Idea Scoring-support System

Present State Our Goal Manual Scoring

3D Laser sensor

Recognition Result of posture and techniques are displayed

technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg

Scoring with the support by ICT

Scoring is becoming more and more difficult with its techniques increasingly more complicated

The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges

26 Copyright 2017 FUJITSU

Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time

of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus

maintaining its ability to seize key point precisely regardless of the distance

distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)

Lasre emission (START)

Detection (STOP)

ΔT

Target

2 次元 MEMSミラー

Detector Detctor

distance measuring

circuit

Lasre Emittor

Lasre Pulse Emission Controller

Emission Circuit

lens with adjustable

emission angle

reflection from the target

Seizing the posture of a person by measuring its key points location

Technology 3D Laser Sensor

Adjustable emission angle

Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications

27 Copyright 2017 FUJITSU

Technology Recognition of Posture and Techniques

Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo

Recognition results are utilized for evaluating the completeness of techniques

Copyright 2017 FUJITSU

Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

The Mechanism of Scoring Support System

Fitting the Skelton

Data Processing

Recognizing Elements

Scoring Support Application

Sensing the action

3D Laser Sensor

High-speed Data matching

Element Database

Storing Model data

Copyright 2017 FUJITSU

31 Copyright 2017 FUJITSU

The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics

Copyright 2017 FUJITSU

32 Copyright 2017 FUJITSU

Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration

Copyright 2017 FUJITSU

33 Copyright 2017 FUJITSU

技術説明

We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far

Copyright 2017 FUJITSU

34 Copyright 2017 FUJITSU

Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle

The Details of System Demonstration

Copyright 2017 FUJITSU

35 Copyright 2017 FUJITSU

Skill of technician or traditional dancer

Support for medical care handicapped people Sports

Fitness

Future Plans

36 Copyright 2017 FUJITSU

Robotics

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 20: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

19 Copyright 2017 FUJITSU

Idea Routing System Configuration and Operation

Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes

If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves

Operational data

Weather prediction

Weather prediction

Recommended route

20 Copyright 2017 FUJITSU

Technology Accurate Ship Performance Estimation

Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models

Ship performances are visualized in various conditions and estimated for planned routes

Performance visualization

in various conditions

cargo weight

wind direction

wave direction

wave height

wind speed

Ship

p

erfo

rma

nce

current speed current

direction

aging

ship design H

igh

-dim

ensi

on

al

sta

tist

ica

l a

na

lysi

s

hellip

Performance estimation

on any planed routes

Calm condition

Current

Beam sea

Head sea

Head wind

Beam wind

21 Copyright 2017 FUJITSU

Practice Weather Routing Simulation

With the accurate ship performance optimal route reducing fuel consumption is calculated

by a weather routing simulation

Gathered operational data from Japanese maritime

shipping companies

Ship performance is estimated through actual ship operational data

22 Copyright 2017 FUJITSU

Sports

23 Copyright 2017 FUJITSU

Why Fujitsu is Developing the Scoring Gymnastics

Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing

technologies and broaden its application

Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring

24 Copyright 2017 FUJITSU

Social Concern Scoring Gymnastics

example of marking in a scoring sheet

Difficulties with scoring gymnastics One must cope with the techniques

becoming more and more complicated every year Scoring rules are modified once in every

4 years

Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets

25 Copyright 2017 FUJITSU

Idea Scoring-support System

Present State Our Goal Manual Scoring

3D Laser sensor

Recognition Result of posture and techniques are displayed

technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg

Scoring with the support by ICT

Scoring is becoming more and more difficult with its techniques increasingly more complicated

The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges

26 Copyright 2017 FUJITSU

Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time

of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus

maintaining its ability to seize key point precisely regardless of the distance

distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)

Lasre emission (START)

Detection (STOP)

ΔT

Target

2 次元 MEMSミラー

Detector Detctor

distance measuring

circuit

Lasre Emittor

Lasre Pulse Emission Controller

Emission Circuit

lens with adjustable

emission angle

reflection from the target

Seizing the posture of a person by measuring its key points location

Technology 3D Laser Sensor

Adjustable emission angle

Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications

27 Copyright 2017 FUJITSU

Technology Recognition of Posture and Techniques

Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo

Recognition results are utilized for evaluating the completeness of techniques

Copyright 2017 FUJITSU

Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

The Mechanism of Scoring Support System

Fitting the Skelton

Data Processing

Recognizing Elements

Scoring Support Application

Sensing the action

3D Laser Sensor

High-speed Data matching

Element Database

Storing Model data

Copyright 2017 FUJITSU

31 Copyright 2017 FUJITSU

The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics

Copyright 2017 FUJITSU

32 Copyright 2017 FUJITSU

Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration

Copyright 2017 FUJITSU

33 Copyright 2017 FUJITSU

技術説明

We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far

Copyright 2017 FUJITSU

34 Copyright 2017 FUJITSU

Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle

The Details of System Demonstration

Copyright 2017 FUJITSU

35 Copyright 2017 FUJITSU

Skill of technician or traditional dancer

Support for medical care handicapped people Sports

Fitness

Future Plans

36 Copyright 2017 FUJITSU

Robotics

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 21: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

20 Copyright 2017 FUJITSU

Technology Accurate Ship Performance Estimation

Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models

Ship performances are visualized in various conditions and estimated for planned routes

Performance visualization

in various conditions

cargo weight

wind direction

wave direction

wave height

wind speed

Ship

p

erfo

rma

nce

current speed current

direction

aging

ship design H

igh

-dim

ensi

on

al

sta

tist

ica

l a

na

lysi

s

hellip

Performance estimation

on any planed routes

Calm condition

Current

Beam sea

Head sea

Head wind

Beam wind

21 Copyright 2017 FUJITSU

Practice Weather Routing Simulation

With the accurate ship performance optimal route reducing fuel consumption is calculated

by a weather routing simulation

Gathered operational data from Japanese maritime

shipping companies

Ship performance is estimated through actual ship operational data

22 Copyright 2017 FUJITSU

Sports

23 Copyright 2017 FUJITSU

Why Fujitsu is Developing the Scoring Gymnastics

Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing

technologies and broaden its application

Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring

24 Copyright 2017 FUJITSU

Social Concern Scoring Gymnastics

example of marking in a scoring sheet

Difficulties with scoring gymnastics One must cope with the techniques

becoming more and more complicated every year Scoring rules are modified once in every

4 years

Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets

25 Copyright 2017 FUJITSU

Idea Scoring-support System

Present State Our Goal Manual Scoring

3D Laser sensor

Recognition Result of posture and techniques are displayed

technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg

Scoring with the support by ICT

Scoring is becoming more and more difficult with its techniques increasingly more complicated

The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges

26 Copyright 2017 FUJITSU

Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time

of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus

maintaining its ability to seize key point precisely regardless of the distance

distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)

Lasre emission (START)

Detection (STOP)

ΔT

Target

2 次元 MEMSミラー

Detector Detctor

distance measuring

circuit

Lasre Emittor

Lasre Pulse Emission Controller

Emission Circuit

lens with adjustable

emission angle

reflection from the target

Seizing the posture of a person by measuring its key points location

Technology 3D Laser Sensor

Adjustable emission angle

Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications

27 Copyright 2017 FUJITSU

Technology Recognition of Posture and Techniques

Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo

Recognition results are utilized for evaluating the completeness of techniques

Copyright 2017 FUJITSU

Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

The Mechanism of Scoring Support System

Fitting the Skelton

Data Processing

Recognizing Elements

Scoring Support Application

Sensing the action

3D Laser Sensor

High-speed Data matching

Element Database

Storing Model data

Copyright 2017 FUJITSU

31 Copyright 2017 FUJITSU

The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics

Copyright 2017 FUJITSU

32 Copyright 2017 FUJITSU

Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration

Copyright 2017 FUJITSU

33 Copyright 2017 FUJITSU

技術説明

We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far

Copyright 2017 FUJITSU

34 Copyright 2017 FUJITSU

Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle

The Details of System Demonstration

Copyright 2017 FUJITSU

35 Copyright 2017 FUJITSU

Skill of technician or traditional dancer

Support for medical care handicapped people Sports

Fitness

Future Plans

36 Copyright 2017 FUJITSU

Robotics

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 22: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

21 Copyright 2017 FUJITSU

Practice Weather Routing Simulation

With the accurate ship performance optimal route reducing fuel consumption is calculated

by a weather routing simulation

Gathered operational data from Japanese maritime

shipping companies

Ship performance is estimated through actual ship operational data

22 Copyright 2017 FUJITSU

Sports

23 Copyright 2017 FUJITSU

Why Fujitsu is Developing the Scoring Gymnastics

Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing

technologies and broaden its application

Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring

24 Copyright 2017 FUJITSU

Social Concern Scoring Gymnastics

example of marking in a scoring sheet

Difficulties with scoring gymnastics One must cope with the techniques

becoming more and more complicated every year Scoring rules are modified once in every

4 years

Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets

25 Copyright 2017 FUJITSU

Idea Scoring-support System

Present State Our Goal Manual Scoring

3D Laser sensor

Recognition Result of posture and techniques are displayed

technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg

Scoring with the support by ICT

Scoring is becoming more and more difficult with its techniques increasingly more complicated

The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges

26 Copyright 2017 FUJITSU

Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time

of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus

maintaining its ability to seize key point precisely regardless of the distance

distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)

Lasre emission (START)

Detection (STOP)

ΔT

Target

2 次元 MEMSミラー

Detector Detctor

distance measuring

circuit

Lasre Emittor

Lasre Pulse Emission Controller

Emission Circuit

lens with adjustable

emission angle

reflection from the target

Seizing the posture of a person by measuring its key points location

Technology 3D Laser Sensor

Adjustable emission angle

Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications

27 Copyright 2017 FUJITSU

Technology Recognition of Posture and Techniques

Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo

Recognition results are utilized for evaluating the completeness of techniques

Copyright 2017 FUJITSU

Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

The Mechanism of Scoring Support System

Fitting the Skelton

Data Processing

Recognizing Elements

Scoring Support Application

Sensing the action

3D Laser Sensor

High-speed Data matching

Element Database

Storing Model data

Copyright 2017 FUJITSU

31 Copyright 2017 FUJITSU

The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics

Copyright 2017 FUJITSU

32 Copyright 2017 FUJITSU

Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration

Copyright 2017 FUJITSU

33 Copyright 2017 FUJITSU

技術説明

We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far

Copyright 2017 FUJITSU

34 Copyright 2017 FUJITSU

Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle

The Details of System Demonstration

Copyright 2017 FUJITSU

35 Copyright 2017 FUJITSU

Skill of technician or traditional dancer

Support for medical care handicapped people Sports

Fitness

Future Plans

36 Copyright 2017 FUJITSU

Robotics

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 23: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

22 Copyright 2017 FUJITSU

Sports

23 Copyright 2017 FUJITSU

Why Fujitsu is Developing the Scoring Gymnastics

Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing

technologies and broaden its application

Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring

24 Copyright 2017 FUJITSU

Social Concern Scoring Gymnastics

example of marking in a scoring sheet

Difficulties with scoring gymnastics One must cope with the techniques

becoming more and more complicated every year Scoring rules are modified once in every

4 years

Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets

25 Copyright 2017 FUJITSU

Idea Scoring-support System

Present State Our Goal Manual Scoring

3D Laser sensor

Recognition Result of posture and techniques are displayed

technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg

Scoring with the support by ICT

Scoring is becoming more and more difficult with its techniques increasingly more complicated

The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges

26 Copyright 2017 FUJITSU

Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time

of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus

maintaining its ability to seize key point precisely regardless of the distance

distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)

Lasre emission (START)

Detection (STOP)

ΔT

Target

2 次元 MEMSミラー

Detector Detctor

distance measuring

circuit

Lasre Emittor

Lasre Pulse Emission Controller

Emission Circuit

lens with adjustable

emission angle

reflection from the target

Seizing the posture of a person by measuring its key points location

Technology 3D Laser Sensor

Adjustable emission angle

Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications

27 Copyright 2017 FUJITSU

Technology Recognition of Posture and Techniques

Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo

Recognition results are utilized for evaluating the completeness of techniques

Copyright 2017 FUJITSU

Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

The Mechanism of Scoring Support System

Fitting the Skelton

Data Processing

Recognizing Elements

Scoring Support Application

Sensing the action

3D Laser Sensor

High-speed Data matching

Element Database

Storing Model data

Copyright 2017 FUJITSU

31 Copyright 2017 FUJITSU

The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics

Copyright 2017 FUJITSU

32 Copyright 2017 FUJITSU

Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration

Copyright 2017 FUJITSU

33 Copyright 2017 FUJITSU

技術説明

We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far

Copyright 2017 FUJITSU

34 Copyright 2017 FUJITSU

Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle

The Details of System Demonstration

Copyright 2017 FUJITSU

35 Copyright 2017 FUJITSU

Skill of technician or traditional dancer

Support for medical care handicapped people Sports

Fitness

Future Plans

36 Copyright 2017 FUJITSU

Robotics

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 24: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

23 Copyright 2017 FUJITSU

Why Fujitsu is Developing the Scoring Gymnastics

Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing

technologies and broaden its application

Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring

24 Copyright 2017 FUJITSU

Social Concern Scoring Gymnastics

example of marking in a scoring sheet

Difficulties with scoring gymnastics One must cope with the techniques

becoming more and more complicated every year Scoring rules are modified once in every

4 years

Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets

25 Copyright 2017 FUJITSU

Idea Scoring-support System

Present State Our Goal Manual Scoring

3D Laser sensor

Recognition Result of posture and techniques are displayed

technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg

Scoring with the support by ICT

Scoring is becoming more and more difficult with its techniques increasingly more complicated

The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges

26 Copyright 2017 FUJITSU

Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time

of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus

maintaining its ability to seize key point precisely regardless of the distance

distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)

Lasre emission (START)

Detection (STOP)

ΔT

Target

2 次元 MEMSミラー

Detector Detctor

distance measuring

circuit

Lasre Emittor

Lasre Pulse Emission Controller

Emission Circuit

lens with adjustable

emission angle

reflection from the target

Seizing the posture of a person by measuring its key points location

Technology 3D Laser Sensor

Adjustable emission angle

Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications

27 Copyright 2017 FUJITSU

Technology Recognition of Posture and Techniques

Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo

Recognition results are utilized for evaluating the completeness of techniques

Copyright 2017 FUJITSU

Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

The Mechanism of Scoring Support System

Fitting the Skelton

Data Processing

Recognizing Elements

Scoring Support Application

Sensing the action

3D Laser Sensor

High-speed Data matching

Element Database

Storing Model data

Copyright 2017 FUJITSU

31 Copyright 2017 FUJITSU

The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics

Copyright 2017 FUJITSU

32 Copyright 2017 FUJITSU

Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration

Copyright 2017 FUJITSU

33 Copyright 2017 FUJITSU

技術説明

We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far

Copyright 2017 FUJITSU

34 Copyright 2017 FUJITSU

Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle

The Details of System Demonstration

Copyright 2017 FUJITSU

35 Copyright 2017 FUJITSU

Skill of technician or traditional dancer

Support for medical care handicapped people Sports

Fitness

Future Plans

36 Copyright 2017 FUJITSU

Robotics

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 25: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

24 Copyright 2017 FUJITSU

Social Concern Scoring Gymnastics

example of marking in a scoring sheet

Difficulties with scoring gymnastics One must cope with the techniques

becoming more and more complicated every year Scoring rules are modified once in every

4 years

Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets

25 Copyright 2017 FUJITSU

Idea Scoring-support System

Present State Our Goal Manual Scoring

3D Laser sensor

Recognition Result of posture and techniques are displayed

technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg

Scoring with the support by ICT

Scoring is becoming more and more difficult with its techniques increasingly more complicated

The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges

26 Copyright 2017 FUJITSU

Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time

of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus

maintaining its ability to seize key point precisely regardless of the distance

distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)

Lasre emission (START)

Detection (STOP)

ΔT

Target

2 次元 MEMSミラー

Detector Detctor

distance measuring

circuit

Lasre Emittor

Lasre Pulse Emission Controller

Emission Circuit

lens with adjustable

emission angle

reflection from the target

Seizing the posture of a person by measuring its key points location

Technology 3D Laser Sensor

Adjustable emission angle

Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications

27 Copyright 2017 FUJITSU

Technology Recognition of Posture and Techniques

Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo

Recognition results are utilized for evaluating the completeness of techniques

Copyright 2017 FUJITSU

Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

The Mechanism of Scoring Support System

Fitting the Skelton

Data Processing

Recognizing Elements

Scoring Support Application

Sensing the action

3D Laser Sensor

High-speed Data matching

Element Database

Storing Model data

Copyright 2017 FUJITSU

31 Copyright 2017 FUJITSU

The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics

Copyright 2017 FUJITSU

32 Copyright 2017 FUJITSU

Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration

Copyright 2017 FUJITSU

33 Copyright 2017 FUJITSU

技術説明

We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far

Copyright 2017 FUJITSU

34 Copyright 2017 FUJITSU

Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle

The Details of System Demonstration

Copyright 2017 FUJITSU

35 Copyright 2017 FUJITSU

Skill of technician or traditional dancer

Support for medical care handicapped people Sports

Fitness

Future Plans

36 Copyright 2017 FUJITSU

Robotics

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 26: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

25 Copyright 2017 FUJITSU

Idea Scoring-support System

Present State Our Goal Manual Scoring

3D Laser sensor

Recognition Result of posture and techniques are displayed

technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg

Scoring with the support by ICT

Scoring is becoming more and more difficult with its techniques increasingly more complicated

The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges

26 Copyright 2017 FUJITSU

Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time

of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus

maintaining its ability to seize key point precisely regardless of the distance

distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)

Lasre emission (START)

Detection (STOP)

ΔT

Target

2 次元 MEMSミラー

Detector Detctor

distance measuring

circuit

Lasre Emittor

Lasre Pulse Emission Controller

Emission Circuit

lens with adjustable

emission angle

reflection from the target

Seizing the posture of a person by measuring its key points location

Technology 3D Laser Sensor

Adjustable emission angle

Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications

27 Copyright 2017 FUJITSU

Technology Recognition of Posture and Techniques

Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo

Recognition results are utilized for evaluating the completeness of techniques

Copyright 2017 FUJITSU

Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

The Mechanism of Scoring Support System

Fitting the Skelton

Data Processing

Recognizing Elements

Scoring Support Application

Sensing the action

3D Laser Sensor

High-speed Data matching

Element Database

Storing Model data

Copyright 2017 FUJITSU

31 Copyright 2017 FUJITSU

The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics

Copyright 2017 FUJITSU

32 Copyright 2017 FUJITSU

Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration

Copyright 2017 FUJITSU

33 Copyright 2017 FUJITSU

技術説明

We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far

Copyright 2017 FUJITSU

34 Copyright 2017 FUJITSU

Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle

The Details of System Demonstration

Copyright 2017 FUJITSU

35 Copyright 2017 FUJITSU

Skill of technician or traditional dancer

Support for medical care handicapped people Sports

Fitness

Future Plans

36 Copyright 2017 FUJITSU

Robotics

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 27: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

26 Copyright 2017 FUJITSU

Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time

of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus

maintaining its ability to seize key point precisely regardless of the distance

distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)

Lasre emission (START)

Detection (STOP)

ΔT

Target

2 次元 MEMSミラー

Detector Detctor

distance measuring

circuit

Lasre Emittor

Lasre Pulse Emission Controller

Emission Circuit

lens with adjustable

emission angle

reflection from the target

Seizing the posture of a person by measuring its key points location

Technology 3D Laser Sensor

Adjustable emission angle

Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications

27 Copyright 2017 FUJITSU

Technology Recognition of Posture and Techniques

Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo

Recognition results are utilized for evaluating the completeness of techniques

Copyright 2017 FUJITSU

Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

The Mechanism of Scoring Support System

Fitting the Skelton

Data Processing

Recognizing Elements

Scoring Support Application

Sensing the action

3D Laser Sensor

High-speed Data matching

Element Database

Storing Model data

Copyright 2017 FUJITSU

31 Copyright 2017 FUJITSU

The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics

Copyright 2017 FUJITSU

32 Copyright 2017 FUJITSU

Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration

Copyright 2017 FUJITSU

33 Copyright 2017 FUJITSU

技術説明

We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far

Copyright 2017 FUJITSU

34 Copyright 2017 FUJITSU

Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle

The Details of System Demonstration

Copyright 2017 FUJITSU

35 Copyright 2017 FUJITSU

Skill of technician or traditional dancer

Support for medical care handicapped people Sports

Fitness

Future Plans

36 Copyright 2017 FUJITSU

Robotics

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 28: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

27 Copyright 2017 FUJITSU

Technology Recognition of Posture and Techniques

Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo

Recognition results are utilized for evaluating the completeness of techniques

Copyright 2017 FUJITSU

Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

The Mechanism of Scoring Support System

Fitting the Skelton

Data Processing

Recognizing Elements

Scoring Support Application

Sensing the action

3D Laser Sensor

High-speed Data matching

Element Database

Storing Model data

Copyright 2017 FUJITSU

31 Copyright 2017 FUJITSU

The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics

Copyright 2017 FUJITSU

32 Copyright 2017 FUJITSU

Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration

Copyright 2017 FUJITSU

33 Copyright 2017 FUJITSU

技術説明

We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far

Copyright 2017 FUJITSU

34 Copyright 2017 FUJITSU

Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle

The Details of System Demonstration

Copyright 2017 FUJITSU

35 Copyright 2017 FUJITSU

Skill of technician or traditional dancer

Support for medical care handicapped people Sports

Fitness

Future Plans

36 Copyright 2017 FUJITSU

Robotics

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 29: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

Copyright 2017 FUJITSU

Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

The Mechanism of Scoring Support System

Fitting the Skelton

Data Processing

Recognizing Elements

Scoring Support Application

Sensing the action

3D Laser Sensor

High-speed Data matching

Element Database

Storing Model data

Copyright 2017 FUJITSU

31 Copyright 2017 FUJITSU

The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics

Copyright 2017 FUJITSU

32 Copyright 2017 FUJITSU

Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration

Copyright 2017 FUJITSU

33 Copyright 2017 FUJITSU

技術説明

We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far

Copyright 2017 FUJITSU

34 Copyright 2017 FUJITSU

Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle

The Details of System Demonstration

Copyright 2017 FUJITSU

35 Copyright 2017 FUJITSU

Skill of technician or traditional dancer

Support for medical care handicapped people Sports

Fitness

Future Plans

36 Copyright 2017 FUJITSU

Robotics

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 30: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

Copyright 2017 FUJITSU

3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it

Copyright 2017 FUJITSU

Copyright 2017 FUJITSU

The Mechanism of Scoring Support System

Fitting the Skelton

Data Processing

Recognizing Elements

Scoring Support Application

Sensing the action

3D Laser Sensor

High-speed Data matching

Element Database

Storing Model data

Copyright 2017 FUJITSU

31 Copyright 2017 FUJITSU

The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics

Copyright 2017 FUJITSU

32 Copyright 2017 FUJITSU

Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration

Copyright 2017 FUJITSU

33 Copyright 2017 FUJITSU

技術説明

We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far

Copyright 2017 FUJITSU

34 Copyright 2017 FUJITSU

Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle

The Details of System Demonstration

Copyright 2017 FUJITSU

35 Copyright 2017 FUJITSU

Skill of technician or traditional dancer

Support for medical care handicapped people Sports

Fitness

Future Plans

36 Copyright 2017 FUJITSU

Robotics

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 31: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

Copyright 2017 FUJITSU

The Mechanism of Scoring Support System

Fitting the Skelton

Data Processing

Recognizing Elements

Scoring Support Application

Sensing the action

3D Laser Sensor

High-speed Data matching

Element Database

Storing Model data

Copyright 2017 FUJITSU

31 Copyright 2017 FUJITSU

The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics

Copyright 2017 FUJITSU

32 Copyright 2017 FUJITSU

Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration

Copyright 2017 FUJITSU

33 Copyright 2017 FUJITSU

技術説明

We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far

Copyright 2017 FUJITSU

34 Copyright 2017 FUJITSU

Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle

The Details of System Demonstration

Copyright 2017 FUJITSU

35 Copyright 2017 FUJITSU

Skill of technician or traditional dancer

Support for medical care handicapped people Sports

Fitness

Future Plans

36 Copyright 2017 FUJITSU

Robotics

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 32: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

31 Copyright 2017 FUJITSU

The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics

Copyright 2017 FUJITSU

32 Copyright 2017 FUJITSU

Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration

Copyright 2017 FUJITSU

33 Copyright 2017 FUJITSU

技術説明

We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far

Copyright 2017 FUJITSU

34 Copyright 2017 FUJITSU

Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle

The Details of System Demonstration

Copyright 2017 FUJITSU

35 Copyright 2017 FUJITSU

Skill of technician or traditional dancer

Support for medical care handicapped people Sports

Fitness

Future Plans

36 Copyright 2017 FUJITSU

Robotics

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 33: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

32 Copyright 2017 FUJITSU

Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration

Copyright 2017 FUJITSU

33 Copyright 2017 FUJITSU

技術説明

We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far

Copyright 2017 FUJITSU

34 Copyright 2017 FUJITSU

Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle

The Details of System Demonstration

Copyright 2017 FUJITSU

35 Copyright 2017 FUJITSU

Skill of technician or traditional dancer

Support for medical care handicapped people Sports

Fitness

Future Plans

36 Copyright 2017 FUJITSU

Robotics

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 34: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

33 Copyright 2017 FUJITSU

技術説明

We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far

Copyright 2017 FUJITSU

34 Copyright 2017 FUJITSU

Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle

The Details of System Demonstration

Copyright 2017 FUJITSU

35 Copyright 2017 FUJITSU

Skill of technician or traditional dancer

Support for medical care handicapped people Sports

Fitness

Future Plans

36 Copyright 2017 FUJITSU

Robotics

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 35: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

34 Copyright 2017 FUJITSU

Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle

The Details of System Demonstration

Copyright 2017 FUJITSU

35 Copyright 2017 FUJITSU

Skill of technician or traditional dancer

Support for medical care handicapped people Sports

Fitness

Future Plans

36 Copyright 2017 FUJITSU

Robotics

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 36: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

35 Copyright 2017 FUJITSU

Skill of technician or traditional dancer

Support for medical care handicapped people Sports

Fitness

Future Plans

36 Copyright 2017 FUJITSU

Robotics

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 37: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

36 Copyright 2017 FUJITSU

Robotics

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 38: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

37 Copyright 2017 FUJITSU

What is a Robot Why We need Robots

Artificial intelligence is indispensable Autonomous action

Sensinginteraction with external worldpeople

Intelligent understanding simple instruction human intension

Values Efficient

Attractive

Connecting human and ICT

Environment

Action Sensing

Recognition Self-judgment AI

A machine that can move around a certain area for sensing some data and make a decision by processing it and do

some task in a given environment

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 39: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

38 Copyright 2017 FUJITSU

History of Robotics Research of FJ Lab 1980 -

Advanced Robot for the nuclear power

plant maintenance

Space Robot

1990 - 2000 -

Robot for Carrying Food Tray for Aged and

Disabled(lsquo98)

HOAP Miniature humanoid

Touch Ojisan Robot(99)

Space recognition technology (Autonomous movement)

MARON-1 Autonomous movement

by map matching and remote control from mobile phone

- 2020

Service Robot enon Autonomous locomotion

using 2D-SLAM

FA Robot

Kuma(bear) Biologicalfriendly interaction

Drone for Infrastructure check

using 3D-SLAM

Human-Robot interaction technology

Next-generation mobility service

Next-generation personal service

New services by networked robots Standalone typeRemote control type robot

Map linkage +

Parking lot control

Automated driving+

Automated parking

今からハワイへ

Zinrai (Interaction system)

Irsquom going to Hawaii from now

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 40: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

39 Copyright 2017 FUJITSU

Concept Mediator Robotics Service

Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 41: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

40 Copyright 2017 FUJITSU

RoboPinrsquos features Expressive movements that convey emotion

RoboPin expresses itself using its whole body mapping 222 movements to an emotion space

Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice

SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice

222 richly expressive movements mapped to an emotion space

Sleepiness

Wakefulness

Happiness

Emotion space Unhappiness

Expresses feelings with voice synthesis that can control the tone

of its variegated voice

Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip

Robotics Platform

Middleware (Soft)

API (Convert)

Application

SDK

Variegated Voice

Prototype ldquoRoboPinrdquo

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 42: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

41 Copyright 2017 FUJITSU

RoboPin Functions

Touch Sensor

Camera

Face LED

Right Arm Rotation 1 Motor

Body Movement 2 Motors

Finger LED

Head Movement 2 Motors

Left Arm Rotation 1 Motor

Touch Sensor

Human Detect Sensor

Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm

Speaker

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 43: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

42 Copyright 2017 FUJITSU

Practice Business Front Service

Anticipated Customers and Services Reception desk at a company service counter at public institution

over-the-counter-services at financial business etc

Efficiency and familiarity improvement

Personal services in sales tourism etc

Attracting customers giving information distributing questionnaires

Education in school personal lesson correspondence course

One-on-one teaching group study support

Private company Reception desk + Meeting room

Please come this way D E

A B C

Welcome to our company Mr A

Meeting room

Financial institutionrsquos counter Reception desk + Work with a teller

Confirms reservation ご用件 お名前

Tellerrsquos counter

Ms B has come

Teller

Welcome to our bank Ms B

Lobby

「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services

the reception desk at companies public institutions bank etc

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 44: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

43 Copyright 2017 FUJITSU

Summary

New business creation initiatives were introduced

If you are interested in todayrsquos topic business

technologies and so on please feel free to contact me

Ship Human

suzukishojijpfujitsucom

44 Copyright 2017 FUJITSU

Page 45: Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its emission rang based on the measured distance from the target, thus maintaining

44 Copyright 2017 FUJITSU