Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its...
Transcript of Fujitsu World Tour 2017 shaping tomorrow with you Suzuki.pdf · 2017-04-06 · System can adapt its...
0 Copyright 2017 FUJITSU
Intel Insidereg Powerful Productivity Outside
shaping tomorrow with you
Fujitsu World Tour 2017 Fujitsu North America Technology Forum 2017
1 Copyright 2017 FUJITSU
Applied Innovation Research - New Businesses Creation Initiatives
Shoji Suzuki Board member
Head of Applied Innovation Research Center
FUJITSU LABORATORIES LTD
2 Copyright 2017 FUJITSU
Agenda
What is Applied Innovation Research
3 Topics
Mobility
Sports
Robotics
3 Copyright 2017 FUJITSU
What is Applied Innovation Research
4 Copyright 2017 FUJITSU
Applied Innovation Research Overview
Objective To create new businesses by matching our cutting-edge technologies with social trends and market opportunities
Process To achieve rapid commercialization of the target technology in collaboration with our customers who provide valuable ldquoreal worldrdquo feedback on use cases
Social Concern
Idea
Technologies
Business Model
Practice with Customers
Business Start
Prototype
BUStartup
Marketing
Hypotheses
5 Copyright 2017 FUJITSU
Example Manhole Sensor
Manhole
Water level sensor
Sewer pipe
6 Copyright 2017 FUJITSU
Social Concern
gt50 mmh Source JMA HP
Freq
uen
cy o
f h
eavy
rai
n
(Aug 2008 Aichi)
(Oct 2015 South Carolina)
Example of flood damage
Localized torrential rain increases every year and the urban area flood damage also increases
Year
7 Copyright 2017 FUJITSU
Idea
Real time monitoring of the water level in sewer pipe with the sensor installed on the bottom of a manhole iron cover
Sensor Node
Water Flow
Gateway
Water-treatment Plant
Manhole
Visualization
Data Flow
Cloud
Data of water level in sewer pipe Wireless
Transmission
Analysis and notification of flood zone Decision of renewal program of drainage
Operator
8 Copyright 2017 FUJITSU
Technologies
Energy harvesting battery (Thermoelectric generator) Detecting symptom of drainage flood (Time-series data analysis)
Sensor Node
Water Flow
Gateway
Water-treatment Plant
Manhole
Visualization
Data Flow
Cloud
Data of water level in sewer pipe Wireless
Transmission
Analysis and notification of flood zone Decision of renewal program of drainage
Operator
Detecting Symptom of drainage flood
Energy Harvesting
9 Copyright 2017 FUJITSU
Business
System Integration (Hardware Software Installation etc) Services Maintenance Consulting and so on
Sensor Node
Water Flow
Water-treatment Plant
Manhole
Visualization
Data Flow
Cloud
Data of water level in sewer pipe Wireless
Transmission
Consulting Analysis and notification of flood zone Decision of renewal program of drainage
Operator
Manhole With sensor
Gateway
Installation
Service
Maintenance
Consulting
10 Copyright 2017 FUJITSU
Practice with Customer (Koriyama City)
Fukushima Prefecture
Koriyama City
Tokyo
Located about 200 km north of Tokyo Famous for beautiful sites 15 flood events (from 1986 to 2013)
Press release (Feb 2015)
11 Copyright 2017 FUJITSU
Practice with Customer (Koriyama City)
Gateway Box
Grating with water-level sensor
Sensor locations
Ochiaibori Storm Drain
① ②
③
Koriyama City Hall
Furukawa pumping station
Koriyama station
③
Succeeded in the real-time water-level measurement of the sewer pipe at heavy rain Detected a rapid water-level rise of 22 m (91 of full level) in only 20 min
Rainfall
Water-level
Water-level
Water-level
The water-level increased toward the downstream
The maximum rainfall intensity 78 mmh
The maximum rainfall intensity 48 mmh
Midstream
Downstream
Upstream
The maximum rainfall intensity 51 mmh
Full level of the pipe
Full level of the pipe
Full level of the pipe (5 m)
The lag time in upstream -downstream was about 15 minutes
After the rainfall the water-level was
the maximum in 15-30 minutes later
Wat
er-l
evel
(m
)
Rai
nfa
ll (m
mh
) 雨量
(m
mh
)
Wat
er-l
evel
(m
) W
ater
-lev
el (
m)
Rainfall
Rainfall
Rai
nfa
ll (m
mh
) R
ain
fall
(mm
h)
Time
Time
Time
①
②
③
12 Copyright 2017 FUJITSU
Business Start
Fujitsu BU decided to start business
Press release (Aug 2016)
13 Copyright 2017 FUJITSU
Mobility
14 Copyright 2017 FUJITSU
Social Concern and Future Mobility
Self-driving cars
Shared cars
Emerging transport System Ride sharing Car sharing
Self-driving Cars
Ship Performance Estimation
Dynamic Mobility Management
MaaS PF
M-IoT PF
Congestion Management
Customized Transportation
Measured rate Flat rate
Mobility service
Train Ship Aircraft Human
Concern(problems) Traffic jam Congestion Long waiting time Energy efficiency
Idea
15 Copyright 2017 FUJITSU
Practice Singapore CoE (Centre of Excellence)
Collaborative research center (5 years since Oct 2014) Fujitsu Limited Agency for Science Technology and Research (ASTAR) Singapore Management University (SMU)
Objective Develop solutions that address urban challenges for sustainable urbanization
Projects
Dynamic Mobility Management
Maritime and Port Optimization
Large-scale Data Processing
Urban Computing Platform
16 Copyright 2017 FUJITSU
Congestion Relief Challenges in Singapore
17 Copyright 2017 FUJITSU
The world first attempt to alleviate congestion by inducing peoples behavior change with AI technology
Technology Dynamic Mobility Management
SPATIOWL
Retail data
Event data
Data collection (congestion situation etc)
Activity recommendation (via smartphone)
Location data
Transport data
BUS
TRAIN
What should I do before leaving AI
Distribute people into different time slots transport mode
Transport Hub Large-scale Facility
I want to avoid congestionhellip When should I leave Which transport mode should I take
TAXI
How about dropping by your favorite shop before leaving (you can get coupon )
Why donrsquot you take a uncongested train leaving 1 hour later
Dining
Dining incentive
Shopping incentive
18 Copyright 2017 FUJITSU
Scale model Simplified material
and structure Limited conditions
on wind wave etc No ocean current
Social Concern in Ship Design and Operation
Design performance (in tank)
Full scale Actual material
and structure Effects of
wind wave current etc
Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO
Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea
Increasing needs for more energy-efficient ship design and operation
Gap between
performances Actual and wide-ranged conditions
Artificial and limited experiments
Actual performance(at sea)
19 Copyright 2017 FUJITSU
Idea Routing System Configuration and Operation
Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes
If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves
Operational data
Weather prediction
Weather prediction
Recommended route
20 Copyright 2017 FUJITSU
Technology Accurate Ship Performance Estimation
Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models
Ship performances are visualized in various conditions and estimated for planned routes
Performance visualization
in various conditions
cargo weight
wind direction
wave direction
wave height
wind speed
Ship
p
erfo
rma
nce
current speed current
direction
aging
ship design H
igh
-dim
ensi
on
al
sta
tist
ica
l a
na
lysi
s
hellip
Performance estimation
on any planed routes
Calm condition
Current
Beam sea
Head sea
Head wind
Beam wind
21 Copyright 2017 FUJITSU
Practice Weather Routing Simulation
With the accurate ship performance optimal route reducing fuel consumption is calculated
by a weather routing simulation
Gathered operational data from Japanese maritime
shipping companies
Ship performance is estimated through actual ship operational data
22 Copyright 2017 FUJITSU
Sports
23 Copyright 2017 FUJITSU
Why Fujitsu is Developing the Scoring Gymnastics
Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing
technologies and broaden its application
Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring
24 Copyright 2017 FUJITSU
Social Concern Scoring Gymnastics
example of marking in a scoring sheet
Difficulties with scoring gymnastics One must cope with the techniques
becoming more and more complicated every year Scoring rules are modified once in every
4 years
Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets
25 Copyright 2017 FUJITSU
Idea Scoring-support System
Present State Our Goal Manual Scoring
3D Laser sensor
Recognition Result of posture and techniques are displayed
technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg
Scoring with the support by ICT
Scoring is becoming more and more difficult with its techniques increasingly more complicated
The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges
26 Copyright 2017 FUJITSU
Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time
of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus
maintaining its ability to seize key point precisely regardless of the distance
distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)
Lasre emission (START)
Detection (STOP)
ΔT
T
Target
2 次元 MEMSミラー
Detector Detctor
distance measuring
circuit
Lasre Emittor
Lasre Pulse Emission Controller
Emission Circuit
lens with adjustable
emission angle
reflection from the target
Seizing the posture of a person by measuring its key points location
Technology 3D Laser Sensor
Adjustable emission angle
Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications
27 Copyright 2017 FUJITSU
Technology Recognition of Posture and Techniques
Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo
Recognition results are utilized for evaluating the completeness of techniques
Copyright 2017 FUJITSU
Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
The Mechanism of Scoring Support System
Fitting the Skelton
Data Processing
Recognizing Elements
Scoring Support Application
Sensing the action
3D Laser Sensor
High-speed Data matching
Element Database
Storing Model data
Copyright 2017 FUJITSU
31 Copyright 2017 FUJITSU
The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics
Copyright 2017 FUJITSU
32 Copyright 2017 FUJITSU
Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration
Copyright 2017 FUJITSU
33 Copyright 2017 FUJITSU
技術説明
We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far
Copyright 2017 FUJITSU
34 Copyright 2017 FUJITSU
Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle
The Details of System Demonstration
Copyright 2017 FUJITSU
35 Copyright 2017 FUJITSU
Skill of technician or traditional dancer
Support for medical care handicapped people Sports
Fitness
Future Plans
36 Copyright 2017 FUJITSU
Robotics
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
1 Copyright 2017 FUJITSU
Applied Innovation Research - New Businesses Creation Initiatives
Shoji Suzuki Board member
Head of Applied Innovation Research Center
FUJITSU LABORATORIES LTD
2 Copyright 2017 FUJITSU
Agenda
What is Applied Innovation Research
3 Topics
Mobility
Sports
Robotics
3 Copyright 2017 FUJITSU
What is Applied Innovation Research
4 Copyright 2017 FUJITSU
Applied Innovation Research Overview
Objective To create new businesses by matching our cutting-edge technologies with social trends and market opportunities
Process To achieve rapid commercialization of the target technology in collaboration with our customers who provide valuable ldquoreal worldrdquo feedback on use cases
Social Concern
Idea
Technologies
Business Model
Practice with Customers
Business Start
Prototype
BUStartup
Marketing
Hypotheses
5 Copyright 2017 FUJITSU
Example Manhole Sensor
Manhole
Water level sensor
Sewer pipe
6 Copyright 2017 FUJITSU
Social Concern
gt50 mmh Source JMA HP
Freq
uen
cy o
f h
eavy
rai
n
(Aug 2008 Aichi)
(Oct 2015 South Carolina)
Example of flood damage
Localized torrential rain increases every year and the urban area flood damage also increases
Year
7 Copyright 2017 FUJITSU
Idea
Real time monitoring of the water level in sewer pipe with the sensor installed on the bottom of a manhole iron cover
Sensor Node
Water Flow
Gateway
Water-treatment Plant
Manhole
Visualization
Data Flow
Cloud
Data of water level in sewer pipe Wireless
Transmission
Analysis and notification of flood zone Decision of renewal program of drainage
Operator
8 Copyright 2017 FUJITSU
Technologies
Energy harvesting battery (Thermoelectric generator) Detecting symptom of drainage flood (Time-series data analysis)
Sensor Node
Water Flow
Gateway
Water-treatment Plant
Manhole
Visualization
Data Flow
Cloud
Data of water level in sewer pipe Wireless
Transmission
Analysis and notification of flood zone Decision of renewal program of drainage
Operator
Detecting Symptom of drainage flood
Energy Harvesting
9 Copyright 2017 FUJITSU
Business
System Integration (Hardware Software Installation etc) Services Maintenance Consulting and so on
Sensor Node
Water Flow
Water-treatment Plant
Manhole
Visualization
Data Flow
Cloud
Data of water level in sewer pipe Wireless
Transmission
Consulting Analysis and notification of flood zone Decision of renewal program of drainage
Operator
Manhole With sensor
Gateway
Installation
Service
Maintenance
Consulting
10 Copyright 2017 FUJITSU
Practice with Customer (Koriyama City)
Fukushima Prefecture
Koriyama City
Tokyo
Located about 200 km north of Tokyo Famous for beautiful sites 15 flood events (from 1986 to 2013)
Press release (Feb 2015)
11 Copyright 2017 FUJITSU
Practice with Customer (Koriyama City)
Gateway Box
Grating with water-level sensor
Sensor locations
Ochiaibori Storm Drain
① ②
③
Koriyama City Hall
Furukawa pumping station
Koriyama station
③
Succeeded in the real-time water-level measurement of the sewer pipe at heavy rain Detected a rapid water-level rise of 22 m (91 of full level) in only 20 min
Rainfall
Water-level
Water-level
Water-level
The water-level increased toward the downstream
The maximum rainfall intensity 78 mmh
The maximum rainfall intensity 48 mmh
Midstream
Downstream
Upstream
The maximum rainfall intensity 51 mmh
Full level of the pipe
Full level of the pipe
Full level of the pipe (5 m)
The lag time in upstream -downstream was about 15 minutes
After the rainfall the water-level was
the maximum in 15-30 minutes later
Wat
er-l
evel
(m
)
Rai
nfa
ll (m
mh
) 雨量
(m
mh
)
Wat
er-l
evel
(m
) W
ater
-lev
el (
m)
Rainfall
Rainfall
Rai
nfa
ll (m
mh
) R
ain
fall
(mm
h)
Time
Time
Time
①
②
③
12 Copyright 2017 FUJITSU
Business Start
Fujitsu BU decided to start business
Press release (Aug 2016)
13 Copyright 2017 FUJITSU
Mobility
14 Copyright 2017 FUJITSU
Social Concern and Future Mobility
Self-driving cars
Shared cars
Emerging transport System Ride sharing Car sharing
Self-driving Cars
Ship Performance Estimation
Dynamic Mobility Management
MaaS PF
M-IoT PF
Congestion Management
Customized Transportation
Measured rate Flat rate
Mobility service
Train Ship Aircraft Human
Concern(problems) Traffic jam Congestion Long waiting time Energy efficiency
Idea
15 Copyright 2017 FUJITSU
Practice Singapore CoE (Centre of Excellence)
Collaborative research center (5 years since Oct 2014) Fujitsu Limited Agency for Science Technology and Research (ASTAR) Singapore Management University (SMU)
Objective Develop solutions that address urban challenges for sustainable urbanization
Projects
Dynamic Mobility Management
Maritime and Port Optimization
Large-scale Data Processing
Urban Computing Platform
16 Copyright 2017 FUJITSU
Congestion Relief Challenges in Singapore
17 Copyright 2017 FUJITSU
The world first attempt to alleviate congestion by inducing peoples behavior change with AI technology
Technology Dynamic Mobility Management
SPATIOWL
Retail data
Event data
Data collection (congestion situation etc)
Activity recommendation (via smartphone)
Location data
Transport data
BUS
TRAIN
What should I do before leaving AI
Distribute people into different time slots transport mode
Transport Hub Large-scale Facility
I want to avoid congestionhellip When should I leave Which transport mode should I take
TAXI
How about dropping by your favorite shop before leaving (you can get coupon )
Why donrsquot you take a uncongested train leaving 1 hour later
Dining
Dining incentive
Shopping incentive
18 Copyright 2017 FUJITSU
Scale model Simplified material
and structure Limited conditions
on wind wave etc No ocean current
Social Concern in Ship Design and Operation
Design performance (in tank)
Full scale Actual material
and structure Effects of
wind wave current etc
Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO
Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea
Increasing needs for more energy-efficient ship design and operation
Gap between
performances Actual and wide-ranged conditions
Artificial and limited experiments
Actual performance(at sea)
19 Copyright 2017 FUJITSU
Idea Routing System Configuration and Operation
Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes
If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves
Operational data
Weather prediction
Weather prediction
Recommended route
20 Copyright 2017 FUJITSU
Technology Accurate Ship Performance Estimation
Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models
Ship performances are visualized in various conditions and estimated for planned routes
Performance visualization
in various conditions
cargo weight
wind direction
wave direction
wave height
wind speed
Ship
p
erfo
rma
nce
current speed current
direction
aging
ship design H
igh
-dim
ensi
on
al
sta
tist
ica
l a
na
lysi
s
hellip
Performance estimation
on any planed routes
Calm condition
Current
Beam sea
Head sea
Head wind
Beam wind
21 Copyright 2017 FUJITSU
Practice Weather Routing Simulation
With the accurate ship performance optimal route reducing fuel consumption is calculated
by a weather routing simulation
Gathered operational data from Japanese maritime
shipping companies
Ship performance is estimated through actual ship operational data
22 Copyright 2017 FUJITSU
Sports
23 Copyright 2017 FUJITSU
Why Fujitsu is Developing the Scoring Gymnastics
Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing
technologies and broaden its application
Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring
24 Copyright 2017 FUJITSU
Social Concern Scoring Gymnastics
example of marking in a scoring sheet
Difficulties with scoring gymnastics One must cope with the techniques
becoming more and more complicated every year Scoring rules are modified once in every
4 years
Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets
25 Copyright 2017 FUJITSU
Idea Scoring-support System
Present State Our Goal Manual Scoring
3D Laser sensor
Recognition Result of posture and techniques are displayed
technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg
Scoring with the support by ICT
Scoring is becoming more and more difficult with its techniques increasingly more complicated
The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges
26 Copyright 2017 FUJITSU
Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time
of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus
maintaining its ability to seize key point precisely regardless of the distance
distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)
Lasre emission (START)
Detection (STOP)
ΔT
T
Target
2 次元 MEMSミラー
Detector Detctor
distance measuring
circuit
Lasre Emittor
Lasre Pulse Emission Controller
Emission Circuit
lens with adjustable
emission angle
reflection from the target
Seizing the posture of a person by measuring its key points location
Technology 3D Laser Sensor
Adjustable emission angle
Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications
27 Copyright 2017 FUJITSU
Technology Recognition of Posture and Techniques
Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo
Recognition results are utilized for evaluating the completeness of techniques
Copyright 2017 FUJITSU
Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
The Mechanism of Scoring Support System
Fitting the Skelton
Data Processing
Recognizing Elements
Scoring Support Application
Sensing the action
3D Laser Sensor
High-speed Data matching
Element Database
Storing Model data
Copyright 2017 FUJITSU
31 Copyright 2017 FUJITSU
The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics
Copyright 2017 FUJITSU
32 Copyright 2017 FUJITSU
Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration
Copyright 2017 FUJITSU
33 Copyright 2017 FUJITSU
技術説明
We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far
Copyright 2017 FUJITSU
34 Copyright 2017 FUJITSU
Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle
The Details of System Demonstration
Copyright 2017 FUJITSU
35 Copyright 2017 FUJITSU
Skill of technician or traditional dancer
Support for medical care handicapped people Sports
Fitness
Future Plans
36 Copyright 2017 FUJITSU
Robotics
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
2 Copyright 2017 FUJITSU
Agenda
What is Applied Innovation Research
3 Topics
Mobility
Sports
Robotics
3 Copyright 2017 FUJITSU
What is Applied Innovation Research
4 Copyright 2017 FUJITSU
Applied Innovation Research Overview
Objective To create new businesses by matching our cutting-edge technologies with social trends and market opportunities
Process To achieve rapid commercialization of the target technology in collaboration with our customers who provide valuable ldquoreal worldrdquo feedback on use cases
Social Concern
Idea
Technologies
Business Model
Practice with Customers
Business Start
Prototype
BUStartup
Marketing
Hypotheses
5 Copyright 2017 FUJITSU
Example Manhole Sensor
Manhole
Water level sensor
Sewer pipe
6 Copyright 2017 FUJITSU
Social Concern
gt50 mmh Source JMA HP
Freq
uen
cy o
f h
eavy
rai
n
(Aug 2008 Aichi)
(Oct 2015 South Carolina)
Example of flood damage
Localized torrential rain increases every year and the urban area flood damage also increases
Year
7 Copyright 2017 FUJITSU
Idea
Real time monitoring of the water level in sewer pipe with the sensor installed on the bottom of a manhole iron cover
Sensor Node
Water Flow
Gateway
Water-treatment Plant
Manhole
Visualization
Data Flow
Cloud
Data of water level in sewer pipe Wireless
Transmission
Analysis and notification of flood zone Decision of renewal program of drainage
Operator
8 Copyright 2017 FUJITSU
Technologies
Energy harvesting battery (Thermoelectric generator) Detecting symptom of drainage flood (Time-series data analysis)
Sensor Node
Water Flow
Gateway
Water-treatment Plant
Manhole
Visualization
Data Flow
Cloud
Data of water level in sewer pipe Wireless
Transmission
Analysis and notification of flood zone Decision of renewal program of drainage
Operator
Detecting Symptom of drainage flood
Energy Harvesting
9 Copyright 2017 FUJITSU
Business
System Integration (Hardware Software Installation etc) Services Maintenance Consulting and so on
Sensor Node
Water Flow
Water-treatment Plant
Manhole
Visualization
Data Flow
Cloud
Data of water level in sewer pipe Wireless
Transmission
Consulting Analysis and notification of flood zone Decision of renewal program of drainage
Operator
Manhole With sensor
Gateway
Installation
Service
Maintenance
Consulting
10 Copyright 2017 FUJITSU
Practice with Customer (Koriyama City)
Fukushima Prefecture
Koriyama City
Tokyo
Located about 200 km north of Tokyo Famous for beautiful sites 15 flood events (from 1986 to 2013)
Press release (Feb 2015)
11 Copyright 2017 FUJITSU
Practice with Customer (Koriyama City)
Gateway Box
Grating with water-level sensor
Sensor locations
Ochiaibori Storm Drain
① ②
③
Koriyama City Hall
Furukawa pumping station
Koriyama station
③
Succeeded in the real-time water-level measurement of the sewer pipe at heavy rain Detected a rapid water-level rise of 22 m (91 of full level) in only 20 min
Rainfall
Water-level
Water-level
Water-level
The water-level increased toward the downstream
The maximum rainfall intensity 78 mmh
The maximum rainfall intensity 48 mmh
Midstream
Downstream
Upstream
The maximum rainfall intensity 51 mmh
Full level of the pipe
Full level of the pipe
Full level of the pipe (5 m)
The lag time in upstream -downstream was about 15 minutes
After the rainfall the water-level was
the maximum in 15-30 minutes later
Wat
er-l
evel
(m
)
Rai
nfa
ll (m
mh
) 雨量
(m
mh
)
Wat
er-l
evel
(m
) W
ater
-lev
el (
m)
Rainfall
Rainfall
Rai
nfa
ll (m
mh
) R
ain
fall
(mm
h)
Time
Time
Time
①
②
③
12 Copyright 2017 FUJITSU
Business Start
Fujitsu BU decided to start business
Press release (Aug 2016)
13 Copyright 2017 FUJITSU
Mobility
14 Copyright 2017 FUJITSU
Social Concern and Future Mobility
Self-driving cars
Shared cars
Emerging transport System Ride sharing Car sharing
Self-driving Cars
Ship Performance Estimation
Dynamic Mobility Management
MaaS PF
M-IoT PF
Congestion Management
Customized Transportation
Measured rate Flat rate
Mobility service
Train Ship Aircraft Human
Concern(problems) Traffic jam Congestion Long waiting time Energy efficiency
Idea
15 Copyright 2017 FUJITSU
Practice Singapore CoE (Centre of Excellence)
Collaborative research center (5 years since Oct 2014) Fujitsu Limited Agency for Science Technology and Research (ASTAR) Singapore Management University (SMU)
Objective Develop solutions that address urban challenges for sustainable urbanization
Projects
Dynamic Mobility Management
Maritime and Port Optimization
Large-scale Data Processing
Urban Computing Platform
16 Copyright 2017 FUJITSU
Congestion Relief Challenges in Singapore
17 Copyright 2017 FUJITSU
The world first attempt to alleviate congestion by inducing peoples behavior change with AI technology
Technology Dynamic Mobility Management
SPATIOWL
Retail data
Event data
Data collection (congestion situation etc)
Activity recommendation (via smartphone)
Location data
Transport data
BUS
TRAIN
What should I do before leaving AI
Distribute people into different time slots transport mode
Transport Hub Large-scale Facility
I want to avoid congestionhellip When should I leave Which transport mode should I take
TAXI
How about dropping by your favorite shop before leaving (you can get coupon )
Why donrsquot you take a uncongested train leaving 1 hour later
Dining
Dining incentive
Shopping incentive
18 Copyright 2017 FUJITSU
Scale model Simplified material
and structure Limited conditions
on wind wave etc No ocean current
Social Concern in Ship Design and Operation
Design performance (in tank)
Full scale Actual material
and structure Effects of
wind wave current etc
Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO
Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea
Increasing needs for more energy-efficient ship design and operation
Gap between
performances Actual and wide-ranged conditions
Artificial and limited experiments
Actual performance(at sea)
19 Copyright 2017 FUJITSU
Idea Routing System Configuration and Operation
Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes
If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves
Operational data
Weather prediction
Weather prediction
Recommended route
20 Copyright 2017 FUJITSU
Technology Accurate Ship Performance Estimation
Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models
Ship performances are visualized in various conditions and estimated for planned routes
Performance visualization
in various conditions
cargo weight
wind direction
wave direction
wave height
wind speed
Ship
p
erfo
rma
nce
current speed current
direction
aging
ship design H
igh
-dim
ensi
on
al
sta
tist
ica
l a
na
lysi
s
hellip
Performance estimation
on any planed routes
Calm condition
Current
Beam sea
Head sea
Head wind
Beam wind
21 Copyright 2017 FUJITSU
Practice Weather Routing Simulation
With the accurate ship performance optimal route reducing fuel consumption is calculated
by a weather routing simulation
Gathered operational data from Japanese maritime
shipping companies
Ship performance is estimated through actual ship operational data
22 Copyright 2017 FUJITSU
Sports
23 Copyright 2017 FUJITSU
Why Fujitsu is Developing the Scoring Gymnastics
Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing
technologies and broaden its application
Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring
24 Copyright 2017 FUJITSU
Social Concern Scoring Gymnastics
example of marking in a scoring sheet
Difficulties with scoring gymnastics One must cope with the techniques
becoming more and more complicated every year Scoring rules are modified once in every
4 years
Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets
25 Copyright 2017 FUJITSU
Idea Scoring-support System
Present State Our Goal Manual Scoring
3D Laser sensor
Recognition Result of posture and techniques are displayed
technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg
Scoring with the support by ICT
Scoring is becoming more and more difficult with its techniques increasingly more complicated
The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges
26 Copyright 2017 FUJITSU
Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time
of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus
maintaining its ability to seize key point precisely regardless of the distance
distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)
Lasre emission (START)
Detection (STOP)
ΔT
T
Target
2 次元 MEMSミラー
Detector Detctor
distance measuring
circuit
Lasre Emittor
Lasre Pulse Emission Controller
Emission Circuit
lens with adjustable
emission angle
reflection from the target
Seizing the posture of a person by measuring its key points location
Technology 3D Laser Sensor
Adjustable emission angle
Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications
27 Copyright 2017 FUJITSU
Technology Recognition of Posture and Techniques
Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo
Recognition results are utilized for evaluating the completeness of techniques
Copyright 2017 FUJITSU
Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
The Mechanism of Scoring Support System
Fitting the Skelton
Data Processing
Recognizing Elements
Scoring Support Application
Sensing the action
3D Laser Sensor
High-speed Data matching
Element Database
Storing Model data
Copyright 2017 FUJITSU
31 Copyright 2017 FUJITSU
The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics
Copyright 2017 FUJITSU
32 Copyright 2017 FUJITSU
Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration
Copyright 2017 FUJITSU
33 Copyright 2017 FUJITSU
技術説明
We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far
Copyright 2017 FUJITSU
34 Copyright 2017 FUJITSU
Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle
The Details of System Demonstration
Copyright 2017 FUJITSU
35 Copyright 2017 FUJITSU
Skill of technician or traditional dancer
Support for medical care handicapped people Sports
Fitness
Future Plans
36 Copyright 2017 FUJITSU
Robotics
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
3 Copyright 2017 FUJITSU
What is Applied Innovation Research
4 Copyright 2017 FUJITSU
Applied Innovation Research Overview
Objective To create new businesses by matching our cutting-edge technologies with social trends and market opportunities
Process To achieve rapid commercialization of the target technology in collaboration with our customers who provide valuable ldquoreal worldrdquo feedback on use cases
Social Concern
Idea
Technologies
Business Model
Practice with Customers
Business Start
Prototype
BUStartup
Marketing
Hypotheses
5 Copyright 2017 FUJITSU
Example Manhole Sensor
Manhole
Water level sensor
Sewer pipe
6 Copyright 2017 FUJITSU
Social Concern
gt50 mmh Source JMA HP
Freq
uen
cy o
f h
eavy
rai
n
(Aug 2008 Aichi)
(Oct 2015 South Carolina)
Example of flood damage
Localized torrential rain increases every year and the urban area flood damage also increases
Year
7 Copyright 2017 FUJITSU
Idea
Real time monitoring of the water level in sewer pipe with the sensor installed on the bottom of a manhole iron cover
Sensor Node
Water Flow
Gateway
Water-treatment Plant
Manhole
Visualization
Data Flow
Cloud
Data of water level in sewer pipe Wireless
Transmission
Analysis and notification of flood zone Decision of renewal program of drainage
Operator
8 Copyright 2017 FUJITSU
Technologies
Energy harvesting battery (Thermoelectric generator) Detecting symptom of drainage flood (Time-series data analysis)
Sensor Node
Water Flow
Gateway
Water-treatment Plant
Manhole
Visualization
Data Flow
Cloud
Data of water level in sewer pipe Wireless
Transmission
Analysis and notification of flood zone Decision of renewal program of drainage
Operator
Detecting Symptom of drainage flood
Energy Harvesting
9 Copyright 2017 FUJITSU
Business
System Integration (Hardware Software Installation etc) Services Maintenance Consulting and so on
Sensor Node
Water Flow
Water-treatment Plant
Manhole
Visualization
Data Flow
Cloud
Data of water level in sewer pipe Wireless
Transmission
Consulting Analysis and notification of flood zone Decision of renewal program of drainage
Operator
Manhole With sensor
Gateway
Installation
Service
Maintenance
Consulting
10 Copyright 2017 FUJITSU
Practice with Customer (Koriyama City)
Fukushima Prefecture
Koriyama City
Tokyo
Located about 200 km north of Tokyo Famous for beautiful sites 15 flood events (from 1986 to 2013)
Press release (Feb 2015)
11 Copyright 2017 FUJITSU
Practice with Customer (Koriyama City)
Gateway Box
Grating with water-level sensor
Sensor locations
Ochiaibori Storm Drain
① ②
③
Koriyama City Hall
Furukawa pumping station
Koriyama station
③
Succeeded in the real-time water-level measurement of the sewer pipe at heavy rain Detected a rapid water-level rise of 22 m (91 of full level) in only 20 min
Rainfall
Water-level
Water-level
Water-level
The water-level increased toward the downstream
The maximum rainfall intensity 78 mmh
The maximum rainfall intensity 48 mmh
Midstream
Downstream
Upstream
The maximum rainfall intensity 51 mmh
Full level of the pipe
Full level of the pipe
Full level of the pipe (5 m)
The lag time in upstream -downstream was about 15 minutes
After the rainfall the water-level was
the maximum in 15-30 minutes later
Wat
er-l
evel
(m
)
Rai
nfa
ll (m
mh
) 雨量
(m
mh
)
Wat
er-l
evel
(m
) W
ater
-lev
el (
m)
Rainfall
Rainfall
Rai
nfa
ll (m
mh
) R
ain
fall
(mm
h)
Time
Time
Time
①
②
③
12 Copyright 2017 FUJITSU
Business Start
Fujitsu BU decided to start business
Press release (Aug 2016)
13 Copyright 2017 FUJITSU
Mobility
14 Copyright 2017 FUJITSU
Social Concern and Future Mobility
Self-driving cars
Shared cars
Emerging transport System Ride sharing Car sharing
Self-driving Cars
Ship Performance Estimation
Dynamic Mobility Management
MaaS PF
M-IoT PF
Congestion Management
Customized Transportation
Measured rate Flat rate
Mobility service
Train Ship Aircraft Human
Concern(problems) Traffic jam Congestion Long waiting time Energy efficiency
Idea
15 Copyright 2017 FUJITSU
Practice Singapore CoE (Centre of Excellence)
Collaborative research center (5 years since Oct 2014) Fujitsu Limited Agency for Science Technology and Research (ASTAR) Singapore Management University (SMU)
Objective Develop solutions that address urban challenges for sustainable urbanization
Projects
Dynamic Mobility Management
Maritime and Port Optimization
Large-scale Data Processing
Urban Computing Platform
16 Copyright 2017 FUJITSU
Congestion Relief Challenges in Singapore
17 Copyright 2017 FUJITSU
The world first attempt to alleviate congestion by inducing peoples behavior change with AI technology
Technology Dynamic Mobility Management
SPATIOWL
Retail data
Event data
Data collection (congestion situation etc)
Activity recommendation (via smartphone)
Location data
Transport data
BUS
TRAIN
What should I do before leaving AI
Distribute people into different time slots transport mode
Transport Hub Large-scale Facility
I want to avoid congestionhellip When should I leave Which transport mode should I take
TAXI
How about dropping by your favorite shop before leaving (you can get coupon )
Why donrsquot you take a uncongested train leaving 1 hour later
Dining
Dining incentive
Shopping incentive
18 Copyright 2017 FUJITSU
Scale model Simplified material
and structure Limited conditions
on wind wave etc No ocean current
Social Concern in Ship Design and Operation
Design performance (in tank)
Full scale Actual material
and structure Effects of
wind wave current etc
Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO
Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea
Increasing needs for more energy-efficient ship design and operation
Gap between
performances Actual and wide-ranged conditions
Artificial and limited experiments
Actual performance(at sea)
19 Copyright 2017 FUJITSU
Idea Routing System Configuration and Operation
Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes
If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves
Operational data
Weather prediction
Weather prediction
Recommended route
20 Copyright 2017 FUJITSU
Technology Accurate Ship Performance Estimation
Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models
Ship performances are visualized in various conditions and estimated for planned routes
Performance visualization
in various conditions
cargo weight
wind direction
wave direction
wave height
wind speed
Ship
p
erfo
rma
nce
current speed current
direction
aging
ship design H
igh
-dim
ensi
on
al
sta
tist
ica
l a
na
lysi
s
hellip
Performance estimation
on any planed routes
Calm condition
Current
Beam sea
Head sea
Head wind
Beam wind
21 Copyright 2017 FUJITSU
Practice Weather Routing Simulation
With the accurate ship performance optimal route reducing fuel consumption is calculated
by a weather routing simulation
Gathered operational data from Japanese maritime
shipping companies
Ship performance is estimated through actual ship operational data
22 Copyright 2017 FUJITSU
Sports
23 Copyright 2017 FUJITSU
Why Fujitsu is Developing the Scoring Gymnastics
Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing
technologies and broaden its application
Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring
24 Copyright 2017 FUJITSU
Social Concern Scoring Gymnastics
example of marking in a scoring sheet
Difficulties with scoring gymnastics One must cope with the techniques
becoming more and more complicated every year Scoring rules are modified once in every
4 years
Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets
25 Copyright 2017 FUJITSU
Idea Scoring-support System
Present State Our Goal Manual Scoring
3D Laser sensor
Recognition Result of posture and techniques are displayed
technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg
Scoring with the support by ICT
Scoring is becoming more and more difficult with its techniques increasingly more complicated
The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges
26 Copyright 2017 FUJITSU
Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time
of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus
maintaining its ability to seize key point precisely regardless of the distance
distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)
Lasre emission (START)
Detection (STOP)
ΔT
T
Target
2 次元 MEMSミラー
Detector Detctor
distance measuring
circuit
Lasre Emittor
Lasre Pulse Emission Controller
Emission Circuit
lens with adjustable
emission angle
reflection from the target
Seizing the posture of a person by measuring its key points location
Technology 3D Laser Sensor
Adjustable emission angle
Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications
27 Copyright 2017 FUJITSU
Technology Recognition of Posture and Techniques
Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo
Recognition results are utilized for evaluating the completeness of techniques
Copyright 2017 FUJITSU
Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
The Mechanism of Scoring Support System
Fitting the Skelton
Data Processing
Recognizing Elements
Scoring Support Application
Sensing the action
3D Laser Sensor
High-speed Data matching
Element Database
Storing Model data
Copyright 2017 FUJITSU
31 Copyright 2017 FUJITSU
The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics
Copyright 2017 FUJITSU
32 Copyright 2017 FUJITSU
Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration
Copyright 2017 FUJITSU
33 Copyright 2017 FUJITSU
技術説明
We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far
Copyright 2017 FUJITSU
34 Copyright 2017 FUJITSU
Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle
The Details of System Demonstration
Copyright 2017 FUJITSU
35 Copyright 2017 FUJITSU
Skill of technician or traditional dancer
Support for medical care handicapped people Sports
Fitness
Future Plans
36 Copyright 2017 FUJITSU
Robotics
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
4 Copyright 2017 FUJITSU
Applied Innovation Research Overview
Objective To create new businesses by matching our cutting-edge technologies with social trends and market opportunities
Process To achieve rapid commercialization of the target technology in collaboration with our customers who provide valuable ldquoreal worldrdquo feedback on use cases
Social Concern
Idea
Technologies
Business Model
Practice with Customers
Business Start
Prototype
BUStartup
Marketing
Hypotheses
5 Copyright 2017 FUJITSU
Example Manhole Sensor
Manhole
Water level sensor
Sewer pipe
6 Copyright 2017 FUJITSU
Social Concern
gt50 mmh Source JMA HP
Freq
uen
cy o
f h
eavy
rai
n
(Aug 2008 Aichi)
(Oct 2015 South Carolina)
Example of flood damage
Localized torrential rain increases every year and the urban area flood damage also increases
Year
7 Copyright 2017 FUJITSU
Idea
Real time monitoring of the water level in sewer pipe with the sensor installed on the bottom of a manhole iron cover
Sensor Node
Water Flow
Gateway
Water-treatment Plant
Manhole
Visualization
Data Flow
Cloud
Data of water level in sewer pipe Wireless
Transmission
Analysis and notification of flood zone Decision of renewal program of drainage
Operator
8 Copyright 2017 FUJITSU
Technologies
Energy harvesting battery (Thermoelectric generator) Detecting symptom of drainage flood (Time-series data analysis)
Sensor Node
Water Flow
Gateway
Water-treatment Plant
Manhole
Visualization
Data Flow
Cloud
Data of water level in sewer pipe Wireless
Transmission
Analysis and notification of flood zone Decision of renewal program of drainage
Operator
Detecting Symptom of drainage flood
Energy Harvesting
9 Copyright 2017 FUJITSU
Business
System Integration (Hardware Software Installation etc) Services Maintenance Consulting and so on
Sensor Node
Water Flow
Water-treatment Plant
Manhole
Visualization
Data Flow
Cloud
Data of water level in sewer pipe Wireless
Transmission
Consulting Analysis and notification of flood zone Decision of renewal program of drainage
Operator
Manhole With sensor
Gateway
Installation
Service
Maintenance
Consulting
10 Copyright 2017 FUJITSU
Practice with Customer (Koriyama City)
Fukushima Prefecture
Koriyama City
Tokyo
Located about 200 km north of Tokyo Famous for beautiful sites 15 flood events (from 1986 to 2013)
Press release (Feb 2015)
11 Copyright 2017 FUJITSU
Practice with Customer (Koriyama City)
Gateway Box
Grating with water-level sensor
Sensor locations
Ochiaibori Storm Drain
① ②
③
Koriyama City Hall
Furukawa pumping station
Koriyama station
③
Succeeded in the real-time water-level measurement of the sewer pipe at heavy rain Detected a rapid water-level rise of 22 m (91 of full level) in only 20 min
Rainfall
Water-level
Water-level
Water-level
The water-level increased toward the downstream
The maximum rainfall intensity 78 mmh
The maximum rainfall intensity 48 mmh
Midstream
Downstream
Upstream
The maximum rainfall intensity 51 mmh
Full level of the pipe
Full level of the pipe
Full level of the pipe (5 m)
The lag time in upstream -downstream was about 15 minutes
After the rainfall the water-level was
the maximum in 15-30 minutes later
Wat
er-l
evel
(m
)
Rai
nfa
ll (m
mh
) 雨量
(m
mh
)
Wat
er-l
evel
(m
) W
ater
-lev
el (
m)
Rainfall
Rainfall
Rai
nfa
ll (m
mh
) R
ain
fall
(mm
h)
Time
Time
Time
①
②
③
12 Copyright 2017 FUJITSU
Business Start
Fujitsu BU decided to start business
Press release (Aug 2016)
13 Copyright 2017 FUJITSU
Mobility
14 Copyright 2017 FUJITSU
Social Concern and Future Mobility
Self-driving cars
Shared cars
Emerging transport System Ride sharing Car sharing
Self-driving Cars
Ship Performance Estimation
Dynamic Mobility Management
MaaS PF
M-IoT PF
Congestion Management
Customized Transportation
Measured rate Flat rate
Mobility service
Train Ship Aircraft Human
Concern(problems) Traffic jam Congestion Long waiting time Energy efficiency
Idea
15 Copyright 2017 FUJITSU
Practice Singapore CoE (Centre of Excellence)
Collaborative research center (5 years since Oct 2014) Fujitsu Limited Agency for Science Technology and Research (ASTAR) Singapore Management University (SMU)
Objective Develop solutions that address urban challenges for sustainable urbanization
Projects
Dynamic Mobility Management
Maritime and Port Optimization
Large-scale Data Processing
Urban Computing Platform
16 Copyright 2017 FUJITSU
Congestion Relief Challenges in Singapore
17 Copyright 2017 FUJITSU
The world first attempt to alleviate congestion by inducing peoples behavior change with AI technology
Technology Dynamic Mobility Management
SPATIOWL
Retail data
Event data
Data collection (congestion situation etc)
Activity recommendation (via smartphone)
Location data
Transport data
BUS
TRAIN
What should I do before leaving AI
Distribute people into different time slots transport mode
Transport Hub Large-scale Facility
I want to avoid congestionhellip When should I leave Which transport mode should I take
TAXI
How about dropping by your favorite shop before leaving (you can get coupon )
Why donrsquot you take a uncongested train leaving 1 hour later
Dining
Dining incentive
Shopping incentive
18 Copyright 2017 FUJITSU
Scale model Simplified material
and structure Limited conditions
on wind wave etc No ocean current
Social Concern in Ship Design and Operation
Design performance (in tank)
Full scale Actual material
and structure Effects of
wind wave current etc
Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO
Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea
Increasing needs for more energy-efficient ship design and operation
Gap between
performances Actual and wide-ranged conditions
Artificial and limited experiments
Actual performance(at sea)
19 Copyright 2017 FUJITSU
Idea Routing System Configuration and Operation
Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes
If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves
Operational data
Weather prediction
Weather prediction
Recommended route
20 Copyright 2017 FUJITSU
Technology Accurate Ship Performance Estimation
Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models
Ship performances are visualized in various conditions and estimated for planned routes
Performance visualization
in various conditions
cargo weight
wind direction
wave direction
wave height
wind speed
Ship
p
erfo
rma
nce
current speed current
direction
aging
ship design H
igh
-dim
ensi
on
al
sta
tist
ica
l a
na
lysi
s
hellip
Performance estimation
on any planed routes
Calm condition
Current
Beam sea
Head sea
Head wind
Beam wind
21 Copyright 2017 FUJITSU
Practice Weather Routing Simulation
With the accurate ship performance optimal route reducing fuel consumption is calculated
by a weather routing simulation
Gathered operational data from Japanese maritime
shipping companies
Ship performance is estimated through actual ship operational data
22 Copyright 2017 FUJITSU
Sports
23 Copyright 2017 FUJITSU
Why Fujitsu is Developing the Scoring Gymnastics
Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing
technologies and broaden its application
Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring
24 Copyright 2017 FUJITSU
Social Concern Scoring Gymnastics
example of marking in a scoring sheet
Difficulties with scoring gymnastics One must cope with the techniques
becoming more and more complicated every year Scoring rules are modified once in every
4 years
Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets
25 Copyright 2017 FUJITSU
Idea Scoring-support System
Present State Our Goal Manual Scoring
3D Laser sensor
Recognition Result of posture and techniques are displayed
technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg
Scoring with the support by ICT
Scoring is becoming more and more difficult with its techniques increasingly more complicated
The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges
26 Copyright 2017 FUJITSU
Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time
of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus
maintaining its ability to seize key point precisely regardless of the distance
distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)
Lasre emission (START)
Detection (STOP)
ΔT
T
Target
2 次元 MEMSミラー
Detector Detctor
distance measuring
circuit
Lasre Emittor
Lasre Pulse Emission Controller
Emission Circuit
lens with adjustable
emission angle
reflection from the target
Seizing the posture of a person by measuring its key points location
Technology 3D Laser Sensor
Adjustable emission angle
Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications
27 Copyright 2017 FUJITSU
Technology Recognition of Posture and Techniques
Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo
Recognition results are utilized for evaluating the completeness of techniques
Copyright 2017 FUJITSU
Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
The Mechanism of Scoring Support System
Fitting the Skelton
Data Processing
Recognizing Elements
Scoring Support Application
Sensing the action
3D Laser Sensor
High-speed Data matching
Element Database
Storing Model data
Copyright 2017 FUJITSU
31 Copyright 2017 FUJITSU
The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics
Copyright 2017 FUJITSU
32 Copyright 2017 FUJITSU
Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration
Copyright 2017 FUJITSU
33 Copyright 2017 FUJITSU
技術説明
We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far
Copyright 2017 FUJITSU
34 Copyright 2017 FUJITSU
Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle
The Details of System Demonstration
Copyright 2017 FUJITSU
35 Copyright 2017 FUJITSU
Skill of technician or traditional dancer
Support for medical care handicapped people Sports
Fitness
Future Plans
36 Copyright 2017 FUJITSU
Robotics
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
5 Copyright 2017 FUJITSU
Example Manhole Sensor
Manhole
Water level sensor
Sewer pipe
6 Copyright 2017 FUJITSU
Social Concern
gt50 mmh Source JMA HP
Freq
uen
cy o
f h
eavy
rai
n
(Aug 2008 Aichi)
(Oct 2015 South Carolina)
Example of flood damage
Localized torrential rain increases every year and the urban area flood damage also increases
Year
7 Copyright 2017 FUJITSU
Idea
Real time monitoring of the water level in sewer pipe with the sensor installed on the bottom of a manhole iron cover
Sensor Node
Water Flow
Gateway
Water-treatment Plant
Manhole
Visualization
Data Flow
Cloud
Data of water level in sewer pipe Wireless
Transmission
Analysis and notification of flood zone Decision of renewal program of drainage
Operator
8 Copyright 2017 FUJITSU
Technologies
Energy harvesting battery (Thermoelectric generator) Detecting symptom of drainage flood (Time-series data analysis)
Sensor Node
Water Flow
Gateway
Water-treatment Plant
Manhole
Visualization
Data Flow
Cloud
Data of water level in sewer pipe Wireless
Transmission
Analysis and notification of flood zone Decision of renewal program of drainage
Operator
Detecting Symptom of drainage flood
Energy Harvesting
9 Copyright 2017 FUJITSU
Business
System Integration (Hardware Software Installation etc) Services Maintenance Consulting and so on
Sensor Node
Water Flow
Water-treatment Plant
Manhole
Visualization
Data Flow
Cloud
Data of water level in sewer pipe Wireless
Transmission
Consulting Analysis and notification of flood zone Decision of renewal program of drainage
Operator
Manhole With sensor
Gateway
Installation
Service
Maintenance
Consulting
10 Copyright 2017 FUJITSU
Practice with Customer (Koriyama City)
Fukushima Prefecture
Koriyama City
Tokyo
Located about 200 km north of Tokyo Famous for beautiful sites 15 flood events (from 1986 to 2013)
Press release (Feb 2015)
11 Copyright 2017 FUJITSU
Practice with Customer (Koriyama City)
Gateway Box
Grating with water-level sensor
Sensor locations
Ochiaibori Storm Drain
① ②
③
Koriyama City Hall
Furukawa pumping station
Koriyama station
③
Succeeded in the real-time water-level measurement of the sewer pipe at heavy rain Detected a rapid water-level rise of 22 m (91 of full level) in only 20 min
Rainfall
Water-level
Water-level
Water-level
The water-level increased toward the downstream
The maximum rainfall intensity 78 mmh
The maximum rainfall intensity 48 mmh
Midstream
Downstream
Upstream
The maximum rainfall intensity 51 mmh
Full level of the pipe
Full level of the pipe
Full level of the pipe (5 m)
The lag time in upstream -downstream was about 15 minutes
After the rainfall the water-level was
the maximum in 15-30 minutes later
Wat
er-l
evel
(m
)
Rai
nfa
ll (m
mh
) 雨量
(m
mh
)
Wat
er-l
evel
(m
) W
ater
-lev
el (
m)
Rainfall
Rainfall
Rai
nfa
ll (m
mh
) R
ain
fall
(mm
h)
Time
Time
Time
①
②
③
12 Copyright 2017 FUJITSU
Business Start
Fujitsu BU decided to start business
Press release (Aug 2016)
13 Copyright 2017 FUJITSU
Mobility
14 Copyright 2017 FUJITSU
Social Concern and Future Mobility
Self-driving cars
Shared cars
Emerging transport System Ride sharing Car sharing
Self-driving Cars
Ship Performance Estimation
Dynamic Mobility Management
MaaS PF
M-IoT PF
Congestion Management
Customized Transportation
Measured rate Flat rate
Mobility service
Train Ship Aircraft Human
Concern(problems) Traffic jam Congestion Long waiting time Energy efficiency
Idea
15 Copyright 2017 FUJITSU
Practice Singapore CoE (Centre of Excellence)
Collaborative research center (5 years since Oct 2014) Fujitsu Limited Agency for Science Technology and Research (ASTAR) Singapore Management University (SMU)
Objective Develop solutions that address urban challenges for sustainable urbanization
Projects
Dynamic Mobility Management
Maritime and Port Optimization
Large-scale Data Processing
Urban Computing Platform
16 Copyright 2017 FUJITSU
Congestion Relief Challenges in Singapore
17 Copyright 2017 FUJITSU
The world first attempt to alleviate congestion by inducing peoples behavior change with AI technology
Technology Dynamic Mobility Management
SPATIOWL
Retail data
Event data
Data collection (congestion situation etc)
Activity recommendation (via smartphone)
Location data
Transport data
BUS
TRAIN
What should I do before leaving AI
Distribute people into different time slots transport mode
Transport Hub Large-scale Facility
I want to avoid congestionhellip When should I leave Which transport mode should I take
TAXI
How about dropping by your favorite shop before leaving (you can get coupon )
Why donrsquot you take a uncongested train leaving 1 hour later
Dining
Dining incentive
Shopping incentive
18 Copyright 2017 FUJITSU
Scale model Simplified material
and structure Limited conditions
on wind wave etc No ocean current
Social Concern in Ship Design and Operation
Design performance (in tank)
Full scale Actual material
and structure Effects of
wind wave current etc
Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO
Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea
Increasing needs for more energy-efficient ship design and operation
Gap between
performances Actual and wide-ranged conditions
Artificial and limited experiments
Actual performance(at sea)
19 Copyright 2017 FUJITSU
Idea Routing System Configuration and Operation
Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes
If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves
Operational data
Weather prediction
Weather prediction
Recommended route
20 Copyright 2017 FUJITSU
Technology Accurate Ship Performance Estimation
Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models
Ship performances are visualized in various conditions and estimated for planned routes
Performance visualization
in various conditions
cargo weight
wind direction
wave direction
wave height
wind speed
Ship
p
erfo
rma
nce
current speed current
direction
aging
ship design H
igh
-dim
ensi
on
al
sta
tist
ica
l a
na
lysi
s
hellip
Performance estimation
on any planed routes
Calm condition
Current
Beam sea
Head sea
Head wind
Beam wind
21 Copyright 2017 FUJITSU
Practice Weather Routing Simulation
With the accurate ship performance optimal route reducing fuel consumption is calculated
by a weather routing simulation
Gathered operational data from Japanese maritime
shipping companies
Ship performance is estimated through actual ship operational data
22 Copyright 2017 FUJITSU
Sports
23 Copyright 2017 FUJITSU
Why Fujitsu is Developing the Scoring Gymnastics
Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing
technologies and broaden its application
Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring
24 Copyright 2017 FUJITSU
Social Concern Scoring Gymnastics
example of marking in a scoring sheet
Difficulties with scoring gymnastics One must cope with the techniques
becoming more and more complicated every year Scoring rules are modified once in every
4 years
Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets
25 Copyright 2017 FUJITSU
Idea Scoring-support System
Present State Our Goal Manual Scoring
3D Laser sensor
Recognition Result of posture and techniques are displayed
technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg
Scoring with the support by ICT
Scoring is becoming more and more difficult with its techniques increasingly more complicated
The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges
26 Copyright 2017 FUJITSU
Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time
of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus
maintaining its ability to seize key point precisely regardless of the distance
distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)
Lasre emission (START)
Detection (STOP)
ΔT
T
Target
2 次元 MEMSミラー
Detector Detctor
distance measuring
circuit
Lasre Emittor
Lasre Pulse Emission Controller
Emission Circuit
lens with adjustable
emission angle
reflection from the target
Seizing the posture of a person by measuring its key points location
Technology 3D Laser Sensor
Adjustable emission angle
Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications
27 Copyright 2017 FUJITSU
Technology Recognition of Posture and Techniques
Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo
Recognition results are utilized for evaluating the completeness of techniques
Copyright 2017 FUJITSU
Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
The Mechanism of Scoring Support System
Fitting the Skelton
Data Processing
Recognizing Elements
Scoring Support Application
Sensing the action
3D Laser Sensor
High-speed Data matching
Element Database
Storing Model data
Copyright 2017 FUJITSU
31 Copyright 2017 FUJITSU
The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics
Copyright 2017 FUJITSU
32 Copyright 2017 FUJITSU
Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration
Copyright 2017 FUJITSU
33 Copyright 2017 FUJITSU
技術説明
We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far
Copyright 2017 FUJITSU
34 Copyright 2017 FUJITSU
Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle
The Details of System Demonstration
Copyright 2017 FUJITSU
35 Copyright 2017 FUJITSU
Skill of technician or traditional dancer
Support for medical care handicapped people Sports
Fitness
Future Plans
36 Copyright 2017 FUJITSU
Robotics
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
6 Copyright 2017 FUJITSU
Social Concern
gt50 mmh Source JMA HP
Freq
uen
cy o
f h
eavy
rai
n
(Aug 2008 Aichi)
(Oct 2015 South Carolina)
Example of flood damage
Localized torrential rain increases every year and the urban area flood damage also increases
Year
7 Copyright 2017 FUJITSU
Idea
Real time monitoring of the water level in sewer pipe with the sensor installed on the bottom of a manhole iron cover
Sensor Node
Water Flow
Gateway
Water-treatment Plant
Manhole
Visualization
Data Flow
Cloud
Data of water level in sewer pipe Wireless
Transmission
Analysis and notification of flood zone Decision of renewal program of drainage
Operator
8 Copyright 2017 FUJITSU
Technologies
Energy harvesting battery (Thermoelectric generator) Detecting symptom of drainage flood (Time-series data analysis)
Sensor Node
Water Flow
Gateway
Water-treatment Plant
Manhole
Visualization
Data Flow
Cloud
Data of water level in sewer pipe Wireless
Transmission
Analysis and notification of flood zone Decision of renewal program of drainage
Operator
Detecting Symptom of drainage flood
Energy Harvesting
9 Copyright 2017 FUJITSU
Business
System Integration (Hardware Software Installation etc) Services Maintenance Consulting and so on
Sensor Node
Water Flow
Water-treatment Plant
Manhole
Visualization
Data Flow
Cloud
Data of water level in sewer pipe Wireless
Transmission
Consulting Analysis and notification of flood zone Decision of renewal program of drainage
Operator
Manhole With sensor
Gateway
Installation
Service
Maintenance
Consulting
10 Copyright 2017 FUJITSU
Practice with Customer (Koriyama City)
Fukushima Prefecture
Koriyama City
Tokyo
Located about 200 km north of Tokyo Famous for beautiful sites 15 flood events (from 1986 to 2013)
Press release (Feb 2015)
11 Copyright 2017 FUJITSU
Practice with Customer (Koriyama City)
Gateway Box
Grating with water-level sensor
Sensor locations
Ochiaibori Storm Drain
① ②
③
Koriyama City Hall
Furukawa pumping station
Koriyama station
③
Succeeded in the real-time water-level measurement of the sewer pipe at heavy rain Detected a rapid water-level rise of 22 m (91 of full level) in only 20 min
Rainfall
Water-level
Water-level
Water-level
The water-level increased toward the downstream
The maximum rainfall intensity 78 mmh
The maximum rainfall intensity 48 mmh
Midstream
Downstream
Upstream
The maximum rainfall intensity 51 mmh
Full level of the pipe
Full level of the pipe
Full level of the pipe (5 m)
The lag time in upstream -downstream was about 15 minutes
After the rainfall the water-level was
the maximum in 15-30 minutes later
Wat
er-l
evel
(m
)
Rai
nfa
ll (m
mh
) 雨量
(m
mh
)
Wat
er-l
evel
(m
) W
ater
-lev
el (
m)
Rainfall
Rainfall
Rai
nfa
ll (m
mh
) R
ain
fall
(mm
h)
Time
Time
Time
①
②
③
12 Copyright 2017 FUJITSU
Business Start
Fujitsu BU decided to start business
Press release (Aug 2016)
13 Copyright 2017 FUJITSU
Mobility
14 Copyright 2017 FUJITSU
Social Concern and Future Mobility
Self-driving cars
Shared cars
Emerging transport System Ride sharing Car sharing
Self-driving Cars
Ship Performance Estimation
Dynamic Mobility Management
MaaS PF
M-IoT PF
Congestion Management
Customized Transportation
Measured rate Flat rate
Mobility service
Train Ship Aircraft Human
Concern(problems) Traffic jam Congestion Long waiting time Energy efficiency
Idea
15 Copyright 2017 FUJITSU
Practice Singapore CoE (Centre of Excellence)
Collaborative research center (5 years since Oct 2014) Fujitsu Limited Agency for Science Technology and Research (ASTAR) Singapore Management University (SMU)
Objective Develop solutions that address urban challenges for sustainable urbanization
Projects
Dynamic Mobility Management
Maritime and Port Optimization
Large-scale Data Processing
Urban Computing Platform
16 Copyright 2017 FUJITSU
Congestion Relief Challenges in Singapore
17 Copyright 2017 FUJITSU
The world first attempt to alleviate congestion by inducing peoples behavior change with AI technology
Technology Dynamic Mobility Management
SPATIOWL
Retail data
Event data
Data collection (congestion situation etc)
Activity recommendation (via smartphone)
Location data
Transport data
BUS
TRAIN
What should I do before leaving AI
Distribute people into different time slots transport mode
Transport Hub Large-scale Facility
I want to avoid congestionhellip When should I leave Which transport mode should I take
TAXI
How about dropping by your favorite shop before leaving (you can get coupon )
Why donrsquot you take a uncongested train leaving 1 hour later
Dining
Dining incentive
Shopping incentive
18 Copyright 2017 FUJITSU
Scale model Simplified material
and structure Limited conditions
on wind wave etc No ocean current
Social Concern in Ship Design and Operation
Design performance (in tank)
Full scale Actual material
and structure Effects of
wind wave current etc
Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO
Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea
Increasing needs for more energy-efficient ship design and operation
Gap between
performances Actual and wide-ranged conditions
Artificial and limited experiments
Actual performance(at sea)
19 Copyright 2017 FUJITSU
Idea Routing System Configuration and Operation
Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes
If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves
Operational data
Weather prediction
Weather prediction
Recommended route
20 Copyright 2017 FUJITSU
Technology Accurate Ship Performance Estimation
Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models
Ship performances are visualized in various conditions and estimated for planned routes
Performance visualization
in various conditions
cargo weight
wind direction
wave direction
wave height
wind speed
Ship
p
erfo
rma
nce
current speed current
direction
aging
ship design H
igh
-dim
ensi
on
al
sta
tist
ica
l a
na
lysi
s
hellip
Performance estimation
on any planed routes
Calm condition
Current
Beam sea
Head sea
Head wind
Beam wind
21 Copyright 2017 FUJITSU
Practice Weather Routing Simulation
With the accurate ship performance optimal route reducing fuel consumption is calculated
by a weather routing simulation
Gathered operational data from Japanese maritime
shipping companies
Ship performance is estimated through actual ship operational data
22 Copyright 2017 FUJITSU
Sports
23 Copyright 2017 FUJITSU
Why Fujitsu is Developing the Scoring Gymnastics
Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing
technologies and broaden its application
Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring
24 Copyright 2017 FUJITSU
Social Concern Scoring Gymnastics
example of marking in a scoring sheet
Difficulties with scoring gymnastics One must cope with the techniques
becoming more and more complicated every year Scoring rules are modified once in every
4 years
Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets
25 Copyright 2017 FUJITSU
Idea Scoring-support System
Present State Our Goal Manual Scoring
3D Laser sensor
Recognition Result of posture and techniques are displayed
technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg
Scoring with the support by ICT
Scoring is becoming more and more difficult with its techniques increasingly more complicated
The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges
26 Copyright 2017 FUJITSU
Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time
of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus
maintaining its ability to seize key point precisely regardless of the distance
distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)
Lasre emission (START)
Detection (STOP)
ΔT
T
Target
2 次元 MEMSミラー
Detector Detctor
distance measuring
circuit
Lasre Emittor
Lasre Pulse Emission Controller
Emission Circuit
lens with adjustable
emission angle
reflection from the target
Seizing the posture of a person by measuring its key points location
Technology 3D Laser Sensor
Adjustable emission angle
Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications
27 Copyright 2017 FUJITSU
Technology Recognition of Posture and Techniques
Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo
Recognition results are utilized for evaluating the completeness of techniques
Copyright 2017 FUJITSU
Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
The Mechanism of Scoring Support System
Fitting the Skelton
Data Processing
Recognizing Elements
Scoring Support Application
Sensing the action
3D Laser Sensor
High-speed Data matching
Element Database
Storing Model data
Copyright 2017 FUJITSU
31 Copyright 2017 FUJITSU
The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics
Copyright 2017 FUJITSU
32 Copyright 2017 FUJITSU
Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration
Copyright 2017 FUJITSU
33 Copyright 2017 FUJITSU
技術説明
We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far
Copyright 2017 FUJITSU
34 Copyright 2017 FUJITSU
Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle
The Details of System Demonstration
Copyright 2017 FUJITSU
35 Copyright 2017 FUJITSU
Skill of technician or traditional dancer
Support for medical care handicapped people Sports
Fitness
Future Plans
36 Copyright 2017 FUJITSU
Robotics
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
7 Copyright 2017 FUJITSU
Idea
Real time monitoring of the water level in sewer pipe with the sensor installed on the bottom of a manhole iron cover
Sensor Node
Water Flow
Gateway
Water-treatment Plant
Manhole
Visualization
Data Flow
Cloud
Data of water level in sewer pipe Wireless
Transmission
Analysis and notification of flood zone Decision of renewal program of drainage
Operator
8 Copyright 2017 FUJITSU
Technologies
Energy harvesting battery (Thermoelectric generator) Detecting symptom of drainage flood (Time-series data analysis)
Sensor Node
Water Flow
Gateway
Water-treatment Plant
Manhole
Visualization
Data Flow
Cloud
Data of water level in sewer pipe Wireless
Transmission
Analysis and notification of flood zone Decision of renewal program of drainage
Operator
Detecting Symptom of drainage flood
Energy Harvesting
9 Copyright 2017 FUJITSU
Business
System Integration (Hardware Software Installation etc) Services Maintenance Consulting and so on
Sensor Node
Water Flow
Water-treatment Plant
Manhole
Visualization
Data Flow
Cloud
Data of water level in sewer pipe Wireless
Transmission
Consulting Analysis and notification of flood zone Decision of renewal program of drainage
Operator
Manhole With sensor
Gateway
Installation
Service
Maintenance
Consulting
10 Copyright 2017 FUJITSU
Practice with Customer (Koriyama City)
Fukushima Prefecture
Koriyama City
Tokyo
Located about 200 km north of Tokyo Famous for beautiful sites 15 flood events (from 1986 to 2013)
Press release (Feb 2015)
11 Copyright 2017 FUJITSU
Practice with Customer (Koriyama City)
Gateway Box
Grating with water-level sensor
Sensor locations
Ochiaibori Storm Drain
① ②
③
Koriyama City Hall
Furukawa pumping station
Koriyama station
③
Succeeded in the real-time water-level measurement of the sewer pipe at heavy rain Detected a rapid water-level rise of 22 m (91 of full level) in only 20 min
Rainfall
Water-level
Water-level
Water-level
The water-level increased toward the downstream
The maximum rainfall intensity 78 mmh
The maximum rainfall intensity 48 mmh
Midstream
Downstream
Upstream
The maximum rainfall intensity 51 mmh
Full level of the pipe
Full level of the pipe
Full level of the pipe (5 m)
The lag time in upstream -downstream was about 15 minutes
After the rainfall the water-level was
the maximum in 15-30 minutes later
Wat
er-l
evel
(m
)
Rai
nfa
ll (m
mh
) 雨量
(m
mh
)
Wat
er-l
evel
(m
) W
ater
-lev
el (
m)
Rainfall
Rainfall
Rai
nfa
ll (m
mh
) R
ain
fall
(mm
h)
Time
Time
Time
①
②
③
12 Copyright 2017 FUJITSU
Business Start
Fujitsu BU decided to start business
Press release (Aug 2016)
13 Copyright 2017 FUJITSU
Mobility
14 Copyright 2017 FUJITSU
Social Concern and Future Mobility
Self-driving cars
Shared cars
Emerging transport System Ride sharing Car sharing
Self-driving Cars
Ship Performance Estimation
Dynamic Mobility Management
MaaS PF
M-IoT PF
Congestion Management
Customized Transportation
Measured rate Flat rate
Mobility service
Train Ship Aircraft Human
Concern(problems) Traffic jam Congestion Long waiting time Energy efficiency
Idea
15 Copyright 2017 FUJITSU
Practice Singapore CoE (Centre of Excellence)
Collaborative research center (5 years since Oct 2014) Fujitsu Limited Agency for Science Technology and Research (ASTAR) Singapore Management University (SMU)
Objective Develop solutions that address urban challenges for sustainable urbanization
Projects
Dynamic Mobility Management
Maritime and Port Optimization
Large-scale Data Processing
Urban Computing Platform
16 Copyright 2017 FUJITSU
Congestion Relief Challenges in Singapore
17 Copyright 2017 FUJITSU
The world first attempt to alleviate congestion by inducing peoples behavior change with AI technology
Technology Dynamic Mobility Management
SPATIOWL
Retail data
Event data
Data collection (congestion situation etc)
Activity recommendation (via smartphone)
Location data
Transport data
BUS
TRAIN
What should I do before leaving AI
Distribute people into different time slots transport mode
Transport Hub Large-scale Facility
I want to avoid congestionhellip When should I leave Which transport mode should I take
TAXI
How about dropping by your favorite shop before leaving (you can get coupon )
Why donrsquot you take a uncongested train leaving 1 hour later
Dining
Dining incentive
Shopping incentive
18 Copyright 2017 FUJITSU
Scale model Simplified material
and structure Limited conditions
on wind wave etc No ocean current
Social Concern in Ship Design and Operation
Design performance (in tank)
Full scale Actual material
and structure Effects of
wind wave current etc
Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO
Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea
Increasing needs for more energy-efficient ship design and operation
Gap between
performances Actual and wide-ranged conditions
Artificial and limited experiments
Actual performance(at sea)
19 Copyright 2017 FUJITSU
Idea Routing System Configuration and Operation
Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes
If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves
Operational data
Weather prediction
Weather prediction
Recommended route
20 Copyright 2017 FUJITSU
Technology Accurate Ship Performance Estimation
Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models
Ship performances are visualized in various conditions and estimated for planned routes
Performance visualization
in various conditions
cargo weight
wind direction
wave direction
wave height
wind speed
Ship
p
erfo
rma
nce
current speed current
direction
aging
ship design H
igh
-dim
ensi
on
al
sta
tist
ica
l a
na
lysi
s
hellip
Performance estimation
on any planed routes
Calm condition
Current
Beam sea
Head sea
Head wind
Beam wind
21 Copyright 2017 FUJITSU
Practice Weather Routing Simulation
With the accurate ship performance optimal route reducing fuel consumption is calculated
by a weather routing simulation
Gathered operational data from Japanese maritime
shipping companies
Ship performance is estimated through actual ship operational data
22 Copyright 2017 FUJITSU
Sports
23 Copyright 2017 FUJITSU
Why Fujitsu is Developing the Scoring Gymnastics
Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing
technologies and broaden its application
Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring
24 Copyright 2017 FUJITSU
Social Concern Scoring Gymnastics
example of marking in a scoring sheet
Difficulties with scoring gymnastics One must cope with the techniques
becoming more and more complicated every year Scoring rules are modified once in every
4 years
Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets
25 Copyright 2017 FUJITSU
Idea Scoring-support System
Present State Our Goal Manual Scoring
3D Laser sensor
Recognition Result of posture and techniques are displayed
technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg
Scoring with the support by ICT
Scoring is becoming more and more difficult with its techniques increasingly more complicated
The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges
26 Copyright 2017 FUJITSU
Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time
of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus
maintaining its ability to seize key point precisely regardless of the distance
distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)
Lasre emission (START)
Detection (STOP)
ΔT
T
Target
2 次元 MEMSミラー
Detector Detctor
distance measuring
circuit
Lasre Emittor
Lasre Pulse Emission Controller
Emission Circuit
lens with adjustable
emission angle
reflection from the target
Seizing the posture of a person by measuring its key points location
Technology 3D Laser Sensor
Adjustable emission angle
Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications
27 Copyright 2017 FUJITSU
Technology Recognition of Posture and Techniques
Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo
Recognition results are utilized for evaluating the completeness of techniques
Copyright 2017 FUJITSU
Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
The Mechanism of Scoring Support System
Fitting the Skelton
Data Processing
Recognizing Elements
Scoring Support Application
Sensing the action
3D Laser Sensor
High-speed Data matching
Element Database
Storing Model data
Copyright 2017 FUJITSU
31 Copyright 2017 FUJITSU
The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics
Copyright 2017 FUJITSU
32 Copyright 2017 FUJITSU
Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration
Copyright 2017 FUJITSU
33 Copyright 2017 FUJITSU
技術説明
We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far
Copyright 2017 FUJITSU
34 Copyright 2017 FUJITSU
Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle
The Details of System Demonstration
Copyright 2017 FUJITSU
35 Copyright 2017 FUJITSU
Skill of technician or traditional dancer
Support for medical care handicapped people Sports
Fitness
Future Plans
36 Copyright 2017 FUJITSU
Robotics
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
8 Copyright 2017 FUJITSU
Technologies
Energy harvesting battery (Thermoelectric generator) Detecting symptom of drainage flood (Time-series data analysis)
Sensor Node
Water Flow
Gateway
Water-treatment Plant
Manhole
Visualization
Data Flow
Cloud
Data of water level in sewer pipe Wireless
Transmission
Analysis and notification of flood zone Decision of renewal program of drainage
Operator
Detecting Symptom of drainage flood
Energy Harvesting
9 Copyright 2017 FUJITSU
Business
System Integration (Hardware Software Installation etc) Services Maintenance Consulting and so on
Sensor Node
Water Flow
Water-treatment Plant
Manhole
Visualization
Data Flow
Cloud
Data of water level in sewer pipe Wireless
Transmission
Consulting Analysis and notification of flood zone Decision of renewal program of drainage
Operator
Manhole With sensor
Gateway
Installation
Service
Maintenance
Consulting
10 Copyright 2017 FUJITSU
Practice with Customer (Koriyama City)
Fukushima Prefecture
Koriyama City
Tokyo
Located about 200 km north of Tokyo Famous for beautiful sites 15 flood events (from 1986 to 2013)
Press release (Feb 2015)
11 Copyright 2017 FUJITSU
Practice with Customer (Koriyama City)
Gateway Box
Grating with water-level sensor
Sensor locations
Ochiaibori Storm Drain
① ②
③
Koriyama City Hall
Furukawa pumping station
Koriyama station
③
Succeeded in the real-time water-level measurement of the sewer pipe at heavy rain Detected a rapid water-level rise of 22 m (91 of full level) in only 20 min
Rainfall
Water-level
Water-level
Water-level
The water-level increased toward the downstream
The maximum rainfall intensity 78 mmh
The maximum rainfall intensity 48 mmh
Midstream
Downstream
Upstream
The maximum rainfall intensity 51 mmh
Full level of the pipe
Full level of the pipe
Full level of the pipe (5 m)
The lag time in upstream -downstream was about 15 minutes
After the rainfall the water-level was
the maximum in 15-30 minutes later
Wat
er-l
evel
(m
)
Rai
nfa
ll (m
mh
) 雨量
(m
mh
)
Wat
er-l
evel
(m
) W
ater
-lev
el (
m)
Rainfall
Rainfall
Rai
nfa
ll (m
mh
) R
ain
fall
(mm
h)
Time
Time
Time
①
②
③
12 Copyright 2017 FUJITSU
Business Start
Fujitsu BU decided to start business
Press release (Aug 2016)
13 Copyright 2017 FUJITSU
Mobility
14 Copyright 2017 FUJITSU
Social Concern and Future Mobility
Self-driving cars
Shared cars
Emerging transport System Ride sharing Car sharing
Self-driving Cars
Ship Performance Estimation
Dynamic Mobility Management
MaaS PF
M-IoT PF
Congestion Management
Customized Transportation
Measured rate Flat rate
Mobility service
Train Ship Aircraft Human
Concern(problems) Traffic jam Congestion Long waiting time Energy efficiency
Idea
15 Copyright 2017 FUJITSU
Practice Singapore CoE (Centre of Excellence)
Collaborative research center (5 years since Oct 2014) Fujitsu Limited Agency for Science Technology and Research (ASTAR) Singapore Management University (SMU)
Objective Develop solutions that address urban challenges for sustainable urbanization
Projects
Dynamic Mobility Management
Maritime and Port Optimization
Large-scale Data Processing
Urban Computing Platform
16 Copyright 2017 FUJITSU
Congestion Relief Challenges in Singapore
17 Copyright 2017 FUJITSU
The world first attempt to alleviate congestion by inducing peoples behavior change with AI technology
Technology Dynamic Mobility Management
SPATIOWL
Retail data
Event data
Data collection (congestion situation etc)
Activity recommendation (via smartphone)
Location data
Transport data
BUS
TRAIN
What should I do before leaving AI
Distribute people into different time slots transport mode
Transport Hub Large-scale Facility
I want to avoid congestionhellip When should I leave Which transport mode should I take
TAXI
How about dropping by your favorite shop before leaving (you can get coupon )
Why donrsquot you take a uncongested train leaving 1 hour later
Dining
Dining incentive
Shopping incentive
18 Copyright 2017 FUJITSU
Scale model Simplified material
and structure Limited conditions
on wind wave etc No ocean current
Social Concern in Ship Design and Operation
Design performance (in tank)
Full scale Actual material
and structure Effects of
wind wave current etc
Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO
Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea
Increasing needs for more energy-efficient ship design and operation
Gap between
performances Actual and wide-ranged conditions
Artificial and limited experiments
Actual performance(at sea)
19 Copyright 2017 FUJITSU
Idea Routing System Configuration and Operation
Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes
If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves
Operational data
Weather prediction
Weather prediction
Recommended route
20 Copyright 2017 FUJITSU
Technology Accurate Ship Performance Estimation
Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models
Ship performances are visualized in various conditions and estimated for planned routes
Performance visualization
in various conditions
cargo weight
wind direction
wave direction
wave height
wind speed
Ship
p
erfo
rma
nce
current speed current
direction
aging
ship design H
igh
-dim
ensi
on
al
sta
tist
ica
l a
na
lysi
s
hellip
Performance estimation
on any planed routes
Calm condition
Current
Beam sea
Head sea
Head wind
Beam wind
21 Copyright 2017 FUJITSU
Practice Weather Routing Simulation
With the accurate ship performance optimal route reducing fuel consumption is calculated
by a weather routing simulation
Gathered operational data from Japanese maritime
shipping companies
Ship performance is estimated through actual ship operational data
22 Copyright 2017 FUJITSU
Sports
23 Copyright 2017 FUJITSU
Why Fujitsu is Developing the Scoring Gymnastics
Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing
technologies and broaden its application
Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring
24 Copyright 2017 FUJITSU
Social Concern Scoring Gymnastics
example of marking in a scoring sheet
Difficulties with scoring gymnastics One must cope with the techniques
becoming more and more complicated every year Scoring rules are modified once in every
4 years
Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets
25 Copyright 2017 FUJITSU
Idea Scoring-support System
Present State Our Goal Manual Scoring
3D Laser sensor
Recognition Result of posture and techniques are displayed
technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg
Scoring with the support by ICT
Scoring is becoming more and more difficult with its techniques increasingly more complicated
The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges
26 Copyright 2017 FUJITSU
Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time
of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus
maintaining its ability to seize key point precisely regardless of the distance
distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)
Lasre emission (START)
Detection (STOP)
ΔT
T
Target
2 次元 MEMSミラー
Detector Detctor
distance measuring
circuit
Lasre Emittor
Lasre Pulse Emission Controller
Emission Circuit
lens with adjustable
emission angle
reflection from the target
Seizing the posture of a person by measuring its key points location
Technology 3D Laser Sensor
Adjustable emission angle
Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications
27 Copyright 2017 FUJITSU
Technology Recognition of Posture and Techniques
Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo
Recognition results are utilized for evaluating the completeness of techniques
Copyright 2017 FUJITSU
Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
The Mechanism of Scoring Support System
Fitting the Skelton
Data Processing
Recognizing Elements
Scoring Support Application
Sensing the action
3D Laser Sensor
High-speed Data matching
Element Database
Storing Model data
Copyright 2017 FUJITSU
31 Copyright 2017 FUJITSU
The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics
Copyright 2017 FUJITSU
32 Copyright 2017 FUJITSU
Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration
Copyright 2017 FUJITSU
33 Copyright 2017 FUJITSU
技術説明
We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far
Copyright 2017 FUJITSU
34 Copyright 2017 FUJITSU
Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle
The Details of System Demonstration
Copyright 2017 FUJITSU
35 Copyright 2017 FUJITSU
Skill of technician or traditional dancer
Support for medical care handicapped people Sports
Fitness
Future Plans
36 Copyright 2017 FUJITSU
Robotics
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
9 Copyright 2017 FUJITSU
Business
System Integration (Hardware Software Installation etc) Services Maintenance Consulting and so on
Sensor Node
Water Flow
Water-treatment Plant
Manhole
Visualization
Data Flow
Cloud
Data of water level in sewer pipe Wireless
Transmission
Consulting Analysis and notification of flood zone Decision of renewal program of drainage
Operator
Manhole With sensor
Gateway
Installation
Service
Maintenance
Consulting
10 Copyright 2017 FUJITSU
Practice with Customer (Koriyama City)
Fukushima Prefecture
Koriyama City
Tokyo
Located about 200 km north of Tokyo Famous for beautiful sites 15 flood events (from 1986 to 2013)
Press release (Feb 2015)
11 Copyright 2017 FUJITSU
Practice with Customer (Koriyama City)
Gateway Box
Grating with water-level sensor
Sensor locations
Ochiaibori Storm Drain
① ②
③
Koriyama City Hall
Furukawa pumping station
Koriyama station
③
Succeeded in the real-time water-level measurement of the sewer pipe at heavy rain Detected a rapid water-level rise of 22 m (91 of full level) in only 20 min
Rainfall
Water-level
Water-level
Water-level
The water-level increased toward the downstream
The maximum rainfall intensity 78 mmh
The maximum rainfall intensity 48 mmh
Midstream
Downstream
Upstream
The maximum rainfall intensity 51 mmh
Full level of the pipe
Full level of the pipe
Full level of the pipe (5 m)
The lag time in upstream -downstream was about 15 minutes
After the rainfall the water-level was
the maximum in 15-30 minutes later
Wat
er-l
evel
(m
)
Rai
nfa
ll (m
mh
) 雨量
(m
mh
)
Wat
er-l
evel
(m
) W
ater
-lev
el (
m)
Rainfall
Rainfall
Rai
nfa
ll (m
mh
) R
ain
fall
(mm
h)
Time
Time
Time
①
②
③
12 Copyright 2017 FUJITSU
Business Start
Fujitsu BU decided to start business
Press release (Aug 2016)
13 Copyright 2017 FUJITSU
Mobility
14 Copyright 2017 FUJITSU
Social Concern and Future Mobility
Self-driving cars
Shared cars
Emerging transport System Ride sharing Car sharing
Self-driving Cars
Ship Performance Estimation
Dynamic Mobility Management
MaaS PF
M-IoT PF
Congestion Management
Customized Transportation
Measured rate Flat rate
Mobility service
Train Ship Aircraft Human
Concern(problems) Traffic jam Congestion Long waiting time Energy efficiency
Idea
15 Copyright 2017 FUJITSU
Practice Singapore CoE (Centre of Excellence)
Collaborative research center (5 years since Oct 2014) Fujitsu Limited Agency for Science Technology and Research (ASTAR) Singapore Management University (SMU)
Objective Develop solutions that address urban challenges for sustainable urbanization
Projects
Dynamic Mobility Management
Maritime and Port Optimization
Large-scale Data Processing
Urban Computing Platform
16 Copyright 2017 FUJITSU
Congestion Relief Challenges in Singapore
17 Copyright 2017 FUJITSU
The world first attempt to alleviate congestion by inducing peoples behavior change with AI technology
Technology Dynamic Mobility Management
SPATIOWL
Retail data
Event data
Data collection (congestion situation etc)
Activity recommendation (via smartphone)
Location data
Transport data
BUS
TRAIN
What should I do before leaving AI
Distribute people into different time slots transport mode
Transport Hub Large-scale Facility
I want to avoid congestionhellip When should I leave Which transport mode should I take
TAXI
How about dropping by your favorite shop before leaving (you can get coupon )
Why donrsquot you take a uncongested train leaving 1 hour later
Dining
Dining incentive
Shopping incentive
18 Copyright 2017 FUJITSU
Scale model Simplified material
and structure Limited conditions
on wind wave etc No ocean current
Social Concern in Ship Design and Operation
Design performance (in tank)
Full scale Actual material
and structure Effects of
wind wave current etc
Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO
Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea
Increasing needs for more energy-efficient ship design and operation
Gap between
performances Actual and wide-ranged conditions
Artificial and limited experiments
Actual performance(at sea)
19 Copyright 2017 FUJITSU
Idea Routing System Configuration and Operation
Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes
If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves
Operational data
Weather prediction
Weather prediction
Recommended route
20 Copyright 2017 FUJITSU
Technology Accurate Ship Performance Estimation
Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models
Ship performances are visualized in various conditions and estimated for planned routes
Performance visualization
in various conditions
cargo weight
wind direction
wave direction
wave height
wind speed
Ship
p
erfo
rma
nce
current speed current
direction
aging
ship design H
igh
-dim
ensi
on
al
sta
tist
ica
l a
na
lysi
s
hellip
Performance estimation
on any planed routes
Calm condition
Current
Beam sea
Head sea
Head wind
Beam wind
21 Copyright 2017 FUJITSU
Practice Weather Routing Simulation
With the accurate ship performance optimal route reducing fuel consumption is calculated
by a weather routing simulation
Gathered operational data from Japanese maritime
shipping companies
Ship performance is estimated through actual ship operational data
22 Copyright 2017 FUJITSU
Sports
23 Copyright 2017 FUJITSU
Why Fujitsu is Developing the Scoring Gymnastics
Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing
technologies and broaden its application
Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring
24 Copyright 2017 FUJITSU
Social Concern Scoring Gymnastics
example of marking in a scoring sheet
Difficulties with scoring gymnastics One must cope with the techniques
becoming more and more complicated every year Scoring rules are modified once in every
4 years
Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets
25 Copyright 2017 FUJITSU
Idea Scoring-support System
Present State Our Goal Manual Scoring
3D Laser sensor
Recognition Result of posture and techniques are displayed
technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg
Scoring with the support by ICT
Scoring is becoming more and more difficult with its techniques increasingly more complicated
The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges
26 Copyright 2017 FUJITSU
Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time
of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus
maintaining its ability to seize key point precisely regardless of the distance
distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)
Lasre emission (START)
Detection (STOP)
ΔT
T
Target
2 次元 MEMSミラー
Detector Detctor
distance measuring
circuit
Lasre Emittor
Lasre Pulse Emission Controller
Emission Circuit
lens with adjustable
emission angle
reflection from the target
Seizing the posture of a person by measuring its key points location
Technology 3D Laser Sensor
Adjustable emission angle
Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications
27 Copyright 2017 FUJITSU
Technology Recognition of Posture and Techniques
Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo
Recognition results are utilized for evaluating the completeness of techniques
Copyright 2017 FUJITSU
Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
The Mechanism of Scoring Support System
Fitting the Skelton
Data Processing
Recognizing Elements
Scoring Support Application
Sensing the action
3D Laser Sensor
High-speed Data matching
Element Database
Storing Model data
Copyright 2017 FUJITSU
31 Copyright 2017 FUJITSU
The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics
Copyright 2017 FUJITSU
32 Copyright 2017 FUJITSU
Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration
Copyright 2017 FUJITSU
33 Copyright 2017 FUJITSU
技術説明
We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far
Copyright 2017 FUJITSU
34 Copyright 2017 FUJITSU
Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle
The Details of System Demonstration
Copyright 2017 FUJITSU
35 Copyright 2017 FUJITSU
Skill of technician or traditional dancer
Support for medical care handicapped people Sports
Fitness
Future Plans
36 Copyright 2017 FUJITSU
Robotics
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
10 Copyright 2017 FUJITSU
Practice with Customer (Koriyama City)
Fukushima Prefecture
Koriyama City
Tokyo
Located about 200 km north of Tokyo Famous for beautiful sites 15 flood events (from 1986 to 2013)
Press release (Feb 2015)
11 Copyright 2017 FUJITSU
Practice with Customer (Koriyama City)
Gateway Box
Grating with water-level sensor
Sensor locations
Ochiaibori Storm Drain
① ②
③
Koriyama City Hall
Furukawa pumping station
Koriyama station
③
Succeeded in the real-time water-level measurement of the sewer pipe at heavy rain Detected a rapid water-level rise of 22 m (91 of full level) in only 20 min
Rainfall
Water-level
Water-level
Water-level
The water-level increased toward the downstream
The maximum rainfall intensity 78 mmh
The maximum rainfall intensity 48 mmh
Midstream
Downstream
Upstream
The maximum rainfall intensity 51 mmh
Full level of the pipe
Full level of the pipe
Full level of the pipe (5 m)
The lag time in upstream -downstream was about 15 minutes
After the rainfall the water-level was
the maximum in 15-30 minutes later
Wat
er-l
evel
(m
)
Rai
nfa
ll (m
mh
) 雨量
(m
mh
)
Wat
er-l
evel
(m
) W
ater
-lev
el (
m)
Rainfall
Rainfall
Rai
nfa
ll (m
mh
) R
ain
fall
(mm
h)
Time
Time
Time
①
②
③
12 Copyright 2017 FUJITSU
Business Start
Fujitsu BU decided to start business
Press release (Aug 2016)
13 Copyright 2017 FUJITSU
Mobility
14 Copyright 2017 FUJITSU
Social Concern and Future Mobility
Self-driving cars
Shared cars
Emerging transport System Ride sharing Car sharing
Self-driving Cars
Ship Performance Estimation
Dynamic Mobility Management
MaaS PF
M-IoT PF
Congestion Management
Customized Transportation
Measured rate Flat rate
Mobility service
Train Ship Aircraft Human
Concern(problems) Traffic jam Congestion Long waiting time Energy efficiency
Idea
15 Copyright 2017 FUJITSU
Practice Singapore CoE (Centre of Excellence)
Collaborative research center (5 years since Oct 2014) Fujitsu Limited Agency for Science Technology and Research (ASTAR) Singapore Management University (SMU)
Objective Develop solutions that address urban challenges for sustainable urbanization
Projects
Dynamic Mobility Management
Maritime and Port Optimization
Large-scale Data Processing
Urban Computing Platform
16 Copyright 2017 FUJITSU
Congestion Relief Challenges in Singapore
17 Copyright 2017 FUJITSU
The world first attempt to alleviate congestion by inducing peoples behavior change with AI technology
Technology Dynamic Mobility Management
SPATIOWL
Retail data
Event data
Data collection (congestion situation etc)
Activity recommendation (via smartphone)
Location data
Transport data
BUS
TRAIN
What should I do before leaving AI
Distribute people into different time slots transport mode
Transport Hub Large-scale Facility
I want to avoid congestionhellip When should I leave Which transport mode should I take
TAXI
How about dropping by your favorite shop before leaving (you can get coupon )
Why donrsquot you take a uncongested train leaving 1 hour later
Dining
Dining incentive
Shopping incentive
18 Copyright 2017 FUJITSU
Scale model Simplified material
and structure Limited conditions
on wind wave etc No ocean current
Social Concern in Ship Design and Operation
Design performance (in tank)
Full scale Actual material
and structure Effects of
wind wave current etc
Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO
Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea
Increasing needs for more energy-efficient ship design and operation
Gap between
performances Actual and wide-ranged conditions
Artificial and limited experiments
Actual performance(at sea)
19 Copyright 2017 FUJITSU
Idea Routing System Configuration and Operation
Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes
If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves
Operational data
Weather prediction
Weather prediction
Recommended route
20 Copyright 2017 FUJITSU
Technology Accurate Ship Performance Estimation
Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models
Ship performances are visualized in various conditions and estimated for planned routes
Performance visualization
in various conditions
cargo weight
wind direction
wave direction
wave height
wind speed
Ship
p
erfo
rma
nce
current speed current
direction
aging
ship design H
igh
-dim
ensi
on
al
sta
tist
ica
l a
na
lysi
s
hellip
Performance estimation
on any planed routes
Calm condition
Current
Beam sea
Head sea
Head wind
Beam wind
21 Copyright 2017 FUJITSU
Practice Weather Routing Simulation
With the accurate ship performance optimal route reducing fuel consumption is calculated
by a weather routing simulation
Gathered operational data from Japanese maritime
shipping companies
Ship performance is estimated through actual ship operational data
22 Copyright 2017 FUJITSU
Sports
23 Copyright 2017 FUJITSU
Why Fujitsu is Developing the Scoring Gymnastics
Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing
technologies and broaden its application
Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring
24 Copyright 2017 FUJITSU
Social Concern Scoring Gymnastics
example of marking in a scoring sheet
Difficulties with scoring gymnastics One must cope with the techniques
becoming more and more complicated every year Scoring rules are modified once in every
4 years
Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets
25 Copyright 2017 FUJITSU
Idea Scoring-support System
Present State Our Goal Manual Scoring
3D Laser sensor
Recognition Result of posture and techniques are displayed
technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg
Scoring with the support by ICT
Scoring is becoming more and more difficult with its techniques increasingly more complicated
The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges
26 Copyright 2017 FUJITSU
Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time
of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus
maintaining its ability to seize key point precisely regardless of the distance
distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)
Lasre emission (START)
Detection (STOP)
ΔT
T
Target
2 次元 MEMSミラー
Detector Detctor
distance measuring
circuit
Lasre Emittor
Lasre Pulse Emission Controller
Emission Circuit
lens with adjustable
emission angle
reflection from the target
Seizing the posture of a person by measuring its key points location
Technology 3D Laser Sensor
Adjustable emission angle
Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications
27 Copyright 2017 FUJITSU
Technology Recognition of Posture and Techniques
Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo
Recognition results are utilized for evaluating the completeness of techniques
Copyright 2017 FUJITSU
Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
The Mechanism of Scoring Support System
Fitting the Skelton
Data Processing
Recognizing Elements
Scoring Support Application
Sensing the action
3D Laser Sensor
High-speed Data matching
Element Database
Storing Model data
Copyright 2017 FUJITSU
31 Copyright 2017 FUJITSU
The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics
Copyright 2017 FUJITSU
32 Copyright 2017 FUJITSU
Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration
Copyright 2017 FUJITSU
33 Copyright 2017 FUJITSU
技術説明
We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far
Copyright 2017 FUJITSU
34 Copyright 2017 FUJITSU
Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle
The Details of System Demonstration
Copyright 2017 FUJITSU
35 Copyright 2017 FUJITSU
Skill of technician or traditional dancer
Support for medical care handicapped people Sports
Fitness
Future Plans
36 Copyright 2017 FUJITSU
Robotics
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
11 Copyright 2017 FUJITSU
Practice with Customer (Koriyama City)
Gateway Box
Grating with water-level sensor
Sensor locations
Ochiaibori Storm Drain
① ②
③
Koriyama City Hall
Furukawa pumping station
Koriyama station
③
Succeeded in the real-time water-level measurement of the sewer pipe at heavy rain Detected a rapid water-level rise of 22 m (91 of full level) in only 20 min
Rainfall
Water-level
Water-level
Water-level
The water-level increased toward the downstream
The maximum rainfall intensity 78 mmh
The maximum rainfall intensity 48 mmh
Midstream
Downstream
Upstream
The maximum rainfall intensity 51 mmh
Full level of the pipe
Full level of the pipe
Full level of the pipe (5 m)
The lag time in upstream -downstream was about 15 minutes
After the rainfall the water-level was
the maximum in 15-30 minutes later
Wat
er-l
evel
(m
)
Rai
nfa
ll (m
mh
) 雨量
(m
mh
)
Wat
er-l
evel
(m
) W
ater
-lev
el (
m)
Rainfall
Rainfall
Rai
nfa
ll (m
mh
) R
ain
fall
(mm
h)
Time
Time
Time
①
②
③
12 Copyright 2017 FUJITSU
Business Start
Fujitsu BU decided to start business
Press release (Aug 2016)
13 Copyright 2017 FUJITSU
Mobility
14 Copyright 2017 FUJITSU
Social Concern and Future Mobility
Self-driving cars
Shared cars
Emerging transport System Ride sharing Car sharing
Self-driving Cars
Ship Performance Estimation
Dynamic Mobility Management
MaaS PF
M-IoT PF
Congestion Management
Customized Transportation
Measured rate Flat rate
Mobility service
Train Ship Aircraft Human
Concern(problems) Traffic jam Congestion Long waiting time Energy efficiency
Idea
15 Copyright 2017 FUJITSU
Practice Singapore CoE (Centre of Excellence)
Collaborative research center (5 years since Oct 2014) Fujitsu Limited Agency for Science Technology and Research (ASTAR) Singapore Management University (SMU)
Objective Develop solutions that address urban challenges for sustainable urbanization
Projects
Dynamic Mobility Management
Maritime and Port Optimization
Large-scale Data Processing
Urban Computing Platform
16 Copyright 2017 FUJITSU
Congestion Relief Challenges in Singapore
17 Copyright 2017 FUJITSU
The world first attempt to alleviate congestion by inducing peoples behavior change with AI technology
Technology Dynamic Mobility Management
SPATIOWL
Retail data
Event data
Data collection (congestion situation etc)
Activity recommendation (via smartphone)
Location data
Transport data
BUS
TRAIN
What should I do before leaving AI
Distribute people into different time slots transport mode
Transport Hub Large-scale Facility
I want to avoid congestionhellip When should I leave Which transport mode should I take
TAXI
How about dropping by your favorite shop before leaving (you can get coupon )
Why donrsquot you take a uncongested train leaving 1 hour later
Dining
Dining incentive
Shopping incentive
18 Copyright 2017 FUJITSU
Scale model Simplified material
and structure Limited conditions
on wind wave etc No ocean current
Social Concern in Ship Design and Operation
Design performance (in tank)
Full scale Actual material
and structure Effects of
wind wave current etc
Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO
Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea
Increasing needs for more energy-efficient ship design and operation
Gap between
performances Actual and wide-ranged conditions
Artificial and limited experiments
Actual performance(at sea)
19 Copyright 2017 FUJITSU
Idea Routing System Configuration and Operation
Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes
If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves
Operational data
Weather prediction
Weather prediction
Recommended route
20 Copyright 2017 FUJITSU
Technology Accurate Ship Performance Estimation
Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models
Ship performances are visualized in various conditions and estimated for planned routes
Performance visualization
in various conditions
cargo weight
wind direction
wave direction
wave height
wind speed
Ship
p
erfo
rma
nce
current speed current
direction
aging
ship design H
igh
-dim
ensi
on
al
sta
tist
ica
l a
na
lysi
s
hellip
Performance estimation
on any planed routes
Calm condition
Current
Beam sea
Head sea
Head wind
Beam wind
21 Copyright 2017 FUJITSU
Practice Weather Routing Simulation
With the accurate ship performance optimal route reducing fuel consumption is calculated
by a weather routing simulation
Gathered operational data from Japanese maritime
shipping companies
Ship performance is estimated through actual ship operational data
22 Copyright 2017 FUJITSU
Sports
23 Copyright 2017 FUJITSU
Why Fujitsu is Developing the Scoring Gymnastics
Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing
technologies and broaden its application
Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring
24 Copyright 2017 FUJITSU
Social Concern Scoring Gymnastics
example of marking in a scoring sheet
Difficulties with scoring gymnastics One must cope with the techniques
becoming more and more complicated every year Scoring rules are modified once in every
4 years
Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets
25 Copyright 2017 FUJITSU
Idea Scoring-support System
Present State Our Goal Manual Scoring
3D Laser sensor
Recognition Result of posture and techniques are displayed
technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg
Scoring with the support by ICT
Scoring is becoming more and more difficult with its techniques increasingly more complicated
The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges
26 Copyright 2017 FUJITSU
Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time
of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus
maintaining its ability to seize key point precisely regardless of the distance
distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)
Lasre emission (START)
Detection (STOP)
ΔT
T
Target
2 次元 MEMSミラー
Detector Detctor
distance measuring
circuit
Lasre Emittor
Lasre Pulse Emission Controller
Emission Circuit
lens with adjustable
emission angle
reflection from the target
Seizing the posture of a person by measuring its key points location
Technology 3D Laser Sensor
Adjustable emission angle
Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications
27 Copyright 2017 FUJITSU
Technology Recognition of Posture and Techniques
Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo
Recognition results are utilized for evaluating the completeness of techniques
Copyright 2017 FUJITSU
Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
The Mechanism of Scoring Support System
Fitting the Skelton
Data Processing
Recognizing Elements
Scoring Support Application
Sensing the action
3D Laser Sensor
High-speed Data matching
Element Database
Storing Model data
Copyright 2017 FUJITSU
31 Copyright 2017 FUJITSU
The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics
Copyright 2017 FUJITSU
32 Copyright 2017 FUJITSU
Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration
Copyright 2017 FUJITSU
33 Copyright 2017 FUJITSU
技術説明
We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far
Copyright 2017 FUJITSU
34 Copyright 2017 FUJITSU
Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle
The Details of System Demonstration
Copyright 2017 FUJITSU
35 Copyright 2017 FUJITSU
Skill of technician or traditional dancer
Support for medical care handicapped people Sports
Fitness
Future Plans
36 Copyright 2017 FUJITSU
Robotics
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
12 Copyright 2017 FUJITSU
Business Start
Fujitsu BU decided to start business
Press release (Aug 2016)
13 Copyright 2017 FUJITSU
Mobility
14 Copyright 2017 FUJITSU
Social Concern and Future Mobility
Self-driving cars
Shared cars
Emerging transport System Ride sharing Car sharing
Self-driving Cars
Ship Performance Estimation
Dynamic Mobility Management
MaaS PF
M-IoT PF
Congestion Management
Customized Transportation
Measured rate Flat rate
Mobility service
Train Ship Aircraft Human
Concern(problems) Traffic jam Congestion Long waiting time Energy efficiency
Idea
15 Copyright 2017 FUJITSU
Practice Singapore CoE (Centre of Excellence)
Collaborative research center (5 years since Oct 2014) Fujitsu Limited Agency for Science Technology and Research (ASTAR) Singapore Management University (SMU)
Objective Develop solutions that address urban challenges for sustainable urbanization
Projects
Dynamic Mobility Management
Maritime and Port Optimization
Large-scale Data Processing
Urban Computing Platform
16 Copyright 2017 FUJITSU
Congestion Relief Challenges in Singapore
17 Copyright 2017 FUJITSU
The world first attempt to alleviate congestion by inducing peoples behavior change with AI technology
Technology Dynamic Mobility Management
SPATIOWL
Retail data
Event data
Data collection (congestion situation etc)
Activity recommendation (via smartphone)
Location data
Transport data
BUS
TRAIN
What should I do before leaving AI
Distribute people into different time slots transport mode
Transport Hub Large-scale Facility
I want to avoid congestionhellip When should I leave Which transport mode should I take
TAXI
How about dropping by your favorite shop before leaving (you can get coupon )
Why donrsquot you take a uncongested train leaving 1 hour later
Dining
Dining incentive
Shopping incentive
18 Copyright 2017 FUJITSU
Scale model Simplified material
and structure Limited conditions
on wind wave etc No ocean current
Social Concern in Ship Design and Operation
Design performance (in tank)
Full scale Actual material
and structure Effects of
wind wave current etc
Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO
Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea
Increasing needs for more energy-efficient ship design and operation
Gap between
performances Actual and wide-ranged conditions
Artificial and limited experiments
Actual performance(at sea)
19 Copyright 2017 FUJITSU
Idea Routing System Configuration and Operation
Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes
If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves
Operational data
Weather prediction
Weather prediction
Recommended route
20 Copyright 2017 FUJITSU
Technology Accurate Ship Performance Estimation
Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models
Ship performances are visualized in various conditions and estimated for planned routes
Performance visualization
in various conditions
cargo weight
wind direction
wave direction
wave height
wind speed
Ship
p
erfo
rma
nce
current speed current
direction
aging
ship design H
igh
-dim
ensi
on
al
sta
tist
ica
l a
na
lysi
s
hellip
Performance estimation
on any planed routes
Calm condition
Current
Beam sea
Head sea
Head wind
Beam wind
21 Copyright 2017 FUJITSU
Practice Weather Routing Simulation
With the accurate ship performance optimal route reducing fuel consumption is calculated
by a weather routing simulation
Gathered operational data from Japanese maritime
shipping companies
Ship performance is estimated through actual ship operational data
22 Copyright 2017 FUJITSU
Sports
23 Copyright 2017 FUJITSU
Why Fujitsu is Developing the Scoring Gymnastics
Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing
technologies and broaden its application
Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring
24 Copyright 2017 FUJITSU
Social Concern Scoring Gymnastics
example of marking in a scoring sheet
Difficulties with scoring gymnastics One must cope with the techniques
becoming more and more complicated every year Scoring rules are modified once in every
4 years
Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets
25 Copyright 2017 FUJITSU
Idea Scoring-support System
Present State Our Goal Manual Scoring
3D Laser sensor
Recognition Result of posture and techniques are displayed
technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg
Scoring with the support by ICT
Scoring is becoming more and more difficult with its techniques increasingly more complicated
The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges
26 Copyright 2017 FUJITSU
Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time
of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus
maintaining its ability to seize key point precisely regardless of the distance
distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)
Lasre emission (START)
Detection (STOP)
ΔT
T
Target
2 次元 MEMSミラー
Detector Detctor
distance measuring
circuit
Lasre Emittor
Lasre Pulse Emission Controller
Emission Circuit
lens with adjustable
emission angle
reflection from the target
Seizing the posture of a person by measuring its key points location
Technology 3D Laser Sensor
Adjustable emission angle
Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications
27 Copyright 2017 FUJITSU
Technology Recognition of Posture and Techniques
Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo
Recognition results are utilized for evaluating the completeness of techniques
Copyright 2017 FUJITSU
Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
The Mechanism of Scoring Support System
Fitting the Skelton
Data Processing
Recognizing Elements
Scoring Support Application
Sensing the action
3D Laser Sensor
High-speed Data matching
Element Database
Storing Model data
Copyright 2017 FUJITSU
31 Copyright 2017 FUJITSU
The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics
Copyright 2017 FUJITSU
32 Copyright 2017 FUJITSU
Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration
Copyright 2017 FUJITSU
33 Copyright 2017 FUJITSU
技術説明
We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far
Copyright 2017 FUJITSU
34 Copyright 2017 FUJITSU
Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle
The Details of System Demonstration
Copyright 2017 FUJITSU
35 Copyright 2017 FUJITSU
Skill of technician or traditional dancer
Support for medical care handicapped people Sports
Fitness
Future Plans
36 Copyright 2017 FUJITSU
Robotics
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
13 Copyright 2017 FUJITSU
Mobility
14 Copyright 2017 FUJITSU
Social Concern and Future Mobility
Self-driving cars
Shared cars
Emerging transport System Ride sharing Car sharing
Self-driving Cars
Ship Performance Estimation
Dynamic Mobility Management
MaaS PF
M-IoT PF
Congestion Management
Customized Transportation
Measured rate Flat rate
Mobility service
Train Ship Aircraft Human
Concern(problems) Traffic jam Congestion Long waiting time Energy efficiency
Idea
15 Copyright 2017 FUJITSU
Practice Singapore CoE (Centre of Excellence)
Collaborative research center (5 years since Oct 2014) Fujitsu Limited Agency for Science Technology and Research (ASTAR) Singapore Management University (SMU)
Objective Develop solutions that address urban challenges for sustainable urbanization
Projects
Dynamic Mobility Management
Maritime and Port Optimization
Large-scale Data Processing
Urban Computing Platform
16 Copyright 2017 FUJITSU
Congestion Relief Challenges in Singapore
17 Copyright 2017 FUJITSU
The world first attempt to alleviate congestion by inducing peoples behavior change with AI technology
Technology Dynamic Mobility Management
SPATIOWL
Retail data
Event data
Data collection (congestion situation etc)
Activity recommendation (via smartphone)
Location data
Transport data
BUS
TRAIN
What should I do before leaving AI
Distribute people into different time slots transport mode
Transport Hub Large-scale Facility
I want to avoid congestionhellip When should I leave Which transport mode should I take
TAXI
How about dropping by your favorite shop before leaving (you can get coupon )
Why donrsquot you take a uncongested train leaving 1 hour later
Dining
Dining incentive
Shopping incentive
18 Copyright 2017 FUJITSU
Scale model Simplified material
and structure Limited conditions
on wind wave etc No ocean current
Social Concern in Ship Design and Operation
Design performance (in tank)
Full scale Actual material
and structure Effects of
wind wave current etc
Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO
Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea
Increasing needs for more energy-efficient ship design and operation
Gap between
performances Actual and wide-ranged conditions
Artificial and limited experiments
Actual performance(at sea)
19 Copyright 2017 FUJITSU
Idea Routing System Configuration and Operation
Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes
If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves
Operational data
Weather prediction
Weather prediction
Recommended route
20 Copyright 2017 FUJITSU
Technology Accurate Ship Performance Estimation
Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models
Ship performances are visualized in various conditions and estimated for planned routes
Performance visualization
in various conditions
cargo weight
wind direction
wave direction
wave height
wind speed
Ship
p
erfo
rma
nce
current speed current
direction
aging
ship design H
igh
-dim
ensi
on
al
sta
tist
ica
l a
na
lysi
s
hellip
Performance estimation
on any planed routes
Calm condition
Current
Beam sea
Head sea
Head wind
Beam wind
21 Copyright 2017 FUJITSU
Practice Weather Routing Simulation
With the accurate ship performance optimal route reducing fuel consumption is calculated
by a weather routing simulation
Gathered operational data from Japanese maritime
shipping companies
Ship performance is estimated through actual ship operational data
22 Copyright 2017 FUJITSU
Sports
23 Copyright 2017 FUJITSU
Why Fujitsu is Developing the Scoring Gymnastics
Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing
technologies and broaden its application
Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring
24 Copyright 2017 FUJITSU
Social Concern Scoring Gymnastics
example of marking in a scoring sheet
Difficulties with scoring gymnastics One must cope with the techniques
becoming more and more complicated every year Scoring rules are modified once in every
4 years
Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets
25 Copyright 2017 FUJITSU
Idea Scoring-support System
Present State Our Goal Manual Scoring
3D Laser sensor
Recognition Result of posture and techniques are displayed
technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg
Scoring with the support by ICT
Scoring is becoming more and more difficult with its techniques increasingly more complicated
The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges
26 Copyright 2017 FUJITSU
Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time
of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus
maintaining its ability to seize key point precisely regardless of the distance
distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)
Lasre emission (START)
Detection (STOP)
ΔT
T
Target
2 次元 MEMSミラー
Detector Detctor
distance measuring
circuit
Lasre Emittor
Lasre Pulse Emission Controller
Emission Circuit
lens with adjustable
emission angle
reflection from the target
Seizing the posture of a person by measuring its key points location
Technology 3D Laser Sensor
Adjustable emission angle
Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications
27 Copyright 2017 FUJITSU
Technology Recognition of Posture and Techniques
Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo
Recognition results are utilized for evaluating the completeness of techniques
Copyright 2017 FUJITSU
Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
The Mechanism of Scoring Support System
Fitting the Skelton
Data Processing
Recognizing Elements
Scoring Support Application
Sensing the action
3D Laser Sensor
High-speed Data matching
Element Database
Storing Model data
Copyright 2017 FUJITSU
31 Copyright 2017 FUJITSU
The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics
Copyright 2017 FUJITSU
32 Copyright 2017 FUJITSU
Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration
Copyright 2017 FUJITSU
33 Copyright 2017 FUJITSU
技術説明
We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far
Copyright 2017 FUJITSU
34 Copyright 2017 FUJITSU
Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle
The Details of System Demonstration
Copyright 2017 FUJITSU
35 Copyright 2017 FUJITSU
Skill of technician or traditional dancer
Support for medical care handicapped people Sports
Fitness
Future Plans
36 Copyright 2017 FUJITSU
Robotics
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
14 Copyright 2017 FUJITSU
Social Concern and Future Mobility
Self-driving cars
Shared cars
Emerging transport System Ride sharing Car sharing
Self-driving Cars
Ship Performance Estimation
Dynamic Mobility Management
MaaS PF
M-IoT PF
Congestion Management
Customized Transportation
Measured rate Flat rate
Mobility service
Train Ship Aircraft Human
Concern(problems) Traffic jam Congestion Long waiting time Energy efficiency
Idea
15 Copyright 2017 FUJITSU
Practice Singapore CoE (Centre of Excellence)
Collaborative research center (5 years since Oct 2014) Fujitsu Limited Agency for Science Technology and Research (ASTAR) Singapore Management University (SMU)
Objective Develop solutions that address urban challenges for sustainable urbanization
Projects
Dynamic Mobility Management
Maritime and Port Optimization
Large-scale Data Processing
Urban Computing Platform
16 Copyright 2017 FUJITSU
Congestion Relief Challenges in Singapore
17 Copyright 2017 FUJITSU
The world first attempt to alleviate congestion by inducing peoples behavior change with AI technology
Technology Dynamic Mobility Management
SPATIOWL
Retail data
Event data
Data collection (congestion situation etc)
Activity recommendation (via smartphone)
Location data
Transport data
BUS
TRAIN
What should I do before leaving AI
Distribute people into different time slots transport mode
Transport Hub Large-scale Facility
I want to avoid congestionhellip When should I leave Which transport mode should I take
TAXI
How about dropping by your favorite shop before leaving (you can get coupon )
Why donrsquot you take a uncongested train leaving 1 hour later
Dining
Dining incentive
Shopping incentive
18 Copyright 2017 FUJITSU
Scale model Simplified material
and structure Limited conditions
on wind wave etc No ocean current
Social Concern in Ship Design and Operation
Design performance (in tank)
Full scale Actual material
and structure Effects of
wind wave current etc
Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO
Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea
Increasing needs for more energy-efficient ship design and operation
Gap between
performances Actual and wide-ranged conditions
Artificial and limited experiments
Actual performance(at sea)
19 Copyright 2017 FUJITSU
Idea Routing System Configuration and Operation
Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes
If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves
Operational data
Weather prediction
Weather prediction
Recommended route
20 Copyright 2017 FUJITSU
Technology Accurate Ship Performance Estimation
Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models
Ship performances are visualized in various conditions and estimated for planned routes
Performance visualization
in various conditions
cargo weight
wind direction
wave direction
wave height
wind speed
Ship
p
erfo
rma
nce
current speed current
direction
aging
ship design H
igh
-dim
ensi
on
al
sta
tist
ica
l a
na
lysi
s
hellip
Performance estimation
on any planed routes
Calm condition
Current
Beam sea
Head sea
Head wind
Beam wind
21 Copyright 2017 FUJITSU
Practice Weather Routing Simulation
With the accurate ship performance optimal route reducing fuel consumption is calculated
by a weather routing simulation
Gathered operational data from Japanese maritime
shipping companies
Ship performance is estimated through actual ship operational data
22 Copyright 2017 FUJITSU
Sports
23 Copyright 2017 FUJITSU
Why Fujitsu is Developing the Scoring Gymnastics
Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing
technologies and broaden its application
Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring
24 Copyright 2017 FUJITSU
Social Concern Scoring Gymnastics
example of marking in a scoring sheet
Difficulties with scoring gymnastics One must cope with the techniques
becoming more and more complicated every year Scoring rules are modified once in every
4 years
Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets
25 Copyright 2017 FUJITSU
Idea Scoring-support System
Present State Our Goal Manual Scoring
3D Laser sensor
Recognition Result of posture and techniques are displayed
technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg
Scoring with the support by ICT
Scoring is becoming more and more difficult with its techniques increasingly more complicated
The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges
26 Copyright 2017 FUJITSU
Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time
of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus
maintaining its ability to seize key point precisely regardless of the distance
distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)
Lasre emission (START)
Detection (STOP)
ΔT
T
Target
2 次元 MEMSミラー
Detector Detctor
distance measuring
circuit
Lasre Emittor
Lasre Pulse Emission Controller
Emission Circuit
lens with adjustable
emission angle
reflection from the target
Seizing the posture of a person by measuring its key points location
Technology 3D Laser Sensor
Adjustable emission angle
Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications
27 Copyright 2017 FUJITSU
Technology Recognition of Posture and Techniques
Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo
Recognition results are utilized for evaluating the completeness of techniques
Copyright 2017 FUJITSU
Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
The Mechanism of Scoring Support System
Fitting the Skelton
Data Processing
Recognizing Elements
Scoring Support Application
Sensing the action
3D Laser Sensor
High-speed Data matching
Element Database
Storing Model data
Copyright 2017 FUJITSU
31 Copyright 2017 FUJITSU
The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics
Copyright 2017 FUJITSU
32 Copyright 2017 FUJITSU
Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration
Copyright 2017 FUJITSU
33 Copyright 2017 FUJITSU
技術説明
We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far
Copyright 2017 FUJITSU
34 Copyright 2017 FUJITSU
Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle
The Details of System Demonstration
Copyright 2017 FUJITSU
35 Copyright 2017 FUJITSU
Skill of technician or traditional dancer
Support for medical care handicapped people Sports
Fitness
Future Plans
36 Copyright 2017 FUJITSU
Robotics
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
15 Copyright 2017 FUJITSU
Practice Singapore CoE (Centre of Excellence)
Collaborative research center (5 years since Oct 2014) Fujitsu Limited Agency for Science Technology and Research (ASTAR) Singapore Management University (SMU)
Objective Develop solutions that address urban challenges for sustainable urbanization
Projects
Dynamic Mobility Management
Maritime and Port Optimization
Large-scale Data Processing
Urban Computing Platform
16 Copyright 2017 FUJITSU
Congestion Relief Challenges in Singapore
17 Copyright 2017 FUJITSU
The world first attempt to alleviate congestion by inducing peoples behavior change with AI technology
Technology Dynamic Mobility Management
SPATIOWL
Retail data
Event data
Data collection (congestion situation etc)
Activity recommendation (via smartphone)
Location data
Transport data
BUS
TRAIN
What should I do before leaving AI
Distribute people into different time slots transport mode
Transport Hub Large-scale Facility
I want to avoid congestionhellip When should I leave Which transport mode should I take
TAXI
How about dropping by your favorite shop before leaving (you can get coupon )
Why donrsquot you take a uncongested train leaving 1 hour later
Dining
Dining incentive
Shopping incentive
18 Copyright 2017 FUJITSU
Scale model Simplified material
and structure Limited conditions
on wind wave etc No ocean current
Social Concern in Ship Design and Operation
Design performance (in tank)
Full scale Actual material
and structure Effects of
wind wave current etc
Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO
Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea
Increasing needs for more energy-efficient ship design and operation
Gap between
performances Actual and wide-ranged conditions
Artificial and limited experiments
Actual performance(at sea)
19 Copyright 2017 FUJITSU
Idea Routing System Configuration and Operation
Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes
If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves
Operational data
Weather prediction
Weather prediction
Recommended route
20 Copyright 2017 FUJITSU
Technology Accurate Ship Performance Estimation
Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models
Ship performances are visualized in various conditions and estimated for planned routes
Performance visualization
in various conditions
cargo weight
wind direction
wave direction
wave height
wind speed
Ship
p
erfo
rma
nce
current speed current
direction
aging
ship design H
igh
-dim
ensi
on
al
sta
tist
ica
l a
na
lysi
s
hellip
Performance estimation
on any planed routes
Calm condition
Current
Beam sea
Head sea
Head wind
Beam wind
21 Copyright 2017 FUJITSU
Practice Weather Routing Simulation
With the accurate ship performance optimal route reducing fuel consumption is calculated
by a weather routing simulation
Gathered operational data from Japanese maritime
shipping companies
Ship performance is estimated through actual ship operational data
22 Copyright 2017 FUJITSU
Sports
23 Copyright 2017 FUJITSU
Why Fujitsu is Developing the Scoring Gymnastics
Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing
technologies and broaden its application
Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring
24 Copyright 2017 FUJITSU
Social Concern Scoring Gymnastics
example of marking in a scoring sheet
Difficulties with scoring gymnastics One must cope with the techniques
becoming more and more complicated every year Scoring rules are modified once in every
4 years
Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets
25 Copyright 2017 FUJITSU
Idea Scoring-support System
Present State Our Goal Manual Scoring
3D Laser sensor
Recognition Result of posture and techniques are displayed
technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg
Scoring with the support by ICT
Scoring is becoming more and more difficult with its techniques increasingly more complicated
The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges
26 Copyright 2017 FUJITSU
Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time
of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus
maintaining its ability to seize key point precisely regardless of the distance
distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)
Lasre emission (START)
Detection (STOP)
ΔT
T
Target
2 次元 MEMSミラー
Detector Detctor
distance measuring
circuit
Lasre Emittor
Lasre Pulse Emission Controller
Emission Circuit
lens with adjustable
emission angle
reflection from the target
Seizing the posture of a person by measuring its key points location
Technology 3D Laser Sensor
Adjustable emission angle
Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications
27 Copyright 2017 FUJITSU
Technology Recognition of Posture and Techniques
Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo
Recognition results are utilized for evaluating the completeness of techniques
Copyright 2017 FUJITSU
Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
The Mechanism of Scoring Support System
Fitting the Skelton
Data Processing
Recognizing Elements
Scoring Support Application
Sensing the action
3D Laser Sensor
High-speed Data matching
Element Database
Storing Model data
Copyright 2017 FUJITSU
31 Copyright 2017 FUJITSU
The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics
Copyright 2017 FUJITSU
32 Copyright 2017 FUJITSU
Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration
Copyright 2017 FUJITSU
33 Copyright 2017 FUJITSU
技術説明
We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far
Copyright 2017 FUJITSU
34 Copyright 2017 FUJITSU
Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle
The Details of System Demonstration
Copyright 2017 FUJITSU
35 Copyright 2017 FUJITSU
Skill of technician or traditional dancer
Support for medical care handicapped people Sports
Fitness
Future Plans
36 Copyright 2017 FUJITSU
Robotics
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
16 Copyright 2017 FUJITSU
Congestion Relief Challenges in Singapore
17 Copyright 2017 FUJITSU
The world first attempt to alleviate congestion by inducing peoples behavior change with AI technology
Technology Dynamic Mobility Management
SPATIOWL
Retail data
Event data
Data collection (congestion situation etc)
Activity recommendation (via smartphone)
Location data
Transport data
BUS
TRAIN
What should I do before leaving AI
Distribute people into different time slots transport mode
Transport Hub Large-scale Facility
I want to avoid congestionhellip When should I leave Which transport mode should I take
TAXI
How about dropping by your favorite shop before leaving (you can get coupon )
Why donrsquot you take a uncongested train leaving 1 hour later
Dining
Dining incentive
Shopping incentive
18 Copyright 2017 FUJITSU
Scale model Simplified material
and structure Limited conditions
on wind wave etc No ocean current
Social Concern in Ship Design and Operation
Design performance (in tank)
Full scale Actual material
and structure Effects of
wind wave current etc
Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO
Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea
Increasing needs for more energy-efficient ship design and operation
Gap between
performances Actual and wide-ranged conditions
Artificial and limited experiments
Actual performance(at sea)
19 Copyright 2017 FUJITSU
Idea Routing System Configuration and Operation
Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes
If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves
Operational data
Weather prediction
Weather prediction
Recommended route
20 Copyright 2017 FUJITSU
Technology Accurate Ship Performance Estimation
Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models
Ship performances are visualized in various conditions and estimated for planned routes
Performance visualization
in various conditions
cargo weight
wind direction
wave direction
wave height
wind speed
Ship
p
erfo
rma
nce
current speed current
direction
aging
ship design H
igh
-dim
ensi
on
al
sta
tist
ica
l a
na
lysi
s
hellip
Performance estimation
on any planed routes
Calm condition
Current
Beam sea
Head sea
Head wind
Beam wind
21 Copyright 2017 FUJITSU
Practice Weather Routing Simulation
With the accurate ship performance optimal route reducing fuel consumption is calculated
by a weather routing simulation
Gathered operational data from Japanese maritime
shipping companies
Ship performance is estimated through actual ship operational data
22 Copyright 2017 FUJITSU
Sports
23 Copyright 2017 FUJITSU
Why Fujitsu is Developing the Scoring Gymnastics
Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing
technologies and broaden its application
Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring
24 Copyright 2017 FUJITSU
Social Concern Scoring Gymnastics
example of marking in a scoring sheet
Difficulties with scoring gymnastics One must cope with the techniques
becoming more and more complicated every year Scoring rules are modified once in every
4 years
Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets
25 Copyright 2017 FUJITSU
Idea Scoring-support System
Present State Our Goal Manual Scoring
3D Laser sensor
Recognition Result of posture and techniques are displayed
technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg
Scoring with the support by ICT
Scoring is becoming more and more difficult with its techniques increasingly more complicated
The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges
26 Copyright 2017 FUJITSU
Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time
of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus
maintaining its ability to seize key point precisely regardless of the distance
distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)
Lasre emission (START)
Detection (STOP)
ΔT
T
Target
2 次元 MEMSミラー
Detector Detctor
distance measuring
circuit
Lasre Emittor
Lasre Pulse Emission Controller
Emission Circuit
lens with adjustable
emission angle
reflection from the target
Seizing the posture of a person by measuring its key points location
Technology 3D Laser Sensor
Adjustable emission angle
Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications
27 Copyright 2017 FUJITSU
Technology Recognition of Posture and Techniques
Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo
Recognition results are utilized for evaluating the completeness of techniques
Copyright 2017 FUJITSU
Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
The Mechanism of Scoring Support System
Fitting the Skelton
Data Processing
Recognizing Elements
Scoring Support Application
Sensing the action
3D Laser Sensor
High-speed Data matching
Element Database
Storing Model data
Copyright 2017 FUJITSU
31 Copyright 2017 FUJITSU
The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics
Copyright 2017 FUJITSU
32 Copyright 2017 FUJITSU
Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration
Copyright 2017 FUJITSU
33 Copyright 2017 FUJITSU
技術説明
We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far
Copyright 2017 FUJITSU
34 Copyright 2017 FUJITSU
Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle
The Details of System Demonstration
Copyright 2017 FUJITSU
35 Copyright 2017 FUJITSU
Skill of technician or traditional dancer
Support for medical care handicapped people Sports
Fitness
Future Plans
36 Copyright 2017 FUJITSU
Robotics
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
17 Copyright 2017 FUJITSU
The world first attempt to alleviate congestion by inducing peoples behavior change with AI technology
Technology Dynamic Mobility Management
SPATIOWL
Retail data
Event data
Data collection (congestion situation etc)
Activity recommendation (via smartphone)
Location data
Transport data
BUS
TRAIN
What should I do before leaving AI
Distribute people into different time slots transport mode
Transport Hub Large-scale Facility
I want to avoid congestionhellip When should I leave Which transport mode should I take
TAXI
How about dropping by your favorite shop before leaving (you can get coupon )
Why donrsquot you take a uncongested train leaving 1 hour later
Dining
Dining incentive
Shopping incentive
18 Copyright 2017 FUJITSU
Scale model Simplified material
and structure Limited conditions
on wind wave etc No ocean current
Social Concern in Ship Design and Operation
Design performance (in tank)
Full scale Actual material
and structure Effects of
wind wave current etc
Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO
Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea
Increasing needs for more energy-efficient ship design and operation
Gap between
performances Actual and wide-ranged conditions
Artificial and limited experiments
Actual performance(at sea)
19 Copyright 2017 FUJITSU
Idea Routing System Configuration and Operation
Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes
If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves
Operational data
Weather prediction
Weather prediction
Recommended route
20 Copyright 2017 FUJITSU
Technology Accurate Ship Performance Estimation
Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models
Ship performances are visualized in various conditions and estimated for planned routes
Performance visualization
in various conditions
cargo weight
wind direction
wave direction
wave height
wind speed
Ship
p
erfo
rma
nce
current speed current
direction
aging
ship design H
igh
-dim
ensi
on
al
sta
tist
ica
l a
na
lysi
s
hellip
Performance estimation
on any planed routes
Calm condition
Current
Beam sea
Head sea
Head wind
Beam wind
21 Copyright 2017 FUJITSU
Practice Weather Routing Simulation
With the accurate ship performance optimal route reducing fuel consumption is calculated
by a weather routing simulation
Gathered operational data from Japanese maritime
shipping companies
Ship performance is estimated through actual ship operational data
22 Copyright 2017 FUJITSU
Sports
23 Copyright 2017 FUJITSU
Why Fujitsu is Developing the Scoring Gymnastics
Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing
technologies and broaden its application
Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring
24 Copyright 2017 FUJITSU
Social Concern Scoring Gymnastics
example of marking in a scoring sheet
Difficulties with scoring gymnastics One must cope with the techniques
becoming more and more complicated every year Scoring rules are modified once in every
4 years
Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets
25 Copyright 2017 FUJITSU
Idea Scoring-support System
Present State Our Goal Manual Scoring
3D Laser sensor
Recognition Result of posture and techniques are displayed
technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg
Scoring with the support by ICT
Scoring is becoming more and more difficult with its techniques increasingly more complicated
The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges
26 Copyright 2017 FUJITSU
Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time
of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus
maintaining its ability to seize key point precisely regardless of the distance
distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)
Lasre emission (START)
Detection (STOP)
ΔT
T
Target
2 次元 MEMSミラー
Detector Detctor
distance measuring
circuit
Lasre Emittor
Lasre Pulse Emission Controller
Emission Circuit
lens with adjustable
emission angle
reflection from the target
Seizing the posture of a person by measuring its key points location
Technology 3D Laser Sensor
Adjustable emission angle
Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications
27 Copyright 2017 FUJITSU
Technology Recognition of Posture and Techniques
Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo
Recognition results are utilized for evaluating the completeness of techniques
Copyright 2017 FUJITSU
Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
The Mechanism of Scoring Support System
Fitting the Skelton
Data Processing
Recognizing Elements
Scoring Support Application
Sensing the action
3D Laser Sensor
High-speed Data matching
Element Database
Storing Model data
Copyright 2017 FUJITSU
31 Copyright 2017 FUJITSU
The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics
Copyright 2017 FUJITSU
32 Copyright 2017 FUJITSU
Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration
Copyright 2017 FUJITSU
33 Copyright 2017 FUJITSU
技術説明
We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far
Copyright 2017 FUJITSU
34 Copyright 2017 FUJITSU
Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle
The Details of System Demonstration
Copyright 2017 FUJITSU
35 Copyright 2017 FUJITSU
Skill of technician or traditional dancer
Support for medical care handicapped people Sports
Fitness
Future Plans
36 Copyright 2017 FUJITSU
Robotics
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
18 Copyright 2017 FUJITSU
Scale model Simplified material
and structure Limited conditions
on wind wave etc No ocean current
Social Concern in Ship Design and Operation
Design performance (in tank)
Full scale Actual material
and structure Effects of
wind wave current etc
Background Increase in fuel price (3X in 10 years) Restrictions on CO2 by IMO
Toward ship designoperation considering performance at sea Current designoperation is based on calm condition There is much room for considering a shiprsquos performance actually at sea
Increasing needs for more energy-efficient ship design and operation
Gap between
performances Actual and wide-ranged conditions
Artificial and limited experiments
Actual performance(at sea)
19 Copyright 2017 FUJITSU
Idea Routing System Configuration and Operation
Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes
If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves
Operational data
Weather prediction
Weather prediction
Recommended route
20 Copyright 2017 FUJITSU
Technology Accurate Ship Performance Estimation
Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models
Ship performances are visualized in various conditions and estimated for planned routes
Performance visualization
in various conditions
cargo weight
wind direction
wave direction
wave height
wind speed
Ship
p
erfo
rma
nce
current speed current
direction
aging
ship design H
igh
-dim
ensi
on
al
sta
tist
ica
l a
na
lysi
s
hellip
Performance estimation
on any planed routes
Calm condition
Current
Beam sea
Head sea
Head wind
Beam wind
21 Copyright 2017 FUJITSU
Practice Weather Routing Simulation
With the accurate ship performance optimal route reducing fuel consumption is calculated
by a weather routing simulation
Gathered operational data from Japanese maritime
shipping companies
Ship performance is estimated through actual ship operational data
22 Copyright 2017 FUJITSU
Sports
23 Copyright 2017 FUJITSU
Why Fujitsu is Developing the Scoring Gymnastics
Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing
technologies and broaden its application
Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring
24 Copyright 2017 FUJITSU
Social Concern Scoring Gymnastics
example of marking in a scoring sheet
Difficulties with scoring gymnastics One must cope with the techniques
becoming more and more complicated every year Scoring rules are modified once in every
4 years
Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets
25 Copyright 2017 FUJITSU
Idea Scoring-support System
Present State Our Goal Manual Scoring
3D Laser sensor
Recognition Result of posture and techniques are displayed
technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg
Scoring with the support by ICT
Scoring is becoming more and more difficult with its techniques increasingly more complicated
The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges
26 Copyright 2017 FUJITSU
Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time
of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus
maintaining its ability to seize key point precisely regardless of the distance
distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)
Lasre emission (START)
Detection (STOP)
ΔT
T
Target
2 次元 MEMSミラー
Detector Detctor
distance measuring
circuit
Lasre Emittor
Lasre Pulse Emission Controller
Emission Circuit
lens with adjustable
emission angle
reflection from the target
Seizing the posture of a person by measuring its key points location
Technology 3D Laser Sensor
Adjustable emission angle
Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications
27 Copyright 2017 FUJITSU
Technology Recognition of Posture and Techniques
Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo
Recognition results are utilized for evaluating the completeness of techniques
Copyright 2017 FUJITSU
Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
The Mechanism of Scoring Support System
Fitting the Skelton
Data Processing
Recognizing Elements
Scoring Support Application
Sensing the action
3D Laser Sensor
High-speed Data matching
Element Database
Storing Model data
Copyright 2017 FUJITSU
31 Copyright 2017 FUJITSU
The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics
Copyright 2017 FUJITSU
32 Copyright 2017 FUJITSU
Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration
Copyright 2017 FUJITSU
33 Copyright 2017 FUJITSU
技術説明
We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far
Copyright 2017 FUJITSU
34 Copyright 2017 FUJITSU
Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle
The Details of System Demonstration
Copyright 2017 FUJITSU
35 Copyright 2017 FUJITSU
Skill of technician or traditional dancer
Support for medical care handicapped people Sports
Fitness
Future Plans
36 Copyright 2017 FUJITSU
Robotics
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
19 Copyright 2017 FUJITSU
Idea Routing System Configuration and Operation
Fuel efficiency changes according to ship routes because wind resistance wave etc changes in each maritime area on the routes
If a routing system accurately recognizes a shiprsquos performance it can determine the most efficient route the shortest route or the longer route to avoid the wind and waves
Operational data
Weather prediction
Weather prediction
Recommended route
20 Copyright 2017 FUJITSU
Technology Accurate Ship Performance Estimation
Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models
Ship performances are visualized in various conditions and estimated for planned routes
Performance visualization
in various conditions
cargo weight
wind direction
wave direction
wave height
wind speed
Ship
p
erfo
rma
nce
current speed current
direction
aging
ship design H
igh
-dim
ensi
on
al
sta
tist
ica
l a
na
lysi
s
hellip
Performance estimation
on any planed routes
Calm condition
Current
Beam sea
Head sea
Head wind
Beam wind
21 Copyright 2017 FUJITSU
Practice Weather Routing Simulation
With the accurate ship performance optimal route reducing fuel consumption is calculated
by a weather routing simulation
Gathered operational data from Japanese maritime
shipping companies
Ship performance is estimated through actual ship operational data
22 Copyright 2017 FUJITSU
Sports
23 Copyright 2017 FUJITSU
Why Fujitsu is Developing the Scoring Gymnastics
Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing
technologies and broaden its application
Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring
24 Copyright 2017 FUJITSU
Social Concern Scoring Gymnastics
example of marking in a scoring sheet
Difficulties with scoring gymnastics One must cope with the techniques
becoming more and more complicated every year Scoring rules are modified once in every
4 years
Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets
25 Copyright 2017 FUJITSU
Idea Scoring-support System
Present State Our Goal Manual Scoring
3D Laser sensor
Recognition Result of posture and techniques are displayed
technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg
Scoring with the support by ICT
Scoring is becoming more and more difficult with its techniques increasingly more complicated
The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges
26 Copyright 2017 FUJITSU
Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time
of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus
maintaining its ability to seize key point precisely regardless of the distance
distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)
Lasre emission (START)
Detection (STOP)
ΔT
T
Target
2 次元 MEMSミラー
Detector Detctor
distance measuring
circuit
Lasre Emittor
Lasre Pulse Emission Controller
Emission Circuit
lens with adjustable
emission angle
reflection from the target
Seizing the posture of a person by measuring its key points location
Technology 3D Laser Sensor
Adjustable emission angle
Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications
27 Copyright 2017 FUJITSU
Technology Recognition of Posture and Techniques
Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo
Recognition results are utilized for evaluating the completeness of techniques
Copyright 2017 FUJITSU
Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
The Mechanism of Scoring Support System
Fitting the Skelton
Data Processing
Recognizing Elements
Scoring Support Application
Sensing the action
3D Laser Sensor
High-speed Data matching
Element Database
Storing Model data
Copyright 2017 FUJITSU
31 Copyright 2017 FUJITSU
The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics
Copyright 2017 FUJITSU
32 Copyright 2017 FUJITSU
Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration
Copyright 2017 FUJITSU
33 Copyright 2017 FUJITSU
技術説明
We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far
Copyright 2017 FUJITSU
34 Copyright 2017 FUJITSU
Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle
The Details of System Demonstration
Copyright 2017 FUJITSU
35 Copyright 2017 FUJITSU
Skill of technician or traditional dancer
Support for medical care handicapped people Sports
Fitness
Future Plans
36 Copyright 2017 FUJITSU
Robotics
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
20 Copyright 2017 FUJITSU
Technology Accurate Ship Performance Estimation
Statistical integrated models of all the factors are automatically learnt from operational data at sea without using physical models
Ship performances are visualized in various conditions and estimated for planned routes
Performance visualization
in various conditions
cargo weight
wind direction
wave direction
wave height
wind speed
Ship
p
erfo
rma
nce
current speed current
direction
aging
ship design H
igh
-dim
ensi
on
al
sta
tist
ica
l a
na
lysi
s
hellip
Performance estimation
on any planed routes
Calm condition
Current
Beam sea
Head sea
Head wind
Beam wind
21 Copyright 2017 FUJITSU
Practice Weather Routing Simulation
With the accurate ship performance optimal route reducing fuel consumption is calculated
by a weather routing simulation
Gathered operational data from Japanese maritime
shipping companies
Ship performance is estimated through actual ship operational data
22 Copyright 2017 FUJITSU
Sports
23 Copyright 2017 FUJITSU
Why Fujitsu is Developing the Scoring Gymnastics
Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing
technologies and broaden its application
Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring
24 Copyright 2017 FUJITSU
Social Concern Scoring Gymnastics
example of marking in a scoring sheet
Difficulties with scoring gymnastics One must cope with the techniques
becoming more and more complicated every year Scoring rules are modified once in every
4 years
Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets
25 Copyright 2017 FUJITSU
Idea Scoring-support System
Present State Our Goal Manual Scoring
3D Laser sensor
Recognition Result of posture and techniques are displayed
technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg
Scoring with the support by ICT
Scoring is becoming more and more difficult with its techniques increasingly more complicated
The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges
26 Copyright 2017 FUJITSU
Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time
of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus
maintaining its ability to seize key point precisely regardless of the distance
distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)
Lasre emission (START)
Detection (STOP)
ΔT
T
Target
2 次元 MEMSミラー
Detector Detctor
distance measuring
circuit
Lasre Emittor
Lasre Pulse Emission Controller
Emission Circuit
lens with adjustable
emission angle
reflection from the target
Seizing the posture of a person by measuring its key points location
Technology 3D Laser Sensor
Adjustable emission angle
Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications
27 Copyright 2017 FUJITSU
Technology Recognition of Posture and Techniques
Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo
Recognition results are utilized for evaluating the completeness of techniques
Copyright 2017 FUJITSU
Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
The Mechanism of Scoring Support System
Fitting the Skelton
Data Processing
Recognizing Elements
Scoring Support Application
Sensing the action
3D Laser Sensor
High-speed Data matching
Element Database
Storing Model data
Copyright 2017 FUJITSU
31 Copyright 2017 FUJITSU
The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics
Copyright 2017 FUJITSU
32 Copyright 2017 FUJITSU
Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration
Copyright 2017 FUJITSU
33 Copyright 2017 FUJITSU
技術説明
We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far
Copyright 2017 FUJITSU
34 Copyright 2017 FUJITSU
Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle
The Details of System Demonstration
Copyright 2017 FUJITSU
35 Copyright 2017 FUJITSU
Skill of technician or traditional dancer
Support for medical care handicapped people Sports
Fitness
Future Plans
36 Copyright 2017 FUJITSU
Robotics
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
21 Copyright 2017 FUJITSU
Practice Weather Routing Simulation
With the accurate ship performance optimal route reducing fuel consumption is calculated
by a weather routing simulation
Gathered operational data from Japanese maritime
shipping companies
Ship performance is estimated through actual ship operational data
22 Copyright 2017 FUJITSU
Sports
23 Copyright 2017 FUJITSU
Why Fujitsu is Developing the Scoring Gymnastics
Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing
technologies and broaden its application
Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring
24 Copyright 2017 FUJITSU
Social Concern Scoring Gymnastics
example of marking in a scoring sheet
Difficulties with scoring gymnastics One must cope with the techniques
becoming more and more complicated every year Scoring rules are modified once in every
4 years
Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets
25 Copyright 2017 FUJITSU
Idea Scoring-support System
Present State Our Goal Manual Scoring
3D Laser sensor
Recognition Result of posture and techniques are displayed
technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg
Scoring with the support by ICT
Scoring is becoming more and more difficult with its techniques increasingly more complicated
The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges
26 Copyright 2017 FUJITSU
Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time
of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus
maintaining its ability to seize key point precisely regardless of the distance
distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)
Lasre emission (START)
Detection (STOP)
ΔT
T
Target
2 次元 MEMSミラー
Detector Detctor
distance measuring
circuit
Lasre Emittor
Lasre Pulse Emission Controller
Emission Circuit
lens with adjustable
emission angle
reflection from the target
Seizing the posture of a person by measuring its key points location
Technology 3D Laser Sensor
Adjustable emission angle
Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications
27 Copyright 2017 FUJITSU
Technology Recognition of Posture and Techniques
Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo
Recognition results are utilized for evaluating the completeness of techniques
Copyright 2017 FUJITSU
Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
The Mechanism of Scoring Support System
Fitting the Skelton
Data Processing
Recognizing Elements
Scoring Support Application
Sensing the action
3D Laser Sensor
High-speed Data matching
Element Database
Storing Model data
Copyright 2017 FUJITSU
31 Copyright 2017 FUJITSU
The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics
Copyright 2017 FUJITSU
32 Copyright 2017 FUJITSU
Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration
Copyright 2017 FUJITSU
33 Copyright 2017 FUJITSU
技術説明
We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far
Copyright 2017 FUJITSU
34 Copyright 2017 FUJITSU
Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle
The Details of System Demonstration
Copyright 2017 FUJITSU
35 Copyright 2017 FUJITSU
Skill of technician or traditional dancer
Support for medical care handicapped people Sports
Fitness
Future Plans
36 Copyright 2017 FUJITSU
Robotics
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
22 Copyright 2017 FUJITSU
Sports
23 Copyright 2017 FUJITSU
Why Fujitsu is Developing the Scoring Gymnastics
Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing
technologies and broaden its application
Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring
24 Copyright 2017 FUJITSU
Social Concern Scoring Gymnastics
example of marking in a scoring sheet
Difficulties with scoring gymnastics One must cope with the techniques
becoming more and more complicated every year Scoring rules are modified once in every
4 years
Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets
25 Copyright 2017 FUJITSU
Idea Scoring-support System
Present State Our Goal Manual Scoring
3D Laser sensor
Recognition Result of posture and techniques are displayed
technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg
Scoring with the support by ICT
Scoring is becoming more and more difficult with its techniques increasingly more complicated
The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges
26 Copyright 2017 FUJITSU
Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time
of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus
maintaining its ability to seize key point precisely regardless of the distance
distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)
Lasre emission (START)
Detection (STOP)
ΔT
T
Target
2 次元 MEMSミラー
Detector Detctor
distance measuring
circuit
Lasre Emittor
Lasre Pulse Emission Controller
Emission Circuit
lens with adjustable
emission angle
reflection from the target
Seizing the posture of a person by measuring its key points location
Technology 3D Laser Sensor
Adjustable emission angle
Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications
27 Copyright 2017 FUJITSU
Technology Recognition of Posture and Techniques
Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo
Recognition results are utilized for evaluating the completeness of techniques
Copyright 2017 FUJITSU
Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
The Mechanism of Scoring Support System
Fitting the Skelton
Data Processing
Recognizing Elements
Scoring Support Application
Sensing the action
3D Laser Sensor
High-speed Data matching
Element Database
Storing Model data
Copyright 2017 FUJITSU
31 Copyright 2017 FUJITSU
The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics
Copyright 2017 FUJITSU
32 Copyright 2017 FUJITSU
Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration
Copyright 2017 FUJITSU
33 Copyright 2017 FUJITSU
技術説明
We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far
Copyright 2017 FUJITSU
34 Copyright 2017 FUJITSU
Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle
The Details of System Demonstration
Copyright 2017 FUJITSU
35 Copyright 2017 FUJITSU
Skill of technician or traditional dancer
Support for medical care handicapped people Sports
Fitness
Future Plans
36 Copyright 2017 FUJITSU
Robotics
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
23 Copyright 2017 FUJITSU
Why Fujitsu is Developing the Scoring Gymnastics
Scoring Supporting System is not our ultimate goal through its development we aim to improve our sensing
technologies and broaden its application
Challenging tasks with scoring gymnastics Recognition of complicated and high-speed movement Adaptation to fast-changing repertory of its techniques Securing fairness of its scoring
24 Copyright 2017 FUJITSU
Social Concern Scoring Gymnastics
example of marking in a scoring sheet
Difficulties with scoring gymnastics One must cope with the techniques
becoming more and more complicated every year Scoring rules are modified once in every
4 years
Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets
25 Copyright 2017 FUJITSU
Idea Scoring-support System
Present State Our Goal Manual Scoring
3D Laser sensor
Recognition Result of posture and techniques are displayed
technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg
Scoring with the support by ICT
Scoring is becoming more and more difficult with its techniques increasingly more complicated
The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges
26 Copyright 2017 FUJITSU
Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time
of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus
maintaining its ability to seize key point precisely regardless of the distance
distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)
Lasre emission (START)
Detection (STOP)
ΔT
T
Target
2 次元 MEMSミラー
Detector Detctor
distance measuring
circuit
Lasre Emittor
Lasre Pulse Emission Controller
Emission Circuit
lens with adjustable
emission angle
reflection from the target
Seizing the posture of a person by measuring its key points location
Technology 3D Laser Sensor
Adjustable emission angle
Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications
27 Copyright 2017 FUJITSU
Technology Recognition of Posture and Techniques
Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo
Recognition results are utilized for evaluating the completeness of techniques
Copyright 2017 FUJITSU
Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
The Mechanism of Scoring Support System
Fitting the Skelton
Data Processing
Recognizing Elements
Scoring Support Application
Sensing the action
3D Laser Sensor
High-speed Data matching
Element Database
Storing Model data
Copyright 2017 FUJITSU
31 Copyright 2017 FUJITSU
The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics
Copyright 2017 FUJITSU
32 Copyright 2017 FUJITSU
Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration
Copyright 2017 FUJITSU
33 Copyright 2017 FUJITSU
技術説明
We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far
Copyright 2017 FUJITSU
34 Copyright 2017 FUJITSU
Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle
The Details of System Demonstration
Copyright 2017 FUJITSU
35 Copyright 2017 FUJITSU
Skill of technician or traditional dancer
Support for medical care handicapped people Sports
Fitness
Future Plans
36 Copyright 2017 FUJITSU
Robotics
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
24 Copyright 2017 FUJITSU
Social Concern Scoring Gymnastics
example of marking in a scoring sheet
Difficulties with scoring gymnastics One must cope with the techniques
becoming more and more complicated every year Scoring rules are modified once in every
4 years
Conventional method bullScoring category of the techniques and its scoring are marked manually at scoring sheets
25 Copyright 2017 FUJITSU
Idea Scoring-support System
Present State Our Goal Manual Scoring
3D Laser sensor
Recognition Result of posture and techniques are displayed
technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg
Scoring with the support by ICT
Scoring is becoming more and more difficult with its techniques increasingly more complicated
The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges
26 Copyright 2017 FUJITSU
Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time
of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus
maintaining its ability to seize key point precisely regardless of the distance
distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)
Lasre emission (START)
Detection (STOP)
ΔT
T
Target
2 次元 MEMSミラー
Detector Detctor
distance measuring
circuit
Lasre Emittor
Lasre Pulse Emission Controller
Emission Circuit
lens with adjustable
emission angle
reflection from the target
Seizing the posture of a person by measuring its key points location
Technology 3D Laser Sensor
Adjustable emission angle
Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications
27 Copyright 2017 FUJITSU
Technology Recognition of Posture and Techniques
Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo
Recognition results are utilized for evaluating the completeness of techniques
Copyright 2017 FUJITSU
Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
The Mechanism of Scoring Support System
Fitting the Skelton
Data Processing
Recognizing Elements
Scoring Support Application
Sensing the action
3D Laser Sensor
High-speed Data matching
Element Database
Storing Model data
Copyright 2017 FUJITSU
31 Copyright 2017 FUJITSU
The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics
Copyright 2017 FUJITSU
32 Copyright 2017 FUJITSU
Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration
Copyright 2017 FUJITSU
33 Copyright 2017 FUJITSU
技術説明
We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far
Copyright 2017 FUJITSU
34 Copyright 2017 FUJITSU
Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle
The Details of System Demonstration
Copyright 2017 FUJITSU
35 Copyright 2017 FUJITSU
Skill of technician or traditional dancer
Support for medical care handicapped people Sports
Fitness
Future Plans
36 Copyright 2017 FUJITSU
Robotics
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
25 Copyright 2017 FUJITSU
Idea Scoring-support System
Present State Our Goal Manual Scoring
3D Laser sensor
Recognition Result of posture and techniques are displayed
technic xxxx right-elbow-angle 162deg left-elbow-angle 170deg right-knee angle 172deg left-knee angle 168deg
Scoring with the support by ICT
Scoring is becoming more and more difficult with its techniques increasingly more complicated
The recognition of each technic and its supplementary information is provided by the scoring supporting system Final scoring is decided by judges
26 Copyright 2017 FUJITSU
Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time
of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus
maintaining its ability to seize key point precisely regardless of the distance
distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)
Lasre emission (START)
Detection (STOP)
ΔT
T
Target
2 次元 MEMSミラー
Detector Detctor
distance measuring
circuit
Lasre Emittor
Lasre Pulse Emission Controller
Emission Circuit
lens with adjustable
emission angle
reflection from the target
Seizing the posture of a person by measuring its key points location
Technology 3D Laser Sensor
Adjustable emission angle
Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications
27 Copyright 2017 FUJITSU
Technology Recognition of Posture and Techniques
Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo
Recognition results are utilized for evaluating the completeness of techniques
Copyright 2017 FUJITSU
Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
The Mechanism of Scoring Support System
Fitting the Skelton
Data Processing
Recognizing Elements
Scoring Support Application
Sensing the action
3D Laser Sensor
High-speed Data matching
Element Database
Storing Model data
Copyright 2017 FUJITSU
31 Copyright 2017 FUJITSU
The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics
Copyright 2017 FUJITSU
32 Copyright 2017 FUJITSU
Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration
Copyright 2017 FUJITSU
33 Copyright 2017 FUJITSU
技術説明
We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far
Copyright 2017 FUJITSU
34 Copyright 2017 FUJITSU
Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle
The Details of System Demonstration
Copyright 2017 FUJITSU
35 Copyright 2017 FUJITSU
Skill of technician or traditional dancer
Support for medical care handicapped people Sports
Fitness
Future Plans
36 Copyright 2017 FUJITSU
Robotics
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
26 Copyright 2017 FUJITSU
Distance Measurement with Laser Pulse By measuring the period required for reflected laser pulse returning to the detector It is called Time
of Flight method (TOF method) emitted laser pulse Emission Range Control with MEMS (Micro Electro Mechanical Systems) System can adapt its emission rang based on the measured distance from the target thus
maintaining its ability to seize key point precisely regardless of the distance
distance between the target = (c X ΔT)2) (c means light speedcirca 300000kms)
Lasre emission (START)
Detection (STOP)
ΔT
T
Target
2 次元 MEMSミラー
Detector Detctor
distance measuring
circuit
Lasre Emittor
Lasre Pulse Emission Controller
Emission Circuit
lens with adjustable
emission angle
reflection from the target
Seizing the posture of a person by measuring its key points location
Technology 3D Laser Sensor
Adjustable emission angle
Our measuring human movement technology can be used not only for scoring gymnastics but also for other applications
27 Copyright 2017 FUJITSU
Technology Recognition of Posture and Techniques
Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo
Recognition results are utilized for evaluating the completeness of techniques
Copyright 2017 FUJITSU
Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
The Mechanism of Scoring Support System
Fitting the Skelton
Data Processing
Recognizing Elements
Scoring Support Application
Sensing the action
3D Laser Sensor
High-speed Data matching
Element Database
Storing Model data
Copyright 2017 FUJITSU
31 Copyright 2017 FUJITSU
The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics
Copyright 2017 FUJITSU
32 Copyright 2017 FUJITSU
Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration
Copyright 2017 FUJITSU
33 Copyright 2017 FUJITSU
技術説明
We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far
Copyright 2017 FUJITSU
34 Copyright 2017 FUJITSU
Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle
The Details of System Demonstration
Copyright 2017 FUJITSU
35 Copyright 2017 FUJITSU
Skill of technician or traditional dancer
Support for medical care handicapped people Sports
Fitness
Future Plans
36 Copyright 2017 FUJITSU
Robotics
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
27 Copyright 2017 FUJITSU
Technology Recognition of Posture and Techniques
Hybrid posture recognition technology Achieving highly accurate high-speed recognition of the joint position by combining the conventional modeling method with the newly developed ldquofitting methodrdquo
Recognition results are utilized for evaluating the completeness of techniques
Copyright 2017 FUJITSU
Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
The Mechanism of Scoring Support System
Fitting the Skelton
Data Processing
Recognizing Elements
Scoring Support Application
Sensing the action
3D Laser Sensor
High-speed Data matching
Element Database
Storing Model data
Copyright 2017 FUJITSU
31 Copyright 2017 FUJITSU
The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics
Copyright 2017 FUJITSU
32 Copyright 2017 FUJITSU
Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration
Copyright 2017 FUJITSU
33 Copyright 2017 FUJITSU
技術説明
We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far
Copyright 2017 FUJITSU
34 Copyright 2017 FUJITSU
Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle
The Details of System Demonstration
Copyright 2017 FUJITSU
35 Copyright 2017 FUJITSU
Skill of technician or traditional dancer
Support for medical care handicapped people Sports
Fitness
Future Plans
36 Copyright 2017 FUJITSU
Robotics
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
Our 3D laser sensor and data processing technologies find gymnasts joint position From that our system can identify which element is being performed in a routine
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
The Mechanism of Scoring Support System
Fitting the Skelton
Data Processing
Recognizing Elements
Scoring Support Application
Sensing the action
3D Laser Sensor
High-speed Data matching
Element Database
Storing Model data
Copyright 2017 FUJITSU
31 Copyright 2017 FUJITSU
The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics
Copyright 2017 FUJITSU
32 Copyright 2017 FUJITSU
Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration
Copyright 2017 FUJITSU
33 Copyright 2017 FUJITSU
技術説明
We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far
Copyright 2017 FUJITSU
34 Copyright 2017 FUJITSU
Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle
The Details of System Demonstration
Copyright 2017 FUJITSU
35 Copyright 2017 FUJITSU
Skill of technician or traditional dancer
Support for medical care handicapped people Sports
Fitness
Future Plans
36 Copyright 2017 FUJITSU
Robotics
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
3D sensing technologies capture gymnastrsquos performance in real time and create Difficulty Score sheet Just after the performance it automatically calculates the score for judges to confirm it
Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
The Mechanism of Scoring Support System
Fitting the Skelton
Data Processing
Recognizing Elements
Scoring Support Application
Sensing the action
3D Laser Sensor
High-speed Data matching
Element Database
Storing Model data
Copyright 2017 FUJITSU
31 Copyright 2017 FUJITSU
The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics
Copyright 2017 FUJITSU
32 Copyright 2017 FUJITSU
Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration
Copyright 2017 FUJITSU
33 Copyright 2017 FUJITSU
技術説明
We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far
Copyright 2017 FUJITSU
34 Copyright 2017 FUJITSU
Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle
The Details of System Demonstration
Copyright 2017 FUJITSU
35 Copyright 2017 FUJITSU
Skill of technician or traditional dancer
Support for medical care handicapped people Sports
Fitness
Future Plans
36 Copyright 2017 FUJITSU
Robotics
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
Copyright 2017 FUJITSU
The Mechanism of Scoring Support System
Fitting the Skelton
Data Processing
Recognizing Elements
Scoring Support Application
Sensing the action
3D Laser Sensor
High-speed Data matching
Element Database
Storing Model data
Copyright 2017 FUJITSU
31 Copyright 2017 FUJITSU
The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics
Copyright 2017 FUJITSU
32 Copyright 2017 FUJITSU
Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration
Copyright 2017 FUJITSU
33 Copyright 2017 FUJITSU
技術説明
We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far
Copyright 2017 FUJITSU
34 Copyright 2017 FUJITSU
Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle
The Details of System Demonstration
Copyright 2017 FUJITSU
35 Copyright 2017 FUJITSU
Skill of technician or traditional dancer
Support for medical care handicapped people Sports
Fitness
Future Plans
36 Copyright 2017 FUJITSU
Robotics
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
31 Copyright 2017 FUJITSU
The 81st FIG Congress in the presence of 117 member federations was held to make important decisions for the future of Gymnastics
Copyright 2017 FUJITSU
32 Copyright 2017 FUJITSU
Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration
Copyright 2017 FUJITSU
33 Copyright 2017 FUJITSU
技術説明
We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far
Copyright 2017 FUJITSU
34 Copyright 2017 FUJITSU
Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle
The Details of System Demonstration
Copyright 2017 FUJITSU
35 Copyright 2017 FUJITSU
Skill of technician or traditional dancer
Support for medical care handicapped people Sports
Fitness
Future Plans
36 Copyright 2017 FUJITSU
Robotics
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
32 Copyright 2017 FUJITSU
Fujitsu is now trying to develop scoring support system as ldquoBruno projectrdquo Today we will show a system demonstration
Copyright 2017 FUJITSU
33 Copyright 2017 FUJITSU
技術説明
We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far
Copyright 2017 FUJITSU
34 Copyright 2017 FUJITSU
Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle
The Details of System Demonstration
Copyright 2017 FUJITSU
35 Copyright 2017 FUJITSU
Skill of technician or traditional dancer
Support for medical care handicapped people Sports
Fitness
Future Plans
36 Copyright 2017 FUJITSU
Robotics
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
33 Copyright 2017 FUJITSU
技術説明
We are giving you the details of ldquoScoring Support System by 3D Sensingrdquo we have developed so far
Copyright 2017 FUJITSU
34 Copyright 2017 FUJITSU
Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle
The Details of System Demonstration
Copyright 2017 FUJITSU
35 Copyright 2017 FUJITSU
Skill of technician or traditional dancer
Support for medical care handicapped people Sports
Fitness
Future Plans
36 Copyright 2017 FUJITSU
Robotics
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
34 Copyright 2017 FUJITSU
Our system is identifying which element is being performed by this gymnast The system is obtaining numerical data of the performance and show it in real time Whereas before judges can view a performance from a single angle we now can do it from every angle
The Details of System Demonstration
Copyright 2017 FUJITSU
35 Copyright 2017 FUJITSU
Skill of technician or traditional dancer
Support for medical care handicapped people Sports
Fitness
Future Plans
36 Copyright 2017 FUJITSU
Robotics
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
35 Copyright 2017 FUJITSU
Skill of technician or traditional dancer
Support for medical care handicapped people Sports
Fitness
Future Plans
36 Copyright 2017 FUJITSU
Robotics
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
36 Copyright 2017 FUJITSU
Robotics
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
37 Copyright 2017 FUJITSU
What is a Robot Why We need Robots
Artificial intelligence is indispensable Autonomous action
Sensinginteraction with external worldpeople
Intelligent understanding simple instruction human intension
Values Efficient
Attractive
Connecting human and ICT
Environment
Action Sensing
Recognition Self-judgment AI
A machine that can move around a certain area for sensing some data and make a decision by processing it and do
some task in a given environment
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
38 Copyright 2017 FUJITSU
History of Robotics Research of FJ Lab 1980 -
Advanced Robot for the nuclear power
plant maintenance
Space Robot
1990 - 2000 -
Robot for Carrying Food Tray for Aged and
Disabled(lsquo98)
HOAP Miniature humanoid
Touch Ojisan Robot(99)
Space recognition technology (Autonomous movement)
MARON-1 Autonomous movement
by map matching and remote control from mobile phone
- 2020
Service Robot enon Autonomous locomotion
using 2D-SLAM
FA Robot
Kuma(bear) Biologicalfriendly interaction
Drone for Infrastructure check
using 3D-SLAM
Human-Robot interaction technology
Next-generation mobility service
Next-generation personal service
New services by networked robots Standalone typeRemote control type robot
Map linkage +
Parking lot control
Automated driving+
Automated parking
今からハワイへ
Zinrai (Interaction system)
Irsquom going to Hawaii from now
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
39 Copyright 2017 FUJITSU
Concept Mediator Robotics Service
Attractive simple advanced and efficient customer front services Each customer and ICT(Cloud Systems) connect in various places
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
40 Copyright 2017 FUJITSU
RoboPinrsquos features Expressive movements that convey emotion
RoboPin expresses itself using its whole body mapping 222 movements to an emotion space
Variegated voice that expresses feelings RoboPin expresses feelings with its voice through voice synthesis technology that can continuously regulate its tone of voice
SDK (Software Development Kit) We are preparing a SDK which makes easy to develop application Key factor is the conversion between emotional wards and combination of 222 basic movements and voice
222 richly expressive movements mapped to an emotion space
Sleepiness
Wakefulness
Happiness
Emotion space Unhappiness
Expresses feelings with voice synthesis that can control the tone
of its variegated voice
Irsquom not so goodhellip Irsquom great Irsquom sleepyhellip
Robotics Platform
Middleware (Soft)
API (Convert)
Application
SDK
Variegated Voice
Prototype ldquoRoboPinrdquo
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
41 Copyright 2017 FUJITSU
RoboPin Functions
Touch Sensor
Camera
Face LED
Right Arm Rotation 1 Motor
Body Movement 2 Motors
Finger LED
Head Movement 2 Motors
Left Arm Rotation 1 Motor
Touch Sensor
Human Detect Sensor
Sensors (Touch Camera Human Detect) LED Speaker 6 Motors Height300mm BasementΦ290times150mm
Speaker
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
42 Copyright 2017 FUJITSU
Practice Business Front Service
Anticipated Customers and Services Reception desk at a company service counter at public institution
over-the-counter-services at financial business etc
Efficiency and familiarity improvement
Personal services in sales tourism etc
Attracting customers giving information distributing questionnaires
Education in school personal lesson correspondence course
One-on-one teaching group study support
Private company Reception desk + Meeting room
Please come this way D E
A B C
Welcome to our company Mr A
Meeting room
Financial institutionrsquos counter Reception desk + Work with a teller
Confirms reservation ご用件 お名前
Tellerrsquos counter
Ms B has come
Teller
Welcome to our bank Ms B
Lobby
「Connect customers and ICT in various places」 Developing attractive simple and advanced customer front services
the reception desk at companies public institutions bank etc
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
43 Copyright 2017 FUJITSU
Summary
New business creation initiatives were introduced
If you are interested in todayrsquos topic business
technologies and so on please feel free to contact me
Ship Human
suzukishojijpfujitsucom
44 Copyright 2017 FUJITSU
44 Copyright 2017 FUJITSU