Development of camera vision based yard monitoring system for

off-shore plant manufacturing

Byeong-Yeol Lee*, Tae-Hyun Baek, Kang-Yeol Lee, Seung-Jin Ha, Dae-Soon Kim

* : Head Researcher

Tel: 82-52-202-3208 Fax: 82-52-250-9587 E-mail : leeby@hhi.co.kr

Industrial Technology Institute, Hyundai Heavy Industries Co., Ltd.

Abstract

In the off-shore plant manufacturing process, many assembly blocks are handled in a

vast expense of yard. For the efficiency of block operation, yard monitoring is very

important. In this paper, a camera vision based yard monitoring system, using

augmented reality and image processing algorithms, is studied.

Keywords: offshore plant, stockyard operation, image processing, vision mining

-2/12- Hyundai Heavy Industries

1. Introduction

2. Background

3. Solution Approaches

4. Results

5. Conclusion

Contents

-3/12- Hyundai Heavy Industries

Introduction

• Hyundai Heavy Industry has successfully

completed more than 150 projects for the

oil and gas industry worldwide.

-4/12- Hyundai Heavy Industries

Hyundai Heavy Industry operates the world’s largest

stockyard, covering more than 250 acres

Offshore Plant Construction Projects are performed

concurrently

The overflow of modules and assembly blocks make

the main problems in yard management

Background

The Overview of Stockyard in Offshore & Engine Division

Efficiency Enhancement of Stockyard Operation is Required

-5/12- Hyundai Heavy Industries

Solution Approaches

Problem : Overflow of assembly blocks at the space limited stockyard

deteriorates the efficiency of stockyard operation

Approaches :

- CCR(Central Control Room) centered yard operation

- Real-time stock yard condition monitoring based

yard operation

Solution :

VSM(Vision-based Stockyard Monitoring) System

-6/12- Hyundai Heavy Industries

Concept of VSM

A system supplying quantified stockyard condition data

using surveillance camera images

Functions :

- VisionRuler : An approach to measuring the distance

- VisionMiner : An approach to identifying a block using

image processing method

Solution Approaches

-7/12- Hyundai Heavy Industries

*FOV: Field Of View)

**RES: Resolution

VisionRuler : An approach to measuring

the distance between specific points

Step 1 : Determine the position in camera coordinate

processing camera tilt parameter and camera image

Step 2 : Determine the position in stockyard coordinate

Step 3 : Calculate the distance between specific points

Solution Approaches

-8/12- Hyundai Heavy Industries

Solution Approaches

VisionMiner : An approach to identify an

assembly block using machine learning method

Step 1 : Separate block to ground

(Edge/Corner Detect Algorithm)

Step 2 : Generate a feature vector for the specific block

Step 3 : Match the feature to feature vector database

-9/12- Hyundai Heavy Industries

Result

The Result of distance measuring

Displaying stockyard data using augmented reality technology

-10/12- Hyundai Heavy Industries

Conclusion

VSM(Vision-based Stockyard Monitoring) system is

developed.

VisionRuler : An approach to measuring the distance on

the ground by mapping camera coordinate to yard coordinate.

VisionMiner : An approach to identifying a block using

image processing technology and machine learning.

(Under Development)

VSM can supply real-time stockyard condition

data to yard operators.

The efficiency of stockyard operation is enhanced.