Artificial Intelligence: Computer Vision

39
1 AI Wizards Artificial Intelligence: Computer Vision

Transcript of Artificial Intelligence: Computer Vision

Page 1: Artificial Intelligence: Computer Vision

1

AI WizardsArtificial Intelligence: Computer Vision

Page 2: Artificial Intelligence: Computer Vision

Our promise: Increasing productivity with fewer errors; increasing safety & security of your premises; understand your customers

We use CCTV feeds inside the premises to analyse asset and process deviation while mapping deviations

2

Our AI software can analyze anything that a CCTV camera can see/detect using “deep learning models”

Our software plugs into existing CCTVoutput to provide seamless monitoring

The software provides data for (a) realtime alerts (mishandling, fire,disturbances, process deviation etc.);and (b) analytical information(utilization, productivity, idle-time etc.)

Automatic alerts are sent on emails,SMS and push notifications whiledashboard are generated end of day onwhich periodic analysis is done toidentify trend-lines

Our Deep learning model works whilemaintaining complete IP secrecy as it isrun completely in on-premise mode

Page 3: Artificial Intelligence: Computer Vision

People behind the company

B.Tech., IIT Bombay with 15 years experience in industrial IOT, automation and

Machine Learning

Worked as chief integration architect at Antenna Software, integration specialist

at Oracle etc

B.Tech. + M.Tech., IIT Bombay and MBA, IIM Lucknow

15 years experience primarily in investment banking (YES Bank and Kotak

Securities) and private equity (ICICI Venture)

Been Board nominee of Indian and international companies as well

B.Tech., IIT Bombay with 15 years experience

Instrumental role in establishing OYO Rooms Western India operations

Serial entrepreneur with AIW being his third venture

Nitin Jain

Head - Operations

Job Philip

Head – Marketing

Kunal Kislay

Head - Technology

Page 4: Artificial Intelligence: Computer Vision

North America Europe APAC

Customers

Page 5: Artificial Intelligence: Computer Vision

Most of Retail Outlets, Manufacturing premises,Warehouses, Yards, Power Plants have CCTV Cameras formonitoring and surveillance

CCTVs are everywhere – do we use them effectively?

It is estimated that there are over 500 Million CCTV Camerastoday. The number is expected to be around 1B by end of2021

Page 6: Artificial Intelligence: Computer Vision

IOT HubTMS

Cache SQL NO SQL

GPU

RTMP, RTSP, HTTP, UDP etc.

Device Touchpoints

Business Layer

Presentation Layer

Web App Reporting Engine Native Mobile App

Polling Adapter

REST Adapter

SOAP Adapter

SAML Adapter

Notification Listener

Rule Engine MachineLearning

Real-time Location Engine

Authentication BusinessLogic

NotificationHub

JSON over MQTT

IOT Hub(Telemetry)

From Hub(Commands)

How does it work: Our solution architecture

6

ERP+

Page 7: Artificial Intelligence: Computer Vision

• MHE Utilization and Tracking• Vehicle/Truck Turn Around Time• Volume Calculation/ Pallet movement/ Packets

Counting• Personnel Utilization• Vehicle/Truck Turn Around Time• Dock Utilization

• Personnel Protective Equipment (PPE) compliance • SOP Compliance• Encroachment• MHE - Near miss• Presence of fire Extinguishers• Fire Detection• Person count in case of Fire Drill/Actual Fire• Ergonomics/SOP Adherence• Vehicle Speed/Vehicle Safety• Face Mask detection• Social Distancing• Temperature Monitoring

HSE Productivity Safety

Health and Safety Productivity

IRIS Use-cases

Security

• Human intrusion at periphery• Pilferage• Crowd formation• Unverified access in restricted areas• Facial recognition-based attendance• Access control through facial recognition

Page 8: Artificial Intelligence: Computer Vision

Health and Safety

View use case video

https://www.youtube.com/watch?v=4m01tWLnUZ0&feature=emb_logo

Page 9: Artificial Intelligence: Computer Vision

Personnel Protective Equipment complianceA

larm

can

be

rai

sed

in t

he

even

t o

f n

on

co

mp

lian

ce

Sup

po

rted

PP

E’s

Helmet, hair cap Safety glasses Safety shoes Face Masks Gloves Apron/Coveralls

Sample Videos – https://drive.google.com/open?id=1GyYm-lPqtj1UTZSQD8ZQG5Taa2shCwuI

Page 10: Artificial Intelligence: Computer Vision

Compliance

SOP Compliance Encroachment Fire Extinguishers Ergonomics

Sample Videos – https://drive.google.com/open?id=1PsuyrK-NltNpzMjnj9heQH3yBMiyLUsr

Need to ensure the presence of fire extinguishers in designated areas. When one is not located, an alarm is raised.

A virtual boundary is used to define encroachment free areas. Whenever the Camera detects individuals or objects placed in the encroachment free zone an alarm is raised.

Encroachment Fire Extinguishers Ergonomics

Ergonomics based compliance like proper bending while lifting heavy load, moving up the stairs without holding the rails etc. need to be adhered to and exceptions are captured by the system

Page 11: Artificial Intelligence: Computer Vision

Fire Detection/DrillA

larm

can

be

rai

sed

in t

he

even

t o

f fi

re o

r sm

oke

Sup

po

rted

PP

E’s

Fire detection in under 5 secsSeamless integration with

fire departmentInterface with hooters Long distance monitoring

Counting entry and exit of people in drills

Sample Videos – https://drive.google.com/open?id=1lW_KgzE2TdSu2JujS8GVVs2n0pfLQBnf

https://drive.google.com/open?id=1zFDtZ5Z7B4X9rPqLuWm0hb6M178gpkm9https://drive.google.com/open?id=1lW_KgzE2TdSu2JujS8GVVs2n0pfLQBnf

Page 12: Artificial Intelligence: Computer Vision

AI Powered Incident and Near Miss Management

Use

rs e

mp

ow

ered

pro

acti

ve a

pp

roac

h t

ow

ard

s H

SE u

sin

g A

I.

Identification of Near miss Notification Follow up CAPA

AI powered HSE application.

Incident

Near Miss

Accident

Report History

Notifications Guaranteed Delivery

AI Analytics Potential Hazards

Info

rmat

ive

| In

tera

ctiv

e |

Easy

to

Fo

llow

| S

imp

le a

pp

roac

h

Page 14: Artificial Intelligence: Computer Vision

Truck Space Utilization

Personnel Utilization

Load Preparation Area Utilization.

Truck TATForklift

UtilizationNear Misses Dock Utilization.

IRIS has the capability to interface with existing CCTV cameras to identify predefined scenarios and update enterprise systems

Truck Space Utilization Personnel Utilization Encroachment Truck Turn Around Time

Forklift Utilization Near Misses (Forklift Safety) Dock Utilization

IRIS has the capability to interface with existing CCTV cameras to identify predefined scenarios and update enterprise systems

Daily utilization and efficiency analytics for each warehouse.

IRIS for Warehouses/ Factories

Intrusion Detection

Page 15: Artificial Intelligence: Computer Vision

Defect Identification / Quality Control

A large FMCG player using IRIS AI to find out defects in Potato Chip during production and thereby accepting/ rejecting the potato lot

Page 16: Artificial Intelligence: Computer Vision

SOP/ Compliance Adherence

Real-time alerts on SOP deviations – For example

• Material mishandling

• Operator not following SOPs

• Safety Violations etc

Page 17: Artificial Intelligence: Computer Vision

Machine Utilization

Page 18: Artificial Intelligence: Computer Vision

Dock UtilizationR

olle

d u

p a

s w

ell a

s lo

w le

vel d

etai

ls a

vaila

ble

Sup

po

rted

PP

E’s

Utilization Loading time Unloading time Wait time Trip level details Truck level details

Sample Videos – https://drive.google.com/open?id=1r6q42T8fwbtUxqfYVLHDvTQBAw1PgYxJ

Page 19: Artificial Intelligence: Computer Vision

Personnel UtilizationR

olle

d u

p a

s w

ell a

s lo

w le

vel d

etai

ls a

vaila

ble

Sup

po

rted

PP

E’s

Utilization Loading time Unloading time Wait time Trip level details Truck level details

Sample Videos – https://drive.google.com/open?id=1dxZYL4P1x323YvkmBo6LLRg0aJ_Pv_YI

Page 20: Artificial Intelligence: Computer Vision

Truck TAT and Space UtilizationR

olle

d u

p a

s w

ell a

s lo

w le

vel d

etai

ls a

vaila

ble

Sup

po

rted

PP

E’s

Utilization Loading time Unloading time Wait time Trip level details Truck level details

Sample Videos –https://drive.google.com/open?id=1dxZYL4P1x323YvkmBo6LLRg0aJ_Pv_YI

Page 21: Artificial Intelligence: Computer Vision

Forklift/MHE utilizationR

olle

d u

p a

s w

ell a

s lo

w le

vel d

etai

ls a

vaila

ble

Sup

po

rted

PP

E’s

Distance Travelled Loaded Unloaded Utilization Number of pallets CBM Moved

Sample Videos –https://drive.google.com/drive/u/0/folders/1dxZYL4P1x323YvkmBo6LLRg0aJ_Pv_YI

Page 23: Artificial Intelligence: Computer Vision

Intrusion Detection

CCTV Based Intrusion Virtual Boundary Autonomous Drones Notifications

Sample Videos – https://drive.google.com/open?id=1PsuyrK-NltNpzMjnj9heQH3yBMiyLUsr

Autonomous drones get the intrusion co-ordinates from the CCTV feed and move to the location

CCTV Cameras detect individuals loitering around or trespassing virtual boundaries defined

CCTV Based Intrusion detection Autonomous Drones Notifications

Notifications with the image of the intruder is sent to the concerned autority

Page 24: Artificial Intelligence: Computer Vision

Facial Recognition based attendanceG

et p

ers

on

ne

l att

end

ance

th

rou

gh C

CTV

Cam

era

s

Sup

po

rted

PP

E’s

Attendance Access Control Unauthorized entry

Sample Videos –https://drive.google.com/open?id=1cioMj74vWzM0uhfF1ueskFJRgWo9nm6U

Page 25: Artificial Intelligence: Computer Vision

Other Solutions

• COVID Solution

• Retail Stores Use Cases

Page 26: Artificial Intelligence: Computer Vision

Covid-19: Govt’s SOP for workplace

Guidelines from various Govt include:

Social distancing

o Seating atleast six feet away on job sites in gathering, meetings and training sessions

o Large gatherings or meetings of 10 or more is discouraged

o Not more than 2/4 people in lift or hoists etc

Visitors’ monitoring

o Complete ban on non-essential visitors at offices / sites

Mandatory wearing of face masks

Temperature screening

Page 27: Artificial Intelligence: Computer Vision

Our solution: Based on your existing CCTV network

1. Real-time information

Real-time alerts via mobile notifications (SMS, Whatsapp,Call, E-mail) to the concerned manager or publicannouncement on speaker depending on the criticality ofbreach around

o Social distancing:

Large gatherings

Physical distance between two people

Unauthorized outside visitors etc

o Masks: Scanning of faces and alerts on people notwearing masks

Page 28: Artificial Intelligence: Computer Vision

Our solution: Based on your existing CCTV network (Cont’d.)

2. Actionable insights on dashboard

Dashboard access to senior management (over the internet)which includes:

o Image snapshot of all alerts / deviations with time-stamps:downloadable dataset

o Real-time score on Physical Distancing as an index

Allows to measure the compliance on guidelines as ascore

Page 29: Artificial Intelligence: Computer Vision

Our solution: Based on your existing CCTV network (Cont’d.)

3. Integrating with existing set-ups

We could also integrate with your existing set-ups that youmight have to provide a one-stop solution for Covid-19monitoring

o Interface with your thermal cameras, if any, forscreening of employees / visitors entering thepremises

If you don’t have thermal cameras, we couldinstall as well (third party cameras) and integratewith our AI solution for alerts / dashboard

o People with temperature over 990C could beidentified on real-time basis (automatedidentification) and further processed based onapplicable Govt rules

Page 30: Artificial Intelligence: Computer Vision

Assert video analytics: Examples of use case (Cont’d.)

Number plate and facial recognition

• On boarding employees/ workers on the platform

• Automatic attendance using face recognition solution

Face Recognition based Attendance

Page 31: Artificial Intelligence: Computer Vision

Other Solutions

• COVID Solution

• Retail Stores Use Cases

Page 32: Artificial Intelligence: Computer Vision

Retail Solution

Page 33: Artificial Intelligence: Computer Vision

Footfall

Page 34: Artificial Intelligence: Computer Vision

Demographics

Page 35: Artificial Intelligence: Computer Vision

Emotions

Page 36: Artificial Intelligence: Computer Vision

Heat Maps

Page 37: Artificial Intelligence: Computer Vision

Employee Productivity

Page 38: Artificial Intelligence: Computer Vision

Select retail client use-cases

Customer analysis including demographics, heat-map, dwell-time, repeat behavior etc

Employee SoP on greeting, counter manning, store opening and closing time etc

Real-time alerts on queue formation, wait-time etc

Drone based image taking which is analyzed by our AI for stock tracking

Reduces time, human intervention and thereby reducing cost and errors

Queue monitoring at the billing counter

Unmanned stores alerts for a fallen/trapped person

Unsupervised Children entering stores

Customer experience including turn-around time, wait-time, meeting and greeting etc

SoP adherences at collection center on sample collection, dress code, attendance etc

Queue formation at petrol pumps including lost sales analysis

Repeat customer analysis and analysis of type of vehicles (car, bus, taxi, bike etc)

Employee SoP around protective equipment wear, decantation process adherences etc.

Customer feedback through a thumbs up/thumbs down gesture

Additional service monitoring in premium outlets like windscreen wiping etc.

Customer analysis on repeat pattern, wait-time, peak-time etc

Dining areas: Opening and closing time, cleanliness, alignment of chairs / tables etc

Early fire warning (much before fire alarm) in the kitchen area

Page 39: Artificial Intelligence: Computer Vision

Dashboard