Layar Vision introductionfor developersGet more out of AR

October 2011

© Layar 2011

Contents

• Layar Vision overview

• Pricing

• Creating Layar Vision layers

• Developer support

© Layar 2011

Purpose

• The purpose of this presentation is to inform developers about the Layar Vision real-time image recognition capabilities

• We assume you have a basic understanding of Layar and layer creation. If you don’t, please refer to this presentation or visit www.layar.com for more information

© Layar 2011

Layar Visioncomputer vision-based detection, tracking and augmentation

of physical images & objects

© Layar 2011

Terminology• Computer vision: a wide range of technologies, algorithms and

approaches aimed at enabling computers to visually sense and interpret the physical world

• Image recognition: a general term for computer vision techniques designed to detect and match physical objects based on stored reference images

• Visual search: a form of image recognition where a still image from the client is uploaded for comparison and matching against a server-side database of reference images

© Layar 2011

Terminology

• Target object: the thing on your desk, the picture in the magazine, the street art outside. You can augment a wide range of physical items with ease.*

• Reference image: an image of the target object that is the base standard of comparison for the image recognition system.

• Fingerprint: a compact representation of the salient features and characteristics of a reference image, derived from analysis by image processing algorithms.

* Target objects with many visual details, angles, and contrast work best. Simple, rounded, low contrast targets and highly repetitive patterns are more difficult to recognize.

© Layar 2011

Terminology• GeoPOI: A point of interest with a specific latitude and

longitude associated with it. GeoPOIs are rendered in the Layar Browser and Player. The GeoPOI can be a real location or a relative location around the user.

• Layar Vision POI: a point of interest defined on a target object and detected by the Layar Vision system.

• Augment: the digital interpretation of a Layar Vision POI or a GeoPOI. It’s attached to a target object or GeoPOI location as seen through the lens of a mobile phone.

© Layar 2011

Layar Vision• Layar Vision is real-time, client-side image detection, tracking

and augmentation of physical images and objects

• Instantaneous detection of target objects from sets of up to 50 image fingerprints. New sets of fingerprints can be dynamically loaded.

• Robust tracking algorithm tolerates rotation, off-normal viewing, partial occlusion of target objects

• Wide range of augments available for Layar Vision POIs, using the full set of features for GeoPOIs of Layar 5.0

© Layar 2011

Layar Vision features• Layar 5.0 features enabled for GeoPOIs will also apply to LV POIs:

• Support for 3D models

• Support for animated augments

• Sharing to Facebook & Twitter

• Layer actions: call, email, share, web page, developer initiated actions

• Support for audio and video

• Autotriggered actions on objects

© Layar 2011

Layar Vision is part of the Layar platform

• Layar Vision POIs and layers are extensions to the existing Layar platform (clients, APIs, publishing service)

• LV layers and Geo layers coexist in the catalog

• LV POIs and GeoPOIs can coexist in the same layer

• Development process is very similar to what you’re used to

• Small API changes required to support the new features

© Layar 2011

Releases

• Layar Vision will be introduced across Layar’s product portfolio*:

• Layar Reality Browser 6.0 (iOS & Android)

• Layar Player 2.0 (iOS & Android)

• Layar Connect 2.0

* Please check www.layar.com for the availability dates of these releases

© Layar 2011

Developer API and Publishing Site• Addition of Layar Vision to layers

• Add augments, actions and intents to target objects

• Autotriggered actions and gaming elements to objects

• Geo-tag objects for location-based services and game play

• Integrate GeoPOIs and objects into one single layer

• Add multiple augments to a single object

• Controls to give your users hints and feedback to find augmented objects

© Layar 2011

Layar Vision in the LRB• Layar Reality Browser interface structure unchanged

• LV layers in the catalog alongside geo layers

• Visual search alongside text search to find and open layers

• AR view now scans continuously for target objects

• Layers include sets of image “fingerprints” for detection

• “Clue menu” can show thumbnails of augmented objects

© Layar 2011

How it works - developer• Developer uploads reference images of the objects to be

recognized, via the Layar Publishing Site

• Each reference image will get a unique ID

• When developing a layer, the developer can use these IDs to create the desired AR experience, by associating augments to the reference image IDs

• Each image is analyzed for its unique fingerprint which is uploaded to the client with the layer

© Layar 2011

How it works - user• When a user opens a Layar Vision layer (either through the

Layar Browser or the Layar Player), the image fingerprints corresponding to the reference image IDs for that layer will be loaded to the client

• The user can receive hints about augmented objects (configurable by the developer)

• When an object is detected and tracked, the associated augment is fetched from the server and rendered on top of the object

© Layar 2011

Feature tracking - flow

6. Feature set recognized

Third-party service provider

(developer/publisher)

1. Open/refresh layer

2. Return reference image ID(s)

Layar feature

repository

3. Get feature set(s) 4. Return feature set(s)

5. Scan for feature set(s)

Object7. Get augment(s)

8. Return augment(s) 9. Display augment(s)

© Layar 2011

Pricing

© Layar 2011

Pricing model

• With Layar Vision, Layar introduces a pricing model for developers and publishers based on usage of Layar Vision layers in the Layar Browser or Layar Player

• The Layar Player SDK remains free of charge for application developers to integrate into a mobile application

• The Layar Browser remains free to use for end users

© Layar 2011

Pricing

GeoLayar Vision

Layar Browser + Player

€ 0.01 per match per monthMonthly usage fee FREE

max € 1,000 per month

first 10,000 matches per month are FREE

Prices valid until May 1, 2012

© Layar 2011

Pricing explanation

• The Layar Browser and the Layar Player monthly usage fees are based on the number of object matches using Layar Vision

• An object match is counted for each target object that is successfully tracked and the associated content displayed to the user for at least 1 second

• The maximum usage fee per month is capped at € 1,000

• First 10,000 matches per month are free of charge

© Layar 2011

Pricing examples

Number of matches per month Usage fee per month5,000 €010,000 €015,000 €50

100,000 €900110,000 €1000200,000 €1000

1,000,000 €1000

© Layar 2011

Creating Layar Vision layers

© Layar 2011

Prerequisites

• Layar developer account

• Basic understanding of layer creation

• Layer service (public web server)

© Layar 2011

Creating Layar Vision layers

1. Enable a layer for image recognition

2. Upload reference image(s)

3. Add augments and actions

© Layar 2011

Step 1: Enable layer for Layar Vision

• You can enable a layer for Layar Vision when you create a new layer on the Layar Publishing Site

• You can also enable an existing layer for Layar Vision via the General tab on the Layar Publishing Site (note: API changes in Layar 6.0 may require modifications to older layers in this case)

© Layar 2011

Step 2: Uploading reference images

• When you have enabled a layer for Layar Vision, a place for uploading reference images will appear in Layar’s Publishing Site

• Here you can upload reference images of the target objects you want to augment

• Reference images can be uploaded independent from a layer

© Layar 2011

Step 3: Add augments and actions• In your layer service, associate the reference image IDs with the

augments and actions that you want to attach to the corresponding target objects

• Current features enabled for GeoPOIs can also be applied to objects

• A layer can contain both GeoPOIs and objects

• You can associate different augments and actions to the same reference image based on location

• You can choose to show visual clues to the user

© Layar 2011

Good and bad reference images

• When uploading reference images, you will receive feedback whether the reference image can be tracked or not

• Layar Vision works best on planar surfaces, like posters, billboards, flyers, book covers, CD covers, paintings, etc.

• The  surface has to have a certain amount of discriminative texture and details. Very simple/stylized logos, mainly uniformly coloured surfaces or repetitive patterns will be hard to track.

• Please refer to the Layar wiki for reference image best practices

© Layar 2011

Developer support

© Layar 2011

Developer support

• The following support resources provide a wealth of information for developers:

• Layar developer wiki

• Layar developer support environment

© Layar 2011

Testing environment

• Layar offers developers to test their layers before publishing:

• Through the API test page in the publishing platform

• Via the Layar app

• Layers in testing phase of development are only visible to the developer (when logged in with developer account)

(Click here for detailed instructions)

© Layar 2011

Developer support

© Layar 2011

Developer support

• The following support resources provide a wealth of information about Layar Vision for developers:

• Layar developer wiki

• Layar developer support environment

Thank you