Data Ninja Services - Incite West talk 2015

20
DATA NINJA Services Service Innovation Group DOCOMO Innovations, Inc. November 6, 2015 Copyright © DOCOMO Innovations, Inc. All Rights Reserved. @DataNinjaAPI

Transcript of Data Ninja Services - Incite West talk 2015

Page 1: Data Ninja Services - Incite West talk 2015

DATA NINJA Services Service Innovation Group

DOCOMO Innovations, Inc.

November 6, 2015

Copyright © DOCOMO Innovations, Inc. All Rights Reserved.

@DataNinjaAPI

Page 2: Data Ninja Services - Incite West talk 2015

NTT DOCOMO, Inc.

• Japan’s largest mobile phone operator

• 67M subscribers in Japan

• 46% are smart phones

Copyright © DOCOMO Innovations, Inc. All Rights Reserved.

4G subscribers 3G subscribers 2G subscribers

NTT DOCOMO mobile market share in Japan

Page 3: Data Ninja Services - Incite West talk 2015

DOCOMO Innovations, Inc.

• DOCOMO Innovations is a subsidiary of NTT DOCOMO

• We collaborate with business partners, research laboratories, start-ups

and engineers to develop innovative products and services

Copyright © DOCOMO Innovations, Inc. All Rights Reserved.

Page 4: Data Ninja Services - Incite West talk 2015

Data Ninja Team

• Formed in 2012 with 10+ researchers and technologists

– 7 members with Ph.D. degree

– 80+ years of combined experience with more than 50 patents and 120

peer-reviewed papers

– Diverse and extensive international large company and startup

experience

– Experts in data science and text analysis

Copyright © DOCOMO Innovations, Inc. All Rights Reserved.

Page 5: Data Ninja Services - Incite West talk 2015

Data Ninja Technologies,

Applications and Customers

• Technologies

– Natural Language Processing (NLP) and Machine Learning

– Large-scale Data Analytics and Cloud Computing

• Applications

– Personal voice assistants

– Personalization and Recommendation systems

– Car navigation assistants

– Automated text categorization system

• Customers

– Large enterprises including NTT DOCOMO, Toyota, Pioneer, Nissan and

FueTrek

– Companies utilizing analytics to enhance service offerings and effectively

provide relevant, appropriate and targeted content

Copyright © DOCOMO Innovations, Inc. All Rights Reserved.

Page 6: Data Ninja Services - Incite West talk 2015

Our mission is to enable companies of all sizes to build smart services

with content intelligence without building in-house advanced data

science and machine learning teams.

Data Ninja Mission

Copyright © DOCOMO Innovations, Inc. All Rights Reserved.

Smart Content Smart Sentiment

Smart Data Smart Learning

by

Page 7: Data Ninja Services - Incite West talk 2015

Content Intelligence Platform

Copyright © DOCOMO Innovations, Inc. All Rights Reserved.

Page 8: Data Ninja Services - Incite West talk 2015

Data Ninja API

Copyright © DOCOMO Innovations, Inc. All Rights Reserved.

Smart

Content

Smart

Data

Smart

Learning

Smart

Sentiment

REST API

public cloud or technology licensing API Endpoints

Smart Applications and Services

Unstructured

Data (text)

Structured Data

(Concepts, Categories and

Entities with Sentiments)

http://dataninja.net

Page 9: Data Ninja Services - Incite West talk 2015

Smart Content Overview

Smart Content service extracts meaningful categories,

concepts, entities and keywords from unstructured text for

broad use in analytics and data science applications.

Smart Content collects relevant data continually to add to its

knowledge-base.

Smart Content knowledge-base is extendable through its

configurable resource repository.

Copyright © DOCOMO Innovations, Inc. All Rights Reserved.

Page 10: Data Ninja Services - Incite West talk 2015

Smart Content Use Cases

Copyright © DOCOMO Innovations, Inc. All Rights Reserved.

Example Use Cases:

• Topic Detection and Tracking

• Concept-based Retrieval

• Image Recommendation for Online Publishing

• Contextual Music Recommendation

• Semantic Analysis of News Articles - demo

Page 11: Data Ninja Services - Incite West talk 2015

Smart Sentiment Service

Smart Sentiment assigns a positive, negative, neutral, or

“none” sentiment value to the content of a natural language

text document.

Sentiments are based on a weighted comparison of all words

denoting sentiment, such as “good”, “bad”, “lovely”,

“splendid”, etc.

Sentiments are assigned to each extracted entity (persons,

places, organizations, etc.).

Copyright © DOCOMO Innovations, Inc. All Rights Reserved.

Page 12: Data Ninja Services - Incite West talk 2015

Smart Sentiment Use Cases

Copyright © DOCOMO Innovations, Inc. All Rights Reserved.

Example Use Cases:

• Brand reputation analysis/monitoring

• Product sentiment around release date

• Product reviews

-1

-0.8

-0.6

-0.4

-0.2

0

0.2

0.4

Se

ntim

en

t

Date

Sentiment for entity “Volkswagen”

by

Page 13: Data Ninja Services - Incite West talk 2015

by

0

50

100

150

200

250

300

350

Nu

mb

er

of a

rtic

les

Date

Topic 2 Topic 3 Topic 6 Topic 10

Distribution of Articles by Date/Topics

Page 14: Data Ninja Services - Incite West talk 2015

-1

-0.8

-0.6

-0.4

-0.2

0

0.2

0.4

Se

ntim

en

t

Date

Sentiment for entity “Volkswagen”

Toyota sales fell 9 percent, Honda was

down 7 percent and Volkswagen brand

vehicles were down 8 percent.

German auto giant

Volkswagen posted a 2.8 per

cent decline …

Volkswagen’s finance chief Hans Dieter Poetsch is set to become its next chairman, putting

Europe’s biggest car maker on course for calmer waters after rival factions including ousted

patriarch Ferdinand Piech united to back him.

The U.S. Environmental Protection Agency said

Friday that Volkswagen intentionally skirted

clean air laws by using a piece of software that

enabled about 500,000 of its diesel cars to emit

fewer smog-causing pollutants during testing

than in real-world driving conditions.

The agency ordered VW to fix the cars at its

own expense.

by

Page 15: Data Ninja Services - Incite West talk 2015

by

-1

-0.8

-0.6

-0.4

-0.2

0

0.2

0.4

0.6S

en

tim

en

t

Date

Sentiment for Entity “HIV/AIDS”

“These are going to be eye-popping numbers,”

warned Edward Lanphier, chief executive of Sangamo

Bioscience Inc., a Richmond, Calif., gene therapy

company working on ways to modify a cell’s DNA at

specific locations to treat AIDS and other diseases.

“It’s going to take a shift away from traditional

business models toward a different kind of model.”

Page 16: Data Ninja Services - Incite West talk 2015

Smart Data Service

Smart Data service provides access to our knowledge graph

to complement the Smart Content service allowing

development of sophisticated data-science applications.

Copyright © DOCOMO Innovations, Inc. All Rights Reserved.

Page 17: Data Ninja Services - Incite West talk 2015

Smart Data Use Cases

Copyright © DOCOMO Innovations, Inc. All Rights Reserved.

• Concept & Category Contextual Search: Keyword suggestion &

expansion

• Related Concept Contextual Search

– Personalization by building user profiles based on browsing history

– Recommendation based on similar concepts

• Concept Popularity Lookup

– Smart search using concepts in addition to keywords to increase

accuracy

– Popularity-based disambiguation

– Trending visualization by finding trends of concepts and categories

for better decision making

• Smart Graph

– Generation of linguistics resources for domain-specific applications

• Induction Engine

– Discovery of hidden relationships among concepts to better reason

with text

Page 18: Data Ninja Services - Incite West talk 2015

Smart Learning Overview

Smart Learning service identifies the intent of a short piece of

text, such as natural-language request to perform some

action.

The service recognizes 30+ intent categories such as call

request, email, news, information seeking, play music,

transportation, schedule, shopping, take a photo, and similar.

Copyright © DOCOMO Innovations, Inc. All Rights Reserved.

Page 19: Data Ninja Services - Incite West talk 2015

Smart Learning Use Cases

Copyright © DOCOMO Innovations, Inc. All Rights Reserved.

Use Cases:

• Intelligent Personal Assistants such as Siri, Cortana,

and Google Now

• Car Navigation Assistants

• Intent identification and query extraction in mobile

apps

Example: “Find me Italian restaurant in Palo Alto.”

Task: Restaurant search

Target: Italian restaurant

Place: Palo Alto

Page 20: Data Ninja Services - Incite West talk 2015

Thank You!

Copyright © DOCOMO Innovations, Inc. All Rights Reserved.