INCITE Overview April 13, 2010 HPC User Forum Julia C. White, INCITE Manager [email protected].
Data Ninja Services - Incite West talk 2015
-
Upload
data-ninja-api -
Category
Data & Analytics
-
view
113 -
download
3
Transcript of Data Ninja Services - Incite West talk 2015
DATA NINJA Services Service Innovation Group
DOCOMO Innovations, Inc.
November 6, 2015
Copyright © DOCOMO Innovations, Inc. All Rights Reserved.
@DataNinjaAPI
NTT DOCOMO, Inc.
• Japan’s largest mobile phone operator
• 67M subscribers in Japan
• 46% are smart phones
Copyright © DOCOMO Innovations, Inc. All Rights Reserved.
4G subscribers 3G subscribers 2G subscribers
NTT DOCOMO mobile market share in Japan
DOCOMO Innovations, Inc.
• DOCOMO Innovations is a subsidiary of NTT DOCOMO
• We collaborate with business partners, research laboratories, start-ups
and engineers to develop innovative products and services
Copyright © DOCOMO Innovations, Inc. All Rights Reserved.
Data Ninja Team
• Formed in 2012 with 10+ researchers and technologists
– 7 members with Ph.D. degree
– 80+ years of combined experience with more than 50 patents and 120
peer-reviewed papers
– Diverse and extensive international large company and startup
experience
– Experts in data science and text analysis
Copyright © DOCOMO Innovations, Inc. All Rights Reserved.
Data Ninja Technologies,
Applications and Customers
• Technologies
– Natural Language Processing (NLP) and Machine Learning
– Large-scale Data Analytics and Cloud Computing
• Applications
– Personal voice assistants
– Personalization and Recommendation systems
– Car navigation assistants
– Automated text categorization system
• Customers
– Large enterprises including NTT DOCOMO, Toyota, Pioneer, Nissan and
FueTrek
– Companies utilizing analytics to enhance service offerings and effectively
provide relevant, appropriate and targeted content
Copyright © DOCOMO Innovations, Inc. All Rights Reserved.
Our mission is to enable companies of all sizes to build smart services
with content intelligence without building in-house advanced data
science and machine learning teams.
Data Ninja Mission
Copyright © DOCOMO Innovations, Inc. All Rights Reserved.
Smart Content Smart Sentiment
Smart Data Smart Learning
by
Content Intelligence Platform
Copyright © DOCOMO Innovations, Inc. All Rights Reserved.
Data Ninja API
Copyright © DOCOMO Innovations, Inc. All Rights Reserved.
Smart
Content
Smart
Data
Smart
Learning
Smart
Sentiment
REST API
public cloud or technology licensing API Endpoints
Smart Applications and Services
Unstructured
Data (text)
Structured Data
(Concepts, Categories and
Entities with Sentiments)
http://dataninja.net
Smart Content Overview
Smart Content service extracts meaningful categories,
concepts, entities and keywords from unstructured text for
broad use in analytics and data science applications.
Smart Content collects relevant data continually to add to its
knowledge-base.
Smart Content knowledge-base is extendable through its
configurable resource repository.
Copyright © DOCOMO Innovations, Inc. All Rights Reserved.
Smart Content Use Cases
Copyright © DOCOMO Innovations, Inc. All Rights Reserved.
Example Use Cases:
• Topic Detection and Tracking
• Concept-based Retrieval
• Image Recommendation for Online Publishing
• Contextual Music Recommendation
• Semantic Analysis of News Articles - demo
Smart Sentiment Service
Smart Sentiment assigns a positive, negative, neutral, or
“none” sentiment value to the content of a natural language
text document.
Sentiments are based on a weighted comparison of all words
denoting sentiment, such as “good”, “bad”, “lovely”,
“splendid”, etc.
Sentiments are assigned to each extracted entity (persons,
places, organizations, etc.).
Copyright © DOCOMO Innovations, Inc. All Rights Reserved.
Smart Sentiment Use Cases
Copyright © DOCOMO Innovations, Inc. All Rights Reserved.
Example Use Cases:
• Brand reputation analysis/monitoring
• Product sentiment around release date
• Product reviews
-1
-0.8
-0.6
-0.4
-0.2
0
0.2
0.4
Se
ntim
en
t
Date
Sentiment for entity “Volkswagen”
by
by
0
50
100
150
200
250
300
350
Nu
mb
er
of a
rtic
les
Date
Topic 2 Topic 3 Topic 6 Topic 10
Distribution of Articles by Date/Topics
-1
-0.8
-0.6
-0.4
-0.2
0
0.2
0.4
Se
ntim
en
t
Date
Sentiment for entity “Volkswagen”
Toyota sales fell 9 percent, Honda was
down 7 percent and Volkswagen brand
vehicles were down 8 percent.
German auto giant
Volkswagen posted a 2.8 per
cent decline …
Volkswagen’s finance chief Hans Dieter Poetsch is set to become its next chairman, putting
Europe’s biggest car maker on course for calmer waters after rival factions including ousted
patriarch Ferdinand Piech united to back him.
The U.S. Environmental Protection Agency said
Friday that Volkswagen intentionally skirted
clean air laws by using a piece of software that
enabled about 500,000 of its diesel cars to emit
fewer smog-causing pollutants during testing
than in real-world driving conditions.
The agency ordered VW to fix the cars at its
own expense.
by
by
-1
-0.8
-0.6
-0.4
-0.2
0
0.2
0.4
0.6S
en
tim
en
t
Date
Sentiment for Entity “HIV/AIDS”
“These are going to be eye-popping numbers,”
warned Edward Lanphier, chief executive of Sangamo
Bioscience Inc., a Richmond, Calif., gene therapy
company working on ways to modify a cell’s DNA at
specific locations to treat AIDS and other diseases.
“It’s going to take a shift away from traditional
business models toward a different kind of model.”
Smart Data Service
Smart Data service provides access to our knowledge graph
to complement the Smart Content service allowing
development of sophisticated data-science applications.
Copyright © DOCOMO Innovations, Inc. All Rights Reserved.
Smart Data Use Cases
Copyright © DOCOMO Innovations, Inc. All Rights Reserved.
• Concept & Category Contextual Search: Keyword suggestion &
expansion
• Related Concept Contextual Search
– Personalization by building user profiles based on browsing history
– Recommendation based on similar concepts
• Concept Popularity Lookup
– Smart search using concepts in addition to keywords to increase
accuracy
– Popularity-based disambiguation
– Trending visualization by finding trends of concepts and categories
for better decision making
• Smart Graph
– Generation of linguistics resources for domain-specific applications
• Induction Engine
– Discovery of hidden relationships among concepts to better reason
with text
Smart Learning Overview
Smart Learning service identifies the intent of a short piece of
text, such as natural-language request to perform some
action.
The service recognizes 30+ intent categories such as call
request, email, news, information seeking, play music,
transportation, schedule, shopping, take a photo, and similar.
Copyright © DOCOMO Innovations, Inc. All Rights Reserved.
Smart Learning Use Cases
Copyright © DOCOMO Innovations, Inc. All Rights Reserved.
Use Cases:
• Intelligent Personal Assistants such as Siri, Cortana,
and Google Now
• Car Navigation Assistants
• Intent identification and query extraction in mobile
apps
Example: “Find me Italian restaurant in Palo Alto.”
Task: Restaurant search
Target: Italian restaurant
Place: Palo Alto
Thank You!
Copyright © DOCOMO Innovations, Inc. All Rights Reserved.