Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal...

51
Open Product Innovation Guenther Ruhe University of Calgary [email protected]

Transcript of Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal...

Page 1: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

Open Product Innovation

Guenther RuheUniversity of [email protected]

Page 2: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe

AGENDAAGENDA

Product Innovation Product Innovation

Open InnovationOpen Innovation

Open Product InnovationOpen Product Innovation

The Road AheadThe Road Ahead

SEKE 2015 2

Page 3: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe

Product Innovation – What do we Mean?

• A product innovation is a new technology or combination of technologies introduced commercially to meet a user or a market need (Utterback & Abernathy, 1975).

• Examples of product innovation might include – A new product's invention; technical specification and quality improvements made to a product; or 

– the inclusion of new components, materials or desirable functions into an existing product.

SEKE 2015 3

Page 4: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe

Product Innovation =Following AND Anticipating Customer Needs

• You can't just ask customers what they want and then try to give that to them. By the time you get it built, they'll want something new.”  (Steve Jobs)

• A product innovationis a new technology or combination of tech‐nologies introduced commercially to meet a stated or unstateduser or market need.

SEKE 2015 4

http://www.businessdictionary.com

Page 5: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe

The Many Facets of “Being New”

SEKE 2015 5

• New technology • New product line• New product features• New product design • New process• New service• New customers• New uses• New quality• New type of benefit

Page 6: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe

Product Success – What and How?

SEKE 2015 6

Page 7: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe

Success Based on Financial Performance*

SEKE 2015 7

*) Cooper & Kleinschmidt, Success Factors in Product Innovation, Industrial Marketing Management 16, 215‐223 (1987)

Components Impact

Having customers’ needs, wants, preferences and product requirements well defined prior to product development.

0.590

Introducing a superior product versus competitive products in the eyes of the customer.

0.556

Having strong synergy or fit between the needs of the project and management resources and skills.

0.466

Page 8: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe

Success Based on Market Impact

SEKE 2015 8

Components Impact

Introducing a superior product versus competitive products in the eyes of the customer.

0.304

Introducing a higher quality product than competitive products, however quality is defined.

0.299

Introducing a product that offered unique benefits to customers ‐ benefits not found in competitive products.

0.296

Page 9: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe

Success Based on Opportunity Window

SEKE 2015 9

Components Impact

Introducing a product which enabled the customer to perform a unique task. 0.421

Entering a market where customers’ needs and wants for products in this category were changing quickly.

0.345

Entering a product category or market that featured many other new product introductions.

0.331

Page 10: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther RuheSEKE 2015 10

Innovative product development: New ideas from leveraging external knowledge and resources, applying 

innovative processes and  technologies

Page 11: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe

AGENDAAGENDA

Product Innovation Product Innovation

Open InnovationOpen Innovation

Open Product InnovationOpen Product Innovation

The Road AheadThe Road Ahead

SEKE 2015 11

Page 12: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe

Open Innovation

• An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas into production processes. 

SEKE 2015 12

Chesbrough, H., “Open Innovation: The New Imperative for Creating and Profiting from Technology”, Harvard Business Press, 2003. 

Page 13: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe

Open Innovation for New Products

SEKE 2015 13

Page 14: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe

Analytical Open Innovation

• Open innovation from utilizing the power of analytics (processes, tools, knowledge, techniques, decisions).

SEKE 2015 14

Page 15: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe

Text mining

SEKE 2015 15

Patternmining

Predictivemodels

Cluster analysis

Statistical analysis

Simulation

Optimization

CrowdsouringAnalytical Kano model

Page 16: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther RuheSEKE 2015 16

What Counts is Insight … not Numbers* 

Don't show me what is;

show me what to do

What counts is insights,

not numbers!

Different problems

should yield

themselves to different 

solution

No distraction of software development but support

(makes it more efficient)

Generalizationsshould be viewed with a healthy 

skepticism

If you have certain patterns in mind, you will look for supportingevidence naturally. 

So ask for anti‐patterns!

Data, analyses, methods andresults haveto be publicly shared

We will be able to gaininsights fromthe past to improve thefuture

Data science should be about causation,

not correlation (watch for bias and confounding 

factors!

Your project has a history.Learn from it.Decide from it. Embrace it!

Underlying theoryneeds to inform the 

data analysis

SE data science should be actionable and reproducible.

We strive to 

do the best we canbut we accept that 

evidence may be incomplete, noisy, and even wrong

* Dagstuhl Seminar on Data Analytics, June 2014

Page 17: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe

AGENDAAGENDA

Product Innovation Product Innovation

Open InnovationOpen Innovation

Open Product InnovationOpen Product Innovation

The Road AheadThe Road Ahead

SEKE 2015 17

Page 18: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe

New Products – Data & Information Needs

SEKE 2015 18

Information needs

Type of release planning problem

Features

Feature de

pend

encies

Feature value

Cus

tom

er n

eeds

Stakeh

olde

r prio

rities 

User feedb

ack

Market trend

s

Cost

What to release × × × × × × ×

Theme based × × × × × × ×

When to release × × × × × × ×

Quality planning × × × × × × ×

Operational release planning × × ×

Consideration of technical debt × × × ×

Multiple products × × × × × × ×

Page 19: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

App’s Category

App’s Name

App’s Developer

Apps’ release date and price log and version number and  …

Apps rating

The Beautiful New World … of App Stores

SEKE 2015 19

Page 20: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther RuheSEKE 2015 20

Mining for Release Cycle Time Patterns 

Page 21: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther RuheSEKE 2015 21

Mining for Release Cycle Time Patterns 

Page 22: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe

Dataset: 6013 Apps from Android App Store

SEKE 2015 22

Redundent Records Incomplete Data One release only Two release The rest

Page 23: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe

Number of Releases vs App Rating 

SEKE 2015 23

H0: No relation between # of releases and rate 

?

Null Hypothesis is rejected!

Page 24: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe

# of Releases vs # of Installs 

SEKE 2015 24

H0: There is no relation between number of releases and # of installs 

Page 25: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe

In Search for Release Cycle Time Patterns

SEKE 2015 25

Patterns related to ‐ The length of release cycle times and their occurrence?‐ The nature of releases (corrective, adaptive, perfective, preventive)?

Page 26: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe

((XmY)nXlZO) p

“Y”, “X” and “Z” Patterns Hierarchy

SEKE 2015 26

(XmY)nZX

(XY)mZX

(ZXY)Xm

XmYXnZXo

XmYZ

XmZXnYX

XmZYX ZYX

XYXZXYZ

XYZX

XYZXY XYZY

XZYXm

XZYm

YXmZXn

YXmYZ YXZ

YZ(YXm)n

YZXY

YZXm

ZXmYn

ZXmY ZXYm

XZXmYn

YmXZ

XmZXnYlXo

(XmY)nZXYl XYZXmY

YmXnZXl

((XmY)nZ)l

((XmY)nZl)O

YmXnZ(YlXo)p

21

3 1 7

2118

21

1 1

2

11

1822

2

22

27

9 24

33

71

328

40

3

43

117

9

10 2

26

35

2

11

12

55

144

Page 27: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe

In Search for Release Cycle Time Patterns

SEKE 2015 27

Patterns related to ‐ The length of release cycle times and their occurrence‐ The nature of releases (corrective, adaptive, perfective, preventive)?

Page 28: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe

Open Product Innovation – Sample ResultsFrom (Android) app store mining: There exist release cycle time patterns associated with app ratings.

From text mining, Kano‐based crowdsourcing and optimization: New product (Super app) design.

Adaptive product development from incorporating usage data and user feedback.

Customized product development from clustering of user interests.

SEKE 2015 28

Page 29: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe

New Products – Data & Information Needs

SEKE 2015 29

Information needs

Type of release planning problem

Features

Feature de

pend

encies

Feature value

Cus

tom

er n

eeds

Stakeh

olde

r prio

rities 

User feedb

ack

Market trend

s

Cost

What to release × × × × × × ×

Theme based × × × × × × ×

When to release × × × × × × ×

Quality planning × × × × × × ×

Operational release planning × × ×

Consideration of technical debt × × × ×

Multiple products × × × × × × ×

Page 30: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther RuheSEKE 2015 30

Feature Prioritization: The Kano Model

Kano, N.; Seraku, N.; Takahashi, F.; Tsuji, S. (1984): Attractive quality and must-be quality, Journal of the Japanese Society for Quality Control (in Japanese) 14 (2), pp.39-48.

Approach Definition of Priority

Theory W Stakeholders perception of requirement priority

Quantitative win‐win Stakeholders perception of requirement priority

Priority Groups Stakeholders perception of requirement priority

Planning Game Value, risk, and effort defined by development team

100 Points Stakeholders perception of requirement priority

AHP Stakeholders pairwise comparison of value and cost of requirements

Value‐oriented prioritization Core value for a company

Page 31: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe 31SEKE 2015

Customer Satisfaction

Customer Dissatisfaction

NoImplementation

FullImplementation

Excite / DelightAttributes

Page 32: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe

OTT Services ‐ Kano Questionnaire 

SEKE 2015 32

How would you feel if “Support of Video‐on‐Demand (VOD)” was provided with this mobile app?

How would you feel if “Support of Video‐on‐Demand (VOD)” was NOT provided with this mobile app?

______ I like it that way ______ It must be that way ______ I'm indifferent ______ I can live with it that way ______ I dislike it that way 

______ I like it that way ______ It must be that way ______ I'm indifferent ______ I can live with it that way ______ I dislike it that way 

Functional formof the question

Dysfunctional formof the question

https://qtrial2014.az1.qualtrics.com/SE/?SID=SV_eeMrc9WjpFX6ZKd  

Page 33: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe

Kano Evaluation Table

SEKE 2015 33

Customer Requirements

Dysfunctional questions

Like Must‐be Neutral Live with Dislike

Functional questions

Like Q A A A O

Must‐be R I I I M

Neutral R I I I M

Live with R I I I M

Dislike R R R R Q

Must‐be (M) One‐Dimensional (O) Attractive (A)        Indifferent (I)Reverse (R) Questionable (Q) 

Page 34: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther RuheSEKE 2015 34

ServiceID ServiceS1 Live channel coverages2 MultiscreenS3 Switch displayS4 Aspect ratio changeS5 EPGS6 Remote controlS7 Support without touch screenS8 Video on demandS9 Youtube integrationS10 Source signal selectionS11 Variety of product usage model supportS12 AdvertisementS13 ArchiveS14 SearchS15 Intuitive navigationS16 Detect locationS17 BookmarkingS18 CategorizationS19 Triple playS20 Social network accessibilityS21 PlaylistS22 HistoryS23 MulticastS24 Different views supportabilityS25 ReplayS26 Instant streamingS27 DRMS28 Memory managementS29 Player integrationS30 Variety of quality supportS31 Parental controlS32 Channel previewS33 Picture‐in‐pictureS34 Peer‐to‐peer wireless screen casting supportS35 Video recommendationS36 Share content

Page 35: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe

Perceived Value from Stakeholders 

SEKE 2015 35

Page 36: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe

Perceived Value from Kano Crowdsourcing 

SEKE 2015 36

Page 37: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe

New Product (Super App) Design

SEKE 2015 37

M O A R I

1 1 3 1 3

{S1,S2,S3,S4,S5,S6,S7,S14,S19,S21,S22,S23,S25,S28,S32}

Value Effort

4506 261

M O A R I

2 2 1 2 0

{S4,S10,S11,S14,S20,S26,S27}

Value Effort

1570 261

Page 38: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe

Open Product Innovation – Sample Results

From (Android) app store mining: There exist release cycle time patterns associated with app ratings.

From text mining, Kano‐based crowdsourcing and optimization: New product (Super app) design.

Adaptive product development from incorporating usage data and user feedback.

Customized product development from clustering of user interests.

SEKE 2015 38

Page 39: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe

Monitoring Usage of Features 

SEKE 2015 39

Page 40: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe

Usage Feedback Analytics

SEKE 2015 40

Page 41: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther RuheSEKE 2015 41

D. Pagano, W.  Maakej: User Feedback in the AppStore: An Empirical Study, RE 2013

# topic Ø rating rating distribution

Ø sample rating 4.08

19 noise 3.67

18 recommendation 4.8812 helpfulness 4.8513 feature info. 4.81

117 how to 4.8011 praise 4.78

111 content request 4.25

114 improvement. requ. 3.9217 other app 3.9118 feature request 3.89

116 other feedback 3.67113 question 2.89112 promise 2.2714 shortcoming 2.10

115 dispraise 1.6915 bug report 1.84

110 dissuasion 1.39

4 STARS

5 STARS

2 STARS

3 STARS

1 STAR

Page 42: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe

Open Product Innovation – Sample Results

From (Android) app store mining: There exist release cycle time patterns associated with app ratings.

From text mining, Kano‐based crowdsourcing and optimization: New product (Super app) design.

Adaptive product development from incorporating (real‐time) usage data and user feedback.

Customized product development from clustering of user interests.

SEKE 2015 42

Page 43: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther RuheSEKE 2015 43

1

2

ClustersClusters

Customized  product 

development (1/2)

Having two cluster of customers

Having six clusters of customers

Page 44: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe

Customized  product 

development (2/2)

SEKE 2015 44

Page 45: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe

Open Product Innovation – Sample ResultsFrom (Android) app store mining: There exist release cycle time patterns associated with app ratings.

From text mining, Kano‐based crowdsourcing and optimization: New product (Super app) design.

Adaptive product development from incorporating (real‐time) usage data and user feedback.

Customized product development from clustering of user interests.

SEKE 2015 45

Page 46: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe

AGENDAAGENDA

Product Innovation Product Innovation

Open InnovationOpen Innovation

Open Product InnovationOpen Product Innovation

The Road AheadThe Road Ahead

SEKE 2015 46

Page 47: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther RuheSEKE 2015 47

Open Innovation for New Products  Kano‐based Crowdsourcing 

New Product (Super App) Design  Real‐time Usage and User Feedback 

Page 48: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther RuheSEKE 2015 48

Crossing the Chasm 

Page 49: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas
Page 50: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe

References

SEKE 2015 50

[1] Nayebi, M and Ruhe, G (2015), “Analytical Product Release Planning”, In: The Art and Science of Analyzing Software Data: Analysis Patterns”, C. Bird, T. Menzies, and T. Zimmermann (eds.), Kaufman & Morgan 2015.

[2] Nayebi, M (2014), “Mining Release Cycles in the Android App Store”, 36th CREST Open Workshop on App Store Analysis, London.

[3] Workshop on Data Analytics, Dagstuhl, June 2014.

[4] Chesbrough, H, “Open Innovation: The New Imperative for Creating and Profiting from Technology”, Harvard Business Press, 2003. 

[5] Maalej, W, Nayebi, M, Johann, T and Ruhe, G, “Towards Data‐Driven Requirements Engineering”, submitted to IEEE Software (2015).

[6] Mao K, Capra L, Harman M and Jia Y, “A Survey of the Use of Crowdsourcing in Software Engineering”, accepted for TSE 2015.

Page 51: Open Product Innovation - IPageOpen Innovation • An (open) approach for integration of internal and external ideas and paths to market that merges distributed knowledge and ideas

©Guenther Ruhe

Acknowledgements

‐ Maleknaz Nayebi from Software Engineering Decision Support Laboratory at U of Calgary.

‐ Ongoing collaborations with Bram Adams (Montreal) and Walid Maalej (Hamburg).

‐ NSERC: This research was partially supported by NSERC Discovery Grant 250343‐12.

SEKE 2015 51