Conducting Design Science Conducting Design Science Research in IT: Introduction
Vijay K. Vaishnavij y K.
OutlineOutlineOverview of Design Science Research (DSR)Phil hi l G di f DSRPhilosophical Grounding of DSRDSR MethodologyAn Example of DSRAn Example of DSRDesign Science Research versus DesignConclusions
1/12/2011© Vijay K. Vaishnavi
Research related termsResearch related termsResearch: an activity that ycontributes to the understanding of a phenomenonPh t f b h i f Phenomenon: a set of behaviors of some entity(ies) that is found interesting by the researcher or by a
• Overview of DSR• Philosophical G d f DSR interesting by the researcher or by a
research communityUnderstanding: knowledge that allows
d f h b h f
Grounding of DSR• DSR Methodology• An Example of DSR • Design Science prediction of the behavior of some
aspect of the phenomenonDesign Science
Research versus Design• Conclusions
1/12/2011© Vijay K. Vaishnavi
Research related terms (2)Research related terms (2)Research Methods: The set of Research Methods: The set of activities a research community considers appropriate to the production of knowledgeParadigmatic Community: Having
l i s l m t th
• Overview of DSR• Philosophical G d f DSR nearly universal agreement on the
phenomenon of interest and the research methods for investigating
Grounding of DSR• DSR Methodology• An Example of DSR • Design Science r r m f r n g ng
itDesign Science
Research versus Design• Conclusions
1/12/2011© Vijay K. Vaishnavi
Research related terms (3)Research related terms (3)Pre-Paradigmatic or Multi-gParadigmatic Research Community: Bound into a nominal community by overlap in sets of phenomena of interest overlap in sets of phenomena of interest and/or overlap in methods of investigation
• Overview of DSR• Philosophical G d f DSR
gInformation Technology/ Computer Science/ Information Systems, Biotechnology Examples of multi
Grounding of DSR• DSR Methodology• An Example of DSR • Design Science Biotechnology – Examples of multi-
paradigmatic communitiesDesign Science
Research versus Design• Conclusions
1/12/2011© Vijay K. Vaishnavi
Design related terms D g m
Design: “Inventing things which do not yet g g g yexist” (Gregory, 1966)Design Science: “Organized, rational, and
h ll s st m tic ppr ch t d si n; n t wholly systematic approach to design; not just the utilization of scientific knowledge of artifacts, but design in some sense as a
• Overview of DSR• Philosophical G d f DSR scientific activity itself” (Cross, 2001).
Science of Design: “A federation of sub-disciplines having design as the subject of
Grounding of DSR• DSR Methodology• An Example of DSR • Design Science disciplines having design as the subject of
their cognitive interests” (Cross, 2001).Design Science
Research versus Design• Conclusions
1/12/2011© Vijay K. Vaishnavi
Design related terms (2) D g m ( )
D i S i R h L i Design Science Research: Learning through building (Vaishnavi and Kuechler, 2004). “. . . Using design as a vehicle for
ti d i i k l d i creating design science knowledge in an area . . . Contributions of design science research are in the combined novelty and utility of
d if “ (M h d S
• Overview of DSR• Philosophical G d f DSR constructed artifacts “ (March and Storey,
2008).Design Theory (ISDT): A high level
Grounding of DSR• DSR Methodology• An Example of DSR • Design Science D gn ry ( D ) g
description of the functional (design) requirements and the design methods for a class of artifacts (Walls et al.. 1992).
Design Science Research versus Design• Conclusions
class of artifacts (Walls et al.. 1992).
1/12/2011© Vijay K. Vaishnavi
Can design be research?g
SymbolicSymbolic
Mathematics
Statutory Law
Analytic Synthetic
Statutory Law
Painting• Overview of DSR• Philosophical G d f DSR
Product Design
Mechanical Engineering
Grounding of DSR• DSR Methodology• An Example of DSR • Design Science
Real
ChemistryDesign Science
Research versus Design• Conclusions
Real
A Conceptual Map of Disciplines [Owen, 1997]
1/12/2011© Vijay K. Vaishnavi
Can design be research?
Channel
Knowledge Building Process
Knowledge WorksParadigm
Channel
• Overview of DSR• Philosophical G d f DSR
Knowledge Using Process
A General Model for Generatingand Accumulating Knowledge [Owen 1997]
Grounding of DSR• DSR Methodology• An Example of DSR • Design Science and Accumulating Knowledge [Owen, 1997]Design Science Research versus Design• Conclusions
1/12/2011© Vijay K. Vaishnavi
Knowledge Building Process
Can design be research?
Channel
Knowledge WorksParadigm
“Knowledge is generated and accumulated
ChannelKnowledge Using Process
Knowledge is generated and accumulated through action. Doing something and judging the results is the general model . . . the process is shown as a
l i hi h k l d i d
• Overview of DSR• Philosophical G d f DSR
g pcycle in which knowledge is used to create works, and works are evaluated to build knowledge.The channels in the diagram of the general
Grounding of DSR• DSR Methodology• An Example of DSR • Design Science The channels in the diagram of the general
model are the “systems of conventions and rules under which the discipline operates."
They embody the measures and values that have been empirically developed as “ways of knowing”
Design Science Research versus Design• Conclusions
been empirically developed as ways of knowing as the discipline has matured.”
[Owen, 1997]1/12/2011© Vijay K. Vaishnavi
“Schools of architecture, business, education law and medicine are all education, law, and medicine, are all centrally concerned with the process of design…. However, in this century n tur l sci nc s lm st dr v ut th natural sciences almost drove out the design from professional school curricula in all professions, including business, with exceptions for management science, computer science, and chemical engineering --
• Overview of DSR• Philosophical G d f DSR
sc ence, and chem cal eng neer ng an activity that peaked two or three decades after the Second World War ” [Simon 1996]
Grounding of DSR• DSR Methodology• An Example of DSR • Design Science War. [Simon, 1996]. Design Science Research versus Design• Conclusions
1/12/2011© Vijay K. Vaishnavi
“. . . The professional schools will reassume their . . . responsibilities just t th d th t th dis to the degree that they can discover a science of design, a body of intellectually tough, analytic, partly ntellectually tough, analyt c, partly formalizable, partly empirical teachable doctrine about the design
“ [Si 1996]
• Overview of DSR• Philosophical G d f DSR process . . . “ [Simon, 1996]Grounding of DSR• DSR Methodology• An Example of DSR • Design Science Design Science Research versus Design• Conclusions
1/12/2011© Vijay K. Vaishnavi
Simon’s distinction between “natural sciences” and “sciences of the artificial”
“A natural science is a body of knowledge about some class of things
sc ences and sc ences of the art f c al
g g-- objects or phenomenon -- in the world (nature or society) that describes and explains how they describes and explains how they behave and interact with each other.
A science of the artificial, on the other • Overview of DSR• Philosophical G d f DSR
,hand, is a body of knowledge about artificial (man made) objects and phenomena designed to meet certain
Grounding of DSR• DSR Methodology• An Example of DSR • Design Science phenomena designed to meet certain
desired goals.”Design Science
Research versus Design• Conclusions
1/12/2011© Vijay K. Vaishnavi
Simon’s framing of the Sciences of the Artificial
An inner environment, an outer environment, and the interface between the two that meets certain desired goals meets certain desired goals Outer Environment: the total set of external forces and effects that act on the artifact the artifact Inner Environment: the set of components that make up the artifact and their
l h h f h
• Overview of DSR• Philosophical G d f DSR relationships – the organization – of the
artifact Design Activity: the bringing-to-be of an
Grounding of DSR• DSR Methodology• An Example of DSR • Design Science D gn y r ng ng f n
artifact, components and their organization, which interfaces in a desired manner with its outer environment
Design Science Research versus Design• Conclusions
manner w th ts outer env ronment
1/12/2011© Vijay K. Vaishnavi
Design science research framework (b d Si ’ k)(based on Simon’s work)
Apply/Deploy
RELE
RI
Knowledge Base(Inner
Design Practice/Research
Environment(Outer
Environment)
E
Knowledge Needs &Constraints
(Inner Environment)
Research(Interface)
Environment)VANC
GOR
E
Add/Contribute (Adapted from Hevner et al [2004])
1/12/2011© Vijay K. Vaishnavi
Add/Contribute (Adapted from Hevner et al. [2004])
D ig i h f kDesign science research framework
Knowledge Base D i S iEnvironment
Needs/Knowledge
Foundations:•Theories Develop/Build:
People:•Roles
Knowledge Base(Inner
Environment)
Design Science Research
(Outer Environment)
Constraints
Contribute Deploy
•Theories•Frameworks•Instruments•Constructs•Models
p•Theories•Artifacts
Assess Refine
•Roles•Capabilities•Characteristics
Organizations:•Models•Instantiations
Methodologies:D t A l i T h i
Justify/Evaluate:•Analytical•Case Study
Organizations:•Strategies•Structure & Culture•Processes
•Data Analysis Techniques•Formalisms•Measures•Validation Criteria
y•Experimental•Field Study•Simulation
Technology:•Infrastructure•Applications•Communications Architecture•Development Capabilities
(Hevner et al. [2004])
1/12/2011© Vijay K. Vaishnavi
Knowledge Flows
Process Steps
LogicalFormalism
Awareness of Problem
Suggestion Abduction
Circumscription
Development
Evaluation
Deduction
*Operational and
• Overview of DSR• Philosophical G d f DSR
Conclusion
*Operational and Goal Knowledge Principles
Grounding of DSR• DSR Methodology• An Example of DSR • Design Science
Reasoning in the Design Science Research Cycle (based on [Takeda, 1991] )
*Operational Principle: Any technique or frame of reference about a class of artifacts or its characteristics that facilitates
ti i l ti d difi ti f tif t l f
Design Science Research versus Design• Conclusions
creation, manipulation and modification of artifactual forms [Dasgupta, 1996; Purao, 2002]
1/12/2011© Vijay K. Vaishnavi
Outputs f desi n science researchOutputs of design science research
Output Description1 Constructs The conceptual vocabulary of a
domaindomain2 Models A set of propositions or statements
expressing relationships between constructs
• Overview of DSR• Philosophical G d f DSR constructs
3 Methods A set of steps used to perform a task – how-to knowledge
I i i Th i li i f
Grounding of DSR• DSR Methodology• An Example of DSR • Design Science 4 Instantiations The operationalization of constructs,
models and methods.5 Better Artifact construction as analogous to
Design Science Research versus Design• Conclusions
theories experimental natural science1/12/2011© Vijay K. Vaishnavi
Outputs of design science research
Emergent Theory about
E b dd d Ph
ConstructsBetter Theories
ModelsEmbedded Phenomena
K l d
Abstraction ModelsMethodsKnowledge as
OperationalPrinciples
MethodsConstructs
Better TheoriesAbstraction• Overview of DSR• Philosophical G d f DSR
Artifact as Situated
Implementation
AbstractionInstantiations
MethodsConstructs
Grounding of DSR• DSR Methodology• An Example of DSR • Design Science ImplementationDesign Science Research versus Design• Conclusions
1/12/2011© Vijay K. Vaishnavi
Example of community determined utputsoutputs
Outputs determined by:Phase of researchLevel of abstraction
Infl n d bInfluenced byCommunity performing research• Overview of
DSR• Philosophical G d f DSRGrounding of DSR• DSR Methodology• An Example of DSR • Design Science Design Science Research versus Design• Conclusions
1/12/2011© Vijay K. Vaishnavi
Artifact: Construction of a data
Example of community determined outputs
rt fact n truct n f a ata visualization interface for complex queries against large relational databasesProblem Awareness: Need for an interface for quick and effective answers to questions about answers to questions about performance of business operationsResearch communities: Database
• Overview of DSR• Philosophical G d f DSR Research communities: Database,
Software Engineering, Decision Sciences, Information System Cognitive Researchers
Grounding of DSR• DSR Methodology• An Example of DSR • Design Science Cognitive ResearchersDesign Science Research versus Design• Conclusions
1/12/2011© Vijay K. Vaishnavi
Research motivation and theoretical
Example of community determined outputs
Research motivation and theoretical impetus:
Software Engineering, Database:New knowledge of faster access techniques of visual rendering techniques
Decision Sciences, HCI, Cognitive Decision Sciences, HCI, Cognitive Research
New research in reference disciplines on visual impacts on cognition and/or on
• Overview of DSR• Philosophical G d f DSR visual impacts on cognition and/or on
decision-makingGrounding of DSR• DSR Methodology• An Example of DSR • Design Science Design Science Research versus Design• Conclusions
1/12/2011© Vijay K. Vaishnavi
Example of community determined outputs
Community Perspective Knowledge Derived
HCI; IS CORE;
Artifact as experimental
What database visualization interfaces reveal about the cognition of complex dataCORE;
Decision science
experimental apparatus
about the cognition of complex data relationships
Database; Artifact as Principles for the construction of dataDatabase; Decision science Software
Artifact as focused design principle
Principles for the construction of data visualization interfaces
engineeringp pexploration
Database; Software
Artifact as improved
A better data visualization interface for relational, business oriented databases.Software
engineering improved instance of tool.
relational, business oriented databases.
Design Science Research Perspectives and Outputs byDesign Science Research Perspectives and Outputs by Community
1/12/2011© Vijay K. Vaishnavi
Philosophical grounding of design science research
Ontology is the study that describes the gy ynature of reality: for example, what is real and what is not, what is fundamental and what is derivative? Epistemology is the study that explores the nature of knowledge: for example, on what does knowledge depend and how can
• Overview of DSR• Philosophical Grounding of DSR what does knowledge depend and how can
we be certain of what we know? Axiology is the study of values: what values does an individual or group hold and
DSR• DSR Methodology• An Example of DSR • Design Science values does an individual or group hold and
why? Design Science
Research versus Design• Conclusions
1/12/2011© Vijay K. Vaishnavi
Research PerspectiveBasic Belief Positivist Interpretive Design
Philosophical grounding of design science research
Ontology A single reality. Knowable,
b bili i
Multiple realities, socially constructed
Multiple, contextually situated alternative world-states. Socio-
h l i ll bl dprobabilistic technologically enabled
Epistemology Objective; dispassionate. Detached
Subjective, i.e. values and knowledge emerge from the
Knowing through making: objectively constrained construction within aDetached
observer of truth
emerge from the researcher-participant interaction.
construction within a context. Iterative circumscription reveals meaning.
Methodology Observation; quantitative, statistical
Participation; qualitative. Hermeneutical, di l i l
Developmental. Measure artifactual impacts on the composite system.
dialectical.
Axiology: what is of value
Truth: universal and beautiful;
Understanding: situated and description
Control; creation; progress (i.e. improvement); understandingvalue beautiful;
predictiondescription understanding
1/12/2011© Vijay K. Vaishnavi
Design science research gmethodology
Knowledge Process Outputs
Awareness of Problem
Proposal
Knowledge Flows
Process Steps
Outputs
Problem
Suggestion Tentative design
• Overview of DSR• Philosophical Grounding of DSR
Development Artifact
Circumscription• DSR Methodology• An Example of DSR • Design Science
Evaluation
Conclusion
Operation and Goal Knowledge
Performance measures
Results
Design Science Research versus Design• Conclusions
1/12/2011© Vijay K. Vaishnavi
Awareness of problem
Design science research methodology
Awareness of problemReference disciplineNew developments in industryNew developments in industryReadings in allied discipline
SuggestionNovel configuration of existing or new elementsEssentially a creative step
• Overview of DSR• Philosophical Grounding of DSR
Essentially a creative step• DSR Methodology• An Example of DSR • Design Science Design Science Research versus Design• Conclusions
1/12/2011© Vijay K. Vaishnavi
Design science research methodology
DevelopmentTentative design implementedImplementation technique depends on the artifact
An algorithm require formal description and An algorithm require formal description and possibly implementation• Overview of DSR
• Philosophical Grounding of DSR• DSR Methodology• An Example of DSR • Design Science Design Science Research versus Design• Conclusions
1/12/2011© Vijay K. Vaishnavi
Design science research methodology
EvaluationContains an analytic sub-phase; h th d b t th b h i hypotheses made about the behavior of the artifactRarely, initial hypotheses completely y, yp mp yborne out
Results in additional information, fed back to another round of problem awareness and
• Overview of DSR• Philosophical Grounding of DSR to another round of problem awareness and
suggestion• DSR Methodology• An Example of DSR • Design Science Design Science Research versus Design• Conclusions
1/12/2011© Vijay K. Vaishnavi
Conclusion
Design science research methodology
ConclusionFinale of a specific research effortTypically result of “satisficing”Typically result of satisficing
Results adjudged “good enough”; still deviations from the (multiply) revised hypothetical predictionshypothetical predictions
Research written up; knowledge gained classified as “firm” or “loose” –n m l us b h vi th t n ds
• Overview of DSR• Philosophical Grounding of DSR
anomalous behavior that needs further research
• DSR Methodology• An Example of DSR • Design Science Design Science Research versus Design• Conclusions
1/12/2011© Vijay K. Vaishnavi
An example of design science researchresearch
Awareness of problempDevelopment of a computerized decision support system for nuclear reactorsreactorsPilot development in Prolog
Problem insight: How to construct and
• Overview of DSR• Philosophical Grounding of DSR
continuously maintain a supports system for the operation of a complex, hierarchical, procedure-driven environment
• DSR Methodology• An Example of DSR •Design Science Research versus Research versus Design• Conclusions
1/12/2011© Vijay K. Vaishnavi
Suggestion
Example of design science research
SuggestionPotential solution approaches were explored which resulted in new insights into the problemp m
Insight: system complexity resulted primarily in the control of the system
Need to effectively model complex y pcontrol structures
Insight: Control information was knowledge and could be modeled using rules but
d d d l f h l f
• Overview of DSR• Philosophical Grounding of DSR
executed independently from the rules for domain procedure knowledgeUse concepts from semantic data modeling
• DSR Methodology• An Example of DSR •Design Science Research versus
Use object-orientation to partition system knowledge
Research versus Design• Conclusions
1/12/2011© Vijay K. Vaishnavi
Awareness of Problem Redoux
Example of design science research
Awareness of Problem RedouxAny of the earlier research phases may be spontaneously revisited p yBy the inception of the development stage, the problem statement had changed to:changed to:
“how to effectively model operations support systems for complex,
• Overview of DSR• Philosophical Grounding of DSR pp y p
hierarchical, procedure driven environments”
• DSR Methodology• An Example of DSR •Design Science Research versus Research versus Design• Conclusions
1/12/2011© Vijay K. Vaishnavi
D l t
Example of design science research
DevelopmentDevelopment was not straightforwardConstruction was conceptual involved Construction was conceptual, involved the “discovery” of details of the novel artifact – “smart objects”
lWhat would the syntax be for the two types of rules, domain and control?Should the two types of knowledge be
i d i f h
• Overview of DSR• Philosophical Grounding of DSR
permitted to interact? If so, how?• DSR Methodology• An Example of DSR •Design Science Research versus Research versus Design• Conclusions
1/12/2011© Vijay K. Vaishnavi
Evaluation
Example of design science research
Evaluation-Informal “micro-evaluations” took place continuouslyp y
Each design decision followed by a thought experiment
Various operating environments were modeled and “hand stepped” through rule modeled and hand-stepped through rule execution to verify correct behavior
Grocery bagging “robot”Modeling of portions of the nuclear reactor
• Overview of DSR• Philosophical Grounding of DSR Modeling of portions of the nuclear reactor
operationsResulted in minor redesign of the artifact – the smart object conceptual model
• DSR Methodology• An Example of DSR •Design Science Research versus j pResearch versus Design• Conclusions
1/12/2011© Vijay K. Vaishnavi
Conclusion
Example of design science research
ConclusionSuccessful defense of a doctoral dissertationThree conference papersPublished in IEEE Trans. Knowledge
d D t E i i ft th and Data Engineering after three revisions
By the time of acceptance, smart objects
• Overview of DSR• Philosophical Grounding of DSR
had gone through several additional design science research cycles
• DSR Methodology• An Example of DSR •Design Science Research versus Research versus Design• Conclusions
1/12/2011© Vijay K. Vaishnavi
Desi n science research vs desi nDesign science research vs. designResearch distinguished by the production of interesting (to a research community) new interesting (to a research community) new knowledgeDistinguished by the intellectual risk,
b f k hi h h number of unknowns, which when successfully surmounted provides new information of value to the community
• Overview of DSR• Philosophical Grounding of DSR
Most product design efforts preceded by meetings to “engineer the risk out of” the design effort
• DSR Methodology• An Example of DSR • Design Science Research versus gResearch versus Design• Conclusions
1/12/2011© Vijay K. Vaishnavi
Design and design science research process
K l d P O t t
Awareness of Problem
Proposal
Knowledge Flows
Process Steps
Outputs
Problem
Suggestion
Ci i ti
Tentative design• Overview of DSR• Philosophical Grounding of DSR
Development Artifact
Circumscription• DSR Methodology• An Example of DSR • Design Science Research versus
Evaluation
Conclusion
Operation and Goal Knowledge
Performance measures
Results
Research versus Design• Conclusions
1/12/2011
Results
© Vijay K. Vaishnavi
Awareness of problem
Design ResearchReference
Design (IT)Interaction Reference
disciplineNew d l i
Interaction with clientsBusiness developments in
industryReadings in
Business analysisNew
• Overview of DSR• Philosophical Grounding of DSR Readings in
allied disciplinesNew developments in industry
• DSR Methodology• An Example of DSR • Design Science Research versus
yRequirements Analysis
Research versus Design• Conclusions
1/12/2011© Vijay K. Vaishnavi
Suggestion
Design Research
DesignResearchLiterature search
Domain analysisP li i Reuse of
existing knowledge
Preliminary designR f
• Overview of DSR• Philosophical Grounding of DSR knowledge
Case studiesReuse of existing elements
• DSR Methodology• An Example of DSR • Design Science Research versus elements
Test suiteResearch versus Design• Conclusions
1/12/2011© Vijay K. Vaishnavi
DevelopmentDesign Research
Novel configuration
DesignDevelopment configuration
of existing or new elementsNature of
penvironment identifiedInitial Nature of
development depends on the artifact
Initial prototypeIterative
• Overview of DSR• Philosophical Grounding of DSR
An algorithm requires formal description and possibly
addition of functionality
• DSR Methodology• An Example of DSR • Design Science Research versus possibly
implementationResearch versus Design• Conclusions
1/12/2011© Vijay K. Vaishnavi
EvaluationDesign Research
Contains an analytic sub-
DesignExercising
ana yt c uphase; hypotheses made about the behavior of the artifact
test suite Bug fixing
Can lead artifactRarely, initial hypotheses completely borne
Can lead to visiting earlier
• Overview of DSR• Philosophical Grounding of DSR p y
outResults in additional information, fed
phasesField testing
• DSR Methodology• An Example of DSR • Design Science Research versus information, fed
back to another round of problem awareness and suggestion
Research versus Design• Conclusions
gg
1/12/2011© Vijay K. Vaishnavi
ConclusionDesign Research
Finale of a specific research
DesignFinale of a specific p c f c r arch
effortTypically result of “satisficing”R h itt
pdevelopment effort
Manuals and reports Research written
up; knowledge gained classified as “firm” or
reports Client satisfaction or market success
• Overview of DSR• Philosophical Grounding of DSR as firm or
“loose” –anomalous behavior that needs further
determines the degree of successIdeally should
• DSR Methodology• An Example of DSR • Design Science Research versus needs further
researchIdeally should result in learning and improvement
Research versus Design• Conclusions
1/12/2011© Vijay K. Vaishnavi
Concluding remarksConcluding remarks
Design science research needs to be conducted and taught in all professional disciplines –engineering, business, law, medicine, g g, , , ,information technology, …Certain phases – problem awareness, evaluation – can and should borrow well developed
s h m th ds (p siti ist i t p ti )
• Overview of DSR• Philosophical Grounding of DSR
research methods (positivist, interpretive)Creativity important part of such research but the research can benefit from guidance through research patterns
• Design Science Research versus Design• DSR Methodology• An Example of through research patterns
General design cycle, a research framework, for research in professional disciplines
An Example of DSR • Conclusions
1/12/2011© Vijay K. Vaishnavi
Top Related