Responsible design, casehuman-robot interaction,

Marketta Niemelä and Veikko Ikonen, VTT

Shaping the future with human-driven design, Design for life research seminar,Tuesday 27.5.2014, VTT, Tekniikantie 2, Espoo

Human Robot Interaction:Robots in SocietyDesign for Life seminarMarketta NiemeläVTT Technical Research Centre of Finland

Place for a photo(no lines around photo)

327/05/2014 3

Robot – Service Robot – Humanoid

A robot can be defined as:an artificial device that can sense itsenvironment and purposefully act on or inthat environment (robot interacts with theworld)an embodied artificial intelligencea machine that can autonomously carry outuseful work

Service robot can be defined as any robotthat is not used in the manufacturing setup

application fields: medical, health care,military, domestic, and educational industries

Humanoid robot (android) resembles ahuman being in appearance

427/05/2014 4

Trends in Robotics

Source: Frost & Sullivan analysis 2013

527/05/2014 5

“Human–Robot Interaction (HRI) is a field of studydedicated to understanding, designing, and evaluating roboticsystems for use by or with humans.”

Taxonomy of HRImetrics by Murphy &Schreckenghost(2013).

627/05/2014 6

Broad Questions

Service robots are designed to interact with humanbeings in human inhabitated environments. Thisbrings requirements for the safety, usability, andsocial acceptability of the robots (Salvini & al 2010)Topics like acceptability, ethics, and sustainabilitybecome more and more spotlighted when studyingsocial robots. Questions arise, such as: what makes arobot socially accepted (long-term)? What are thesocietal implications of integrating robots intoeducation, working or health contexts? (Weiss &Tscheligi 2010)

727/05/2014 7

Users’ expectations and experience

”Uncanny Valley” (Mori 1970, 2012)

827/05/2014 8

Ethical issues

E.g. invading privacy, safety and control; vulnerableusers; role in careSpecific ethical questions, “robot ethics” raise withhumanoid robots which would work in closeinteraction with ordinary people, including children,vulnerable and elderly people

users can develop attachment and emotionsusers can believe that the robot is capable to dosomething that it is not capable of

927/05/2014 9

Societal impacts

There is a “widespread feeling that robots can takeover jobs that are traditionally the domain ofhumans” (Salvini & al 2010, p. 456).On the other hand

for workers, safety and health issues and workingconditions are improved with robotsrobots replacing humans may mean enablingpromoting human capabilities elsewhere – better,more sophisticated jobs for people

1027/05/2014 10

RRI as an approach to anticipate challenges andbuild solutions?

RESPONSIBLEDESIGN –

MISSION POSSIBLE?Veikko Ikonen

Human-Driven Design and System Dynamics

Shaping the future with human-driven designDesign for life research seminar, Tuesday 27.5.2014VTT, Tekniikantie 2, Espoo

1227/05/2014 12

From Ethical issues, Innovation Policy, OpenScience …… to RRI in H2020

Science with Society, Science for Society, Science with andfor….Responsible Research and Innovation”, often abbreviated to“RRI”, is a recent expression that is being used by the EuropeanCommission to denote part of its research and innovationstrategy. The term is being used in EU policies, fundingprograms, funded research project, and increasingly also in theacademic literature, both in Europe and abroad. The term ismeant to refer to approaches to research and innovation thattake into account ethical criteria and societal needs. A frequentlycited definition of RRI is that by philosopher and EC policyofficer René von Schomberg:

1327/05/2014 13

RRI?

“Responsible Research and Innovation is a transparent,interactive process by which societal actors and innovatorsbecome mutually responsive to each other with a view to the(ethical) acceptability, sustainability and societal desirability ofthe innovation process and its marketable products (in order toallow a proper embedding of scientific and technologicaladvances in our society).” (Von Schomberg, 2011).“RRI is an inclusive approach to research and innovation (R&I),to ensure that societal actors work together during the wholeresearch and innovation process. It aims to better align both theprocess and outcomes of R&I with the values, needs andexpectations of European society.” (European Commission,2013)RRI is key concept for EU’s HORIZON 2020

1427/05/2014 14

What is needed to ”do” RRI - dimensions:

AnticipationInclusionResponsivenessReflextivity (reflexsive learning)Transparency

(e.g. Owen et al., Sutcliffe)

How this is done in practive, may vary. Important dimensions ofvariation are

activitiesactorsNorms

These render the space of RRI.

• The Engagement,• Open Access,• Gender Equality,• Ethics,• Science Education• Governance(HORIZON 2020, EU)

• Anticipate,• Reflect,• Engage• and Act(EPSRC, UK)

15

Norms

Actors

Activities

Space of RRI (Stahl 2013)

Riskassessment

Technologyassessment(incl. CTA, PTA)

Foresightactivities

Broadinclusion ofstakeholders Upstream,

midstream,downstreamactivities

External scrutiny(e.g., ethics reviews,standards ofresearch integrity)

Internalreflexivity

Work packages onethical, social andlegal issues

Research processesand methodologies(e.g., value-sensitivedesign; life-baseddesign?)

Provision ofawareness andaccountabilitystructures, e.g.,educatingindividuals

Incentives andguidelines (e.g.,codes ofethics/conduct)

Oaths/pledges

Researchorganisations(public andprivate)

ResearchersResearch ethicscommittees

Usersof R&I

Civil societyactors

Policy makerson differentlevels

Professionalbodies

Legislators

Educationalorganisations

Public bodies

Philosophicalethics (e.g.,virtue ethics)Human Rights of

United Nations

UNESCO DraftCode of Ethicsfor InformationSociety

EuropeanHuman Rights

United NationsGlobal Compact

Research ethics

United NationsGlobal Compact

Technologyethics

Principles ofdemocraticgovernance

1627/05/2014 16

Main questions for RD or RRI discussion?

Who (or what) is designing your future/everyday life?Who are the decision makers? Industry, policy makers, citizens?What are their ambitions/goals/intentions and what is behind inthose?How design decisions are justified – on what grounds?Conflicting interests?Balancing between responsibility and innovation??What kind of systems are designed (user interface –task – localservice system - global ecosystem)Do we go to the global level?Short-term vs. Long-Term perspective!What is Responsible Research and Innovation?Is Human-Driven Design an answer for some of the questions?

1727/05/2014 17

RRI and Industry? – current buzzwords

Technology and ethics > academic approachResearch, science, innovation, business ethics > reputationbuilding or being honestly good?Ecological thinking > environmental policies > avoiding hazardsSustainability (social, economical, environmental) > policy andbusiness approach, but also research aproachEthical design, Ethics by Design > humanistic design approachGreen – growth, clean tech > business opportunitiesCorporate social responsibility > reputationEthical consumption > looking for new markets, customer insight

1827/05/2014 18

19

2027/05/2014 2020

BASIC STATEMENT FOR RD?

The society should make use of thetechnology so that it increases thequality of life and does not cause

harm to anyone

2127/05/2014 21

The History of Ethics in Research andInnnovation and RRI - from our point of view

Participatory design approach (from 60s)UCD/HCD appraoch was broaden from UI design to the designof technological environment and servicesDesign for All, Inclusive design approachesEthical issues in our work in some level and several technologydevelopment projects with industry where ethical issues hasbeen emphasised (mmHACS (OY): MultiMedia HomeAid Communication System (1998-2001) – ethical guidelines / expert based

KEN: Key Usability and Ethical Issues in Navi –program (2000-2002) - ethical guidelines / expert basedECG: Ethical Computing Group (2003-) – VTT’s network to support researchers when confronting critical/ethical issuesEASE, Ecological Approach to Smart Environments – Good Smart Environment – expert based /more general assessment frameworkNEAT (Jaana Leikas),report on ethics, aging and technologyEU -projects (Nomadic Media, Mimosa, Minami, ETICA 2009-2011 Goldenworkers, Guardian Angels 2011-2012DfA: Design for All -networkRegional ethics committees for the social sciences and humanities)

> now more holistic view called RRI (projects etc. GREAT, ResponsibleIndustry (VTT as partner)Res-Agora, Responsibility, RRI Tools (collaboration within all RRI projects)SATORI (Stakeholders Acting Together On the ethical impact assessment of Researchand Innovation, VTT as partner)

22

23

Guardian Angels - Ethical principles from MINAmIproject as the starting point

24

Guardian Angels - Ethical principles from MINAmIproject as the starting point

2527/05/2014 25

MINAmI ethical principles ondifferent levels of the society

Individualuser

Other people involved

Organisations and society

Privacy

Autonomy

Integrity and dignity

Reliability

Reliability

E-inclusion

Role of thetechnology in thesociety

http://www.fp6-minami.org

Responsible (HRI)Innovation through (HD)co-design

AnticipateReflectEngage

Act

AnticipationInclusionResponsivenessReflextivity (reflexsivelearning)Transparency

The Engagement,Open Access,

Gender Equality,Ethics,

Science EducationGovernance

2727/05/2014 27

Companies bring theiremployees and partnersinto collaborativeworkshops

Consumersparticipate inservice development

Citizens develop theirliving environmenttogether with themunicipality

What is co-design?

Involving differentstakeholders in theinnovation anddesign processesof new products,services andprocesses.

Examples:

2827/05/2014 28

Why co-design for HRI?

Co-design helps to identify new strategicbusiness possibilities, improveexisting services and optimize internalprocesses.Co-design gives you deeper understandingof customers’ needs and wishes.Co-design helps you catch the good ideasthat can come from everywhere.Co-design in the early phases of the innovation process helps to avoidcostly re-designs later.Thanks to digital technologies, co-design is easier and cheaper than everbefore.Collaboration brings closer relationship with customers, who become morecommitted to your services.

2927/05/2014 29

Responsible co-design for HRI - HDD

We characterise HDD as follows: the human-driven designapproach

1) takes a human and social view to users of technology asindividuals and members of human social groups, such as family,organisation or community, and as consumers2) is responsible in terms of being aware of human,societal and ethical values related to a particular design andreflecting them in the design in order to make the technologysupport well-being and activities of people as well assustainability (social, environmental and economic) > RRI3) includes systemic approach to the context – systemdynamics, modelling

3027/05/2014 30

Responsible co-design - HDD4) is collaborative in terms of utilising and promoting participatoryand collaborative design methods to promote equality in designprocess and design outcomes and to ensure successful designoutcomes by means of deep understanding of the user’s needs,values and circumstances5) is future-oriented: the core of HDD is to design concepts forthe needs of future sustainable society. The concepts stronglylean on emerging technologies but are formulated by insight ofsocietal phenomena, demands for business solutions andsustainable development, acquired by e.g. foresight methods

AIM IS A HOLISTIC VIEW TO THE DEVELOPMENT, NOTALONE BUT TOGETHER WITH OTHERS

3127/05/2014 31

Some points for discussion/thinking

RD is required throughout the product/service/system life cycle.Theoretical, laboratory and contextBy means of a holistic perspective we can consider the challenges,threats and opportunities in advance when designing newtechnologies and services for our future everyday environments.General guidelines (checklist) never manage to cover all issuesbecause there are also application-specific RD issuesThrough thorough discussion and communication we canunderstand better other stakeholder’s viewpoint and build togetherbest possible solutions > empowering/deliberative design practise>but how to assure that quantity and quality of these activities areconsidered at the same time?Including RD perspective means also increased quality assurance

3227/05/2014 32

Ethics and technology

Melvin Kranzberg's (1986) first law of technology”Technology is neither good nor bad; nor is it neutral”

33

TECHNOLOGY FOR BUSINESSRESPONSIBILITY FORRESEARCH ANDINNOVATION