September 2006

Vermelding onderdeel organisatie

1

Including human behaviorin product simulations

for the investigation of use processes

in conceptual design

A SURVEY ASME CIE 2006, Philadelphia

Wilfred van der Vegte, Imre Horváth

Faculty of Industrial Design Engineering

April 22, 2023 2 of 16

Overview

• Objective, scope and method of survey• Assessment criteria for reviewing simulation

approaches• Types of artifact and human behavior that can be

simulated• Categorization of simulation approaches• Brief overview of reviewed simulation approaches

with a focus on ‘unfamiliar’ approaches• Conclusions: what is possible,

what is not possible yet and what can be done to make it possible

April 22, 2023 3 of 16

Objective of the survey and the research

Knowledge exploration in orientation phase of

new computer tooldevelopment

to simulateuse processes of

consumer durables

simulation (definition):performing experiments

onvirtual models

my goal:enable designers

to perform simulations with

fully virtual systems

the human involved in theuse process is also virtual:

even his/her decision-making is simulated

simulation of autonomous virtual

humans involved in use processes

April 22, 2023 4 of 16

Scope of the survey

Knowledge exploration in orientation phase of

new computer tooldevelopment

to simulateuse processes of

consumer durables

behavior ofproducts

behavior ofhumans

behavior ofsurroundings

behaviorof artifacts

this survey:existing

simulationapproaches

application field:behavior prediction in

conceptual design

MethodLiterature study(for scientific achievements)Web search(for commercial achievements)

April 22, 2023 5 of 16

Criteria for the assessment of simulation approaches

• Range of use-process behaviors covered (as many as possible, e.g., cognitive, perceptual, mechanical, thermal, …)

• Relevance of the scope (with respect to use of consumer products)

• Ease of preparing simulations (e.g., direct conversion from CAD)

• Speed and computability (real-time vs. delayed)• Ease of interpretation (animations vs. numeric output)• Fidelity of the outcomes (but accuracy is less important)• Combination options and exchangeability of data

(assuming that there is no simulation approach that covers the complete range of behaviors on itself)

April 22, 2023 6 of 16

Types of behavior in artifact simulation

observedphysicalbehavior

mechanics

statics

kineticssolid

fluid

kinematicshydrostaticshydrodynamicsaerodynamicspneumatics

acoustics

thermodynamicselectrics

optics

stabilitydeformationstress and strainmotion dynamicscollisionvibrationdeformation

stress and strain

interpretedphysicalbehavior

physicalbehavior

M, E

I

magnetism

bucklingphysicalbehavior

continuous simulation

discrete simulationhybrid simulation

April 22, 2023 7 of 16

Types of behavior in human simulationty

pes

ofbe

havi

orbo

dy p

arts

and

orga

ns in

volv

ed senseorgans

brain centralnervoussystem

muscles skin,subcu-

taneoustissue,

etc.

kine-maticalbehavior

cognitivebehavior

perceptualbehavior

controlbehavior

actuatorbehavior

bowels,lungs,heart,blood

vessels,etc.

metabolicbehavior

flow of energy flow of informationflow of matter

centralnervoussystem

kineticbehavior

tendons,bones,joints

interface withthe outside world

April 22, 2023 8 of 16

Types of behavior in human simulationty

pes

ofbe

havi

orbo

dy p

arts

and

orga

ns in

volv

ed senseorgans

brain centralnervoussystem

muscles skin,subcu-

taneoustissue,

etc.

kine-maticalbehavior

cognitivebehavior

perceptualbehavior

controlbehavior

actuatorbehavior

bowels,lungs,heart,bloodvessels,etc.

metabolicbehavior

centralnervoussystem

kineticbehavior

tendons,bones,joints

mechanicalobserved physical behavior

non- mechanicalobserved physical

behaviorinterpreted physical

behavior

April 22, 2023 9 of 16

volu

-m

etric

qualitative models

finite state machines

block diagrams

bond graphs

3D schematic models

algebraic descriptions

finite-element models

boundary-element models

skinning models mes

h-ba

sed

production rules

disc

retiz

ed

particle models

guided 3D volumetric models

(semi) autonomous3D volumetric models

Overview of simulation approaches based on models

Behavioralmodels

Objectmodels

Entitymodels

Relationshipmodels

Processingmodels

Controlmodels

algebraicalgorithmbasedanimationoriented

laws-basedlogic-based

graphical (2D)schematic (3D)

simplifiedboundary

spatiallogical

volumetric

boundary

concrete

abstract

simplifiedvolumetric

Typical simulation modelsTaxonomy of model types

volu

-m

etric

qualitative models

finite state machines

block diagrams

bond graphs

3D schematic models

algebraic descriptions

finite-element models

boundary-element models

skinning models mes

h-ba

sed

production rules

disc

retiz

ed

particle models

guided 3D volumetric models

(semi) autonomous3D volumetric models

April 22, 2023 10 of 16

UG

S

block diagrams

bond graphs

3D schematic models

algebraic descriptions

finite-element models

boundary-element models

disc

retiz

ed

particle models

guided 3D volumetric models

Common mechanical artifact-simulation models also applied to human simulation

block diagrams

bond graphs

3D schematic models

algebraic descriptions

finite-element models

boundary-element models

particle models

guided 3D volumetric models

Yang

et

al.,

2006

guided human “simulation” (or guided animation):the user guides the manikin using a UI, so that human decision-making does not have to be simulated. Only fixed sequences of action are simulated / animated

April 22, 2023 11 of 16

qualitative models

finite state machines

skinning models

production rules

(semi) autonomous3D volumetric models

Simulation models that are not commonly used formechanical artifact simulation

qualitative models

finite state machines

skinning models

production rules

(semi) autonomous3D volumetric models

open

close

housingopened release

push housingpusheddown

stapleloaded

reload

staplepaperstapled

housing closed

North_Lights South_GateSouth_Lights North_Gate

On

Off

On

Off

On

Off

On

Off

Entering_Crossing

In_Crossing

Leaving_Crossing

Train-In-CrossingNo_Train

Train_Crossing

Nat

ural

Mot

ion

Ltd.

Cognitive ProcessorLong TermMemory

Short TermMemory

AuditoryProcessor

VisualProcessor

OcularMotor

Processor

VocalMotor

Processor

ManualMotor

Processor

Production RuleInterpreter

WorkingMemory

TactileProcessor

• IF-THEN descriptions of how humansprocess information, mostly based onpsychological research results.

• Often grouped into functional modules e.g., EPIC

Oki

no, i

nc.

Kier

as e

t al

., 19

97 T

hom

pson

& h

eim

dahl

, 199

9

Koga

& A

oyam

a, 2

004

Part of the human’s condition-dependent decision making (high-level or low-level) is included in the model. Depending on circumstances during simulation,

different courses of action are possible. Typically based on hybrid models

April 22, 2023 12 of 16

Conclusions (1)

• Simulation approaches that are the most flexible (algebraic descriptions, qualitative model-based simulation)require the most preparation and interpretation effort for designers (no visual models, no link with CAD models of humans and artifacts, no animated output)

• Of the other, ‘user-friendly’ simulation approaches, 3 categories of approaches together can cover the most relevant forms of human and artifact behavior:• finite state machines

for interpreted behavior(information processing, cognition)• rigid volumetric model-based

approaches for rigid-body kinetics and kinematics• discretized-model based

approaches (e.g., FEM) for mechanical deformations and non-mechanical physical behavior

IF …

April 22, 2023 13 of 16

Conclusions (2)

senseorgans

brain centralnervoussystem

muscles skin,subcu-

taneoustissue,

etc.

kine-maticalbehavior

cognitivebehavior

perceptualbehavior

controlbehavior

actuatorbehavior

flow of energyflow of information

centralnervoussystem

kineticbehavior

tendons,bones,joints

HUMAN

information processing by the senses, the brain andthe central nervous system

+ controlled conversion to energy by the muscles

ARTIFACTS

IF …

the human interaction chain is simplified

April 22, 2023 14 of 16

mechanical deformations,non-mechanical observedphysical behaviormechanical deformations,non-mechanical observedphysical behavior

How can the three categories of approaches be combined?

discretesimulation

hybridsimulation

continuous simulation

finite state machines

vol u

met

r ic b

odies

rigid

3D volumetric models

discretized 3D

human & artifactbehavior

rigid-bodykinetics &kinematics

human behaviorartifact behavior

interpreted physical behavior(information processing)

Legend:

cognitive & control behavior

rigid-body kinetics& kinematics,cognition, control

rigid-body kinetics & kinematicswith deformations but without geometriceffect of deformation on kinematicsrigid-body kinetics & kinematics ofbody parts considered rigid; deforma-tions of body parts considered flexible

April 22, 2023 15 of 16

A possible solution:Nucleus-based modeling (Horváth, 2004) is a novel discretized modeling approach based on particles, that allows full simultaneous simulation of rigid-body kinetics, kinematics, deformations and other physical behaviors.If we can combine nucleus-based simulation with finite state machines, designers might be able to perform hybrid simulations of observed and interpreted physical behavior of humans and artifacts with little preparation effort,obtaining results that can easily be interpreted.Key bottleneck:

combining rigid-body mechanics with deformations &non-mechanical

behavior

April 22, 2023 16 of 16

End of my presentation.Questions?