Wendell Wallach Yale Interdisciplinary Center for ...
Transcript of Wendell Wallach Yale Interdisciplinary Center for ...
![Page 1: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/1.jpg)
Wendell WallachYale Interdisciplinary Center for Bioethics
Irving, CA – August 28, 2013
ELSI, Autonomy and Civil Aeronautics
![Page 2: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/2.jpg)
• ELSI – Ethics, Law, and Societal Issues
• Privacy, Surveillance and Property Rights
• Autonomy
• Engineering for Responsibility
• Moral Machines
• Governance Coordination
![Page 3: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/3.jpg)
ELSI
• Attention to ELSI Lags Far Behind Technological Development.
• ELSI Research Must be Funded Along With the Technologies.
![Page 4: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/4.jpg)
![Page 5: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/5.jpg)
![Page 6: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/6.jpg)
![Page 7: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/7.jpg)
Privacy and Surveillance
![Page 8: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/8.jpg)
Property Rights
![Page 9: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/9.jpg)
![Page 10: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/10.jpg)
Autonomy
• Safety
•Predictability
•Resilience if something goes wrong
•Attribution of responsibility, liability, and culpability
•Decision making – choices and actions
•Legal, ethical, and appropriate,
![Page 11: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/11.jpg)
Increasingly Autonomous Robotic Systems
threatens to undermine the foundational principle that a human agent (either
individual or corporate) is responsible, and potentially accountable and liable,
for the harms caused by the deployment of any technology.
![Page 12: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/12.jpg)
Responsibility
• Difficulty in predicting actions of algorithmic and complex systems.
• ‘many hands’ (Nissenbaum, 1997)
• Joint Cognitive Systems/Coordination
• Woods and Hollnagel - Global Hawk UAV – December 6th, 1999 – $5.3M
![Page 13: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/13.jpg)
”we have constructed a world in which the potential for high-tech catastrophe is embedded in the fabric of day-to-day life.”
Malcolm Gladwell
![Page 14: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/14.jpg)
Engineer for Responsibility
• Design of Artifacts
• Social Engineering
![Page 15: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/15.jpg)
Rules for Computing Artifacts• Rule 1: The people who design, develop, or deploy a computing artifact are
morally responsible for that artifact, and for the foreseeable effects of that artifact. This responsibility is shared with other people who design, develop, deploy or knowingly use the artifact as part of a sociotechnical system.
• Rule 2: The shared responsibility of computing artifacts is not a zero-sum game. The responsibility of an individual is not reduced simply because more people become involved in designing, developing, deploying or using the artifact. Instead, a person’s responsibility includes being answerable for the behaviours of the artifact and for the artifact’s effects after deployment, to the degree to which these effects are reasonably foreseeable by that person.
• Rule 3: People who knowingly use a particular computing artifact are morally responsible for that use.
• Rule 4: People who knowingly design, develop, deploy, or use a computing artifact can do so responsibly only when they make a reasonable effort to take into account the sociotechnical systems in which the artifact is embedded.
• Rule 5: People who design, develop, deploy, promote, or evaluate a computing artifact should not explicitly or implicitly deceive users about the artifact or its foreseeable effects, or about the sociotechnical systems in which the artifact is embedded.
![Page 16: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/16.jpg)
Machines must not make ‘decisions’ that result in the death
of humans.• Ban on Killer Robots
• ICRAC (Berlin, Oct ’10)
• Call for an Executive Order (Feb ‘12)
• ALFIS violates LOAC & IHL
• malum in se
• HRW/Harvard Law School Human Rights Clincic (Nov. 19th 2012)
• Autonomy in Weapons Systems (Nov. 23rd, 2012)
• DoD Undersecretary Ashton Carter
![Page 17: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/17.jpg)
Moral Agency - AMA• If and when robots become ethical
actors that can be held responsible for their actions, we can begin debating whether they are no longer machines and are deserving of some form of personhood.
• ‘mala in se’
• Not because they are machines
• Unpredictable, can not be fully controlled, and attribution of responsibility is difficult if not impossible
![Page 18: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/18.jpg)
Once such a principle is in place we can go on to the more exacting discussion as
to the situations in which robots and information systems are indeed an
extension of human will and intention and when their actions are beyond direct
human control.
![Page 19: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/19.jpg)
Professor Colin AllenIndiana University
Mapping a New Field of Inquiry
Machine Morality Machine Ethics
Computational EthicsArtificial Morality
Friendly AIRoboethics
![Page 20: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/20.jpg)
Artificial Moral Agents (AMAs)Implementation of moral decision-making faculties in artificial agents
Necessitated by autonomous systems making choices
![Page 21: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/21.jpg)
21
“The greater the freedom of a machine, the more it will need moral standards.”
Rosalind Picard, Director
M.I.T. Affective Computing Group
![Page 22: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/22.jpg)
• If robots can be designed so that they are sensitive to ethical considerations and factor those considerations into their choices and actions, new markets for their adoption will be opened up.
• If they fail to adequately accommodate human laws and values, there will be demands for regulations that limit their use.
![Page 23: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/23.jpg)
Questions• Do we need artificial moral
agents (AMAs)?
•When? For what?
• Do we want computers making ethical decisions?
•Whose morality or what morality?
• How can we make ethics computable?
![Page 24: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/24.jpg)
![Page 25: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/25.jpg)
Approaches
– Role of ethical theory in defining the control architecture.
– Top-Down
– Bottom-Up
– Hybrid Approaches
– Supra-rational Faculties
![Page 26: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/26.jpg)
The Two Hard Problems
•Implementing norms, rules, principles, or procedures for making moral judgments
•Framing Problems
![Page 27: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/27.jpg)
Framing ProblemsHow does the system recognize it is in an ethically significant situation?
How does it discern essential from inessential information?
How does the AMA estimate the sufficiency of initial information?
What capabilities would an AMA require to make a valid judgment about a complex situation? e.g., combatant v. non-combatant.
How would the system recognize that it had applied all necessary considerations to the challenge at hand or completed its determination
of the appropriate action to take?
![Page 28: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/28.jpg)
Distinction
• Humans -- Biochemical,
• Instinctual, Emotion Platform
• Higher Order Faculties Emerged
• Computers -- Logical Platform
![Page 29: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/29.jpg)
• Calculated Morality
• Rationality Less Bounded
• Absence of base motivations
• greed -- dubious for Alife
• Absence of emotions
• emotional “highjackings”
• (sexual jealousy)
Possible Advantages
![Page 30: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/30.jpg)
Role of Emotions in Moral Decision-Making Machines
Stoicism vs. Moral Intelligence
Both beneficial and dysfunctional
• Will AMA’s Require some affective intelligence
Emotions of their own? Cognitive? Somatic?
Emotional heuristics
Will humans feel comfortable with machines sensitive to their emotional states?
![Page 31: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/31.jpg)
Beyond Reason
• Emotions
• Sociability
• Embodiment
• Theory of Mind
• Empathy
• Consciousness
• Understanding
Chronos2
Genghis
![Page 32: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/32.jpg)
Will artificial agents need to emulate the full array of human faculties to function as adequate moral agents and to instill trust in their actions?
Hiroshi Ishiguru
![Page 33: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/33.jpg)
WHAT HAS BEEN ENGINEERED SO FAR?
•Not Much!• Ethical advisors
• Systems developed for discrete tasks
![Page 34: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/34.jpg)
LIDA Cognitive Cycle Stan Franklin & Bernie Baars (GWT)
Competition for Consciousness
Long-term Working Memory
Declarative Memory(Sparse Distributed
Memory)
Transient EpisodicMemory
(Sparse Distributed Memory)
Working MemoryPreconscious Buffers
(Workspace)
Attention Codelets
Sensory-MotorMemory
(Subsumption Net)
External Stimulus
Internal Stimulus
Perceptual Associative Memory
(Slip Net)
Procedural Memory(Scheme Net)
Action Selection
(Behavior Net)
2Percept
3Cue
3Cue
3Local Associations
3Local Associations
3Copy Over
4Look At
4Coalitions
4Winning Coalition
5ConsciousBroadcast6,7
Instantiate, bind,activate schemes
8Action Selected
Attentional Learning
Episodic LearningPerceptual Learning
Procedural Learning
Interpret
Interpret
Pre-afference
Consolidation1Perception
Codelets
ConsciousBroadcast
8Action &Object
8SMA
(SubsumptionNetwork)
9Action Taken
Effectors
Sensors &PrimitiveFeatureDetectors
8Object
![Page 35: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/35.jpg)
• If there are clear limits in our ability to develop AMAs or manage robots, then it will be incumbent upon us to recognize those limits so that we can turn our attention away from a false reliance on autonomous systems and toward more human intervention in the decision-making process of computers and robots.
![Page 36: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/36.jpg)
Existing Policy Mechanisms
• Govt. Financing of Research
• Laws & Regulations
• Oversight
• Professional Codes of Ethics
• Research Ethics
• Laboratory practices and procedures
• Insurance Policy
• Govt. agencies
• FDA, CDC, EPA, etc.
• University and Hospital
• IRBs, IACUCs, Biosafety Committees, & ESCROs
![Page 37: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/37.jpg)
Existing Policy Mechanisms
• Relatively robust system of protections
• Grounds for criticism
• lack of funding for oversight
• hamper productivity
• piecemeal
• Adding, modifying and dismantling
• FBI WMD Directorate, Biological Countermeasures Unit (2006)
![Page 38: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/38.jpg)
International Considerations
• Differing values
• Precautionary Principle
• more stringent/competitive disadvantage
• more open/exposure to dangerous products
![Page 39: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/39.jpg)
Oversight• Governance Mechanism – GCC
• monitor
• whether the lines of responsibility have been established for new systems being deployed.
• whether thresholds are about to be crossed that pose serious dangers.
• Manage
• Relationship between stakeholders
• Gaps
• ModulateGary Marchant
![Page 40: Wendell Wallach Yale Interdisciplinary Center for ...](https://reader035.fdocuments.in/reader035/viewer/2022071614/61580f4d3f1e44433c17c5bf/html5/thumbnails/40.jpg)
• Coordinate activities of the various stakeholders
• Modular
• Comprehensive monitoring
• Flag issues/gaps
• Find solutions within the robust set of available mechanisms
• Mandated to avoid regulation where possible
• Soft Governance
• Nimble/Flexible/Adaptive/Lean
• Credible vehicle
GOVERNANCE COORDINATION COMMITTEE (GCC)