The ER Model: from Plot generation to Visual...
Transcript of The ER Model: from Plot generation to Visual...
Rafael Pérez y Pérez
Universidad Autónoma Metropolitana, Cuajimalpa
The ER Model: from Plot generation to Visual Composition
The Engagement-Reflection
Model
Material to be evaluated
Engagement
Reflection
Guidelines
The process of developing new stories consists of a cycle between the Engaged and Reflective States
It is inspired on Sharples (1999) cognitive account of writing:
Sharples, M. (1999). How we write? Writing as creative design. London: Routledge.
The Engagement-Reflection
Computer Model
K-B creation
E-R Cycle
input
Initial action
Output
Knowledge Base
K-B creation
E-R Cycle
input
Initial action
Output
The user
- Parameters - Set of actions - Examples of “Previous Stories”
Knowledge Base
Automatic Plot Evaluation
I am also developing computer models for automatic plot evaluation
Collaborative Storytelling
Interdisciplinary Group on Computational Creativity
Actions 1 and previous stories 1.
Building the knowledge base.
Knowledge Base 1
E
R
Agent 1
Actions 2 and previous stories 2.
Building the knowledge base.
Knowledge Base 2
E
R
Agent 2
Improvisación
Previous Stories 1
Previous Stories 2
Actions 1 and previous stories 1.
Building the knowledge base.
Knowledge Base 1
E
R
Agent 1
Actions 2 and previous stories 2.
Building the knowledge base.
Knowledge Base 2
E
R
Agent 2
Improvisación
Previous Stories 1
Previous Stories 2
We are interested in explicitly representing social hierarchy
and social norms
Actions 1 and previous stories 1.
Building the knowledge base.
Knowledge Base 1
E
R
Agent 1
Actions 2 and previous stories 2.
Building the knowledge base.
Knowledge Base 2
E
R
Agent 2
Improvisación
Previous Stories 1
Previous Stories 2
We have developed the hypothesis that, as the difference between the two sets of social norms grows the originality
of the collective narratives developed by the system increases
Actions 1 and previous stories 1.
Building the knowledge base.
Knowledge Base 1
E
R
Agent 1
Actions 2 and previous stories 2.
Building the knowledge base.
Knowledge Base 2
E
R
Agent 2
Improvisación
Previous Stories 1
Previous Stories 2
However, if such a difference keeps on growing the system
will reach a point where agents cannot communicate anymore and therefore they will be incapable of
developing collective narratives
Actions 1 and previous stories 1.
Building the knowledge base.
Knowledge Base 1
E
R
Agent 1
Actions 2 and previous stories 2.
Building the knowledge base.
Knowledge Base 2
E
R
Agent 2
Improvisación
Previous Stories 1
Previous Stories 2
We are interested in identifying and studying the characteristics of this breaking point
Exploring different ways of presenting the plots generated by the
system
MEXICA presents its outputs in three possible ways:
As a sequence of actions
As a more elaborated (predefined) text
As a visual narrative
(How text influence image
How image influence text)
Visual Daydreamer
In the visual narrative , each action is represented by a scene.
This is an example combining illustrations and elaborated
predefined texts
Princess's frame of mind was very volatile and without thinking about it princess charged against jaguar knight
Princess threw some dust in jaguar knight's face. Then, using a dagger princess perforated jaguar knight's chess
Princess got that depress that committed suicide
The End
Trope Tank Lab
Working at the
Nick Montfort Fox Harrell
We are trying to design a more complete narrative
generator.
SLANT
The general idea is, based on our previous work, to produce a new interesting model
Exploring the use of the ER Model in Design
The ERI Designer
A Computer Model for the Automatic Generation of Visual Compositions
Current PhD research projects
A virtual developmental agent
Wendy Aguilar
• We are working on a computer model that:
Objectives
We are interested in the origins of the creative behavior.
• Initially is provided with basic knowledge structures and skills and, through interaction with its environment, it develops automatically novel behaviors
The virtual world
The agent
The computer program implementing the agent’s architecture
A Computer Model for Social Norms Representation
Carlos Iván Guerrero Román
Representation of social norms
Development of a computational model for the generalization of the Knowledge Inspired in
the theory R-R (Representational -Redescription)
Edgar Morales Palafox