Virtual Worlds And Real World
-
Upload
kanavkahol -
Category
Technology
-
view
340 -
download
0
description
Transcript of Virtual Worlds And Real World
![Page 1: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/1.jpg)
Virtual Worlds and Real World
By the real… Of the Real… For the Real…
![Page 2: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/2.jpg)
Contents
• What to capture from the real world?
• How to simulate in the virtual world?
• How to measure transfer in the real world?
![Page 3: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/3.jpg)
A model of the real world..
IT MAY BE ARGUED THAT ACTIVITIES, INTERACTIONS AND COGNITION IS WHERETHE BIGGEST BANG FOR THE BUCK IS….
![Page 4: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/4.jpg)
Visual Appearance
• Need 3D Models: www.3dcafe.com, www.exchange3d.com, www.turbosquid.com
• Modification of Models: Need Maya, 3D Studio Max… free solutions Vorpal, MeshMan (www.ryanholmes.net) 3D Object converter.
• Need textures… get a camera and click pics of real world. Make images small in size <100K in size.
• Need space: www.secondlife.com, www.activeworlds.com www.forterra.com
![Page 5: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/5.jpg)
Entities.
• Poser® allows for clicking front and side images and enables building of a model.
• For non-human entities search the 3D models websites…
![Page 6: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/6.jpg)
Activities and Interactions
• This is where conventional off-the-shelf approaches don’t work.
• We need a fly on the wall… a system which much like blackbox captures interactions in real environment without much interventions.
• We can develop models of normative behavior and simulate that and…
![Page 7: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/7.jpg)
Interactions in a Complex Environment
• High performance, high complexity environment with high interpersonal variations and interactions that are unstructured.
• Interactions are multimodal and not just verbal– Speech– Movement– Proximity – Gestures
THE PROBLEM
BehavioralManifestations
BehavioralManifestations
Cognitive Foundations
Cognitive Foundations
![Page 8: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/8.jpg)
Capturing Interactions….DetailedBut HumanIntensive andCan missDynamic Events
Data DrivenToo CoarseNot cognitively grounded
Laxmisan et al. 2007 Malhotra et al. 2007
Alwan et al. 2006Ostbye et al. 2003
![Page 9: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/9.jpg)
Proposed Hybrid Method
![Page 10: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/10.jpg)
Qualitative Data
OntologyBy Zhang et al.
![Page 11: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/11.jpg)
Quantitative Data
Movement/Proximity Data Speech/Voice Data
![Page 12: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/12.jpg)
Capturing Movement Data• A common approach is to
focus on <x,y,z> location of entities and then developing activities as deterministic models of location.
• The issue: sensors such as RID sensors suck when it comes to movement by themselves.
• What can we do?• Well the end product is
activities.. Why not develop probabilistic models of activities from noisy data.
![Page 13: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/13.jpg)
Activity Recognition• Activity Recognition is a
burgeoning area..• Routinely done through
computer vision, sensor processing and data mining.
• We use temporal modeling techniques such as Hidden markov Models for detecting activities (gestures).
![Page 14: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/14.jpg)
Scenario
![Page 15: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/15.jpg)
But I really really want location• A multisensor approach is a
valid method of finding exact locations.
• Multisensor fusion provides multiple streams of data and enables a correction mechanism to combine multiple noisy streams to yield a single noiseless stream.
• A possible mechanism for sensor fusion is a predictro corrector mechanism called Kalman Filter.
![Page 16: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/16.jpg)
Kalman Filter
Extended Kalman FilterDiscrete Kalman Filter
Assumed noise
![Page 17: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/17.jpg)
Integration of Audio Data
• HIPAA regulations: security and privacy• Time synchronization• Audio Analytics– Number of words spoken– Tone/Amplitude of the signal– Directionality of Verbal Interactions.
![Page 18: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/18.jpg)
Movement Analysis Results
UT HoustonBanner Health
![Page 19: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/19.jpg)
Location Detection• Kalman filter to combine accelerometer data
with RID based location data
![Page 20: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/20.jpg)
Virtual Playback and Analysis Tool
Demo
![Page 21: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/21.jpg)
Building Learning Environments
![Page 22: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/22.jpg)
Persuasive Collaborative FrameworkExternal motivatorsInternal motivators
Feedback on patient conditionsdue to decisions
Encouraging group consensus, Dissent.Shared mental models
![Page 23: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/23.jpg)
Tabletop exercises
*courtesy ICT USC
Supplemented by offline sessions on web 2.0 tools
![Page 24: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/24.jpg)
Case Study Design• Develop a decision tree for
case solving stopping at different times during vignettes and asking questions.
• Using custom software it is possible to group answers based on clinical specialtys or groups
• Word clouds can be shown for answers by these different groups to enable visualization of differences in mental models and then promotion of shared mental models.
![Page 25: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/25.jpg)
Validation Strategy
![Page 26: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/26.jpg)
Validation Strategy
• Actual usage statistics
– Track usage statistics
– Track number of times community option is used.
– Track number of times alternative path of care is used.
• User preference models
– User preference for tools
• Reveal the effect of different tools on diagnostic and clinical abilities.
• Differentiate between levels of expertise.
• Reveal underlying trends on technology adoption with regards to attitudes to
technology, demographic information etc.
• Reveal difference in teams physically co-located and physically separated during
training.
![Page 27: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/27.jpg)
Some Interesting Studies.
• Discussion on what can be done.
![Page 28: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/28.jpg)
Take Home Simulators• Re-use of existing resources such
as simulation gaming platform has several advantages
• Can provide practice on psychomotor and cognitive skills
• Engaging and fun for trainees • Several students can study
together• Connectivity proficiency scores can
be transmitted to database over the Internet
• Can be deployed anywhere, remote areas as well as developing countries
![Page 29: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/29.jpg)
Methodology For Choosing ExercisesCognitive task analysisSuturing->{setting the needle->passing suture->tying}
Matching observationalParameters in the real world And virtual world
Monitor progressthrough mechanism that work in an ambient manner
Adapt gaming scores to our needs
![Page 30: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/30.jpg)
Wii and fine motor skills
Fine motor skills based games are very suitable
Very high correlation with basic gestures of surgery
Quantitatively we found that hand movement acceleration, and joint angles showed 0.78 to 0.91% correlation.
Cons: doesn’t have the fulcrum effect and significant weight.
![Page 31: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/31.jpg)
Apparatus
• Gaming Extensions to Wii can be modified for surgical probe based interactions.
• WiiMote Extension• Movement Constrainer
Location of wiimote
![Page 32: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/32.jpg)
Full System in Action
![Page 33: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/33.jpg)
Study
![Page 34: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/34.jpg)
Robotic Surgery Simulator
![Page 35: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/35.jpg)
Analysis• Exploring the error innovation
continuum• Focus in analysis on best practices
and validity of checklists in Trauma and critical care settings.
• We performed analysis on ATLS training and execution and used the tool to analyze if activities as cited in checklists are followed.
• Hypothesis: Experts assign criticality to steps in a procedure and tend to follow high criticality steps with precision but innovate in low criticality steps.
• Criticality obtained by focus group sessions with physicians, nurses and residents with checklists.
![Page 36: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/36.jpg)
Adherence to Best Practices and Accuracy
Perc
enta
ge
![Page 37: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/37.jpg)
Future Work: Technical
• An activity segmentation algorithm: using the accelerometer, we aim to define a method to segment data into activities and then recognize them.
• Based on Kahol (2003) , we propose to use Bayesian techniques to identify activity boundaries automatically.
• Pilot data gathered at ASU and UT Houston.
![Page 38: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/38.jpg)
Future Work: Analytical
• Employ the tool to further explore error-innovation continuum in critical care environment.
• One mans error is another mans innovation.• This evolves extensively in critical care
environments and ASU and BannerHealth will develop methodology to explore how errors and innovations evolve in critical care environments.
![Page 39: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/39.jpg)
Future Work Interventions
• The developed tools will be employed with new year residents for training in a control group experimental group paradigm.
• We expect that the group with exposure to workflow will be better integrated in the trauma unit workflow as compared to the group that doesn’t.
![Page 40: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/40.jpg)
Conclusions
• Virtual from real is fun and effective…
• Focus on the activities and interactions visual brilliance is over-rated and your main aim is education anyway…
• Go with environments that allow programming…
• What are you waiting for… build it!
![Page 41: Virtual Worlds And Real World](https://reader036.fdocuments.in/reader036/viewer/2022081514/55627c5ad8b42ae73c8b4f0f/html5/thumbnails/41.jpg)
thanks
Partner
LABORATORY