VRGraphicS Virtual Reality, Computer Graphics and Simulation
Simulation and Virtual Reality
Transcript of Simulation and Virtual Reality
![Page 1: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/1.jpg)
Jim X. Chen, Ph.D.Department of Computer Science
George Mason University
Simulation and Virtual RealitySimulation and Virtual Realityfor Education and Medical Applications
![Page 2: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/2.jpg)
2
1.1. Simulation of FluidsSimulation of Fluids
2.2. Edutainment: Learning through PlayingEdutainment: Learning through Playing
3.3. Knee Surgery Assistance SystemKnee Surgery Assistance System
4.4. Temporal Bone Visualization and Virtual Ear Temporal Bone Visualization and Virtual Ear SurgerySurgery
5.5. Virtual Human AnatomyVirtual Human Anatomy
6.6. A New Graphics Pipeline for Atomic PrimitivesA New Graphics Pipeline for Atomic Primitives
![Page 3: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/3.jpg)
3
1. Simulation of Fluids• Objective
– Liquid behavior: water waves, wakes behind boats– Dust behavior: dust behind moving vehicles– Distortion: water drop on glasses– Lens and depth of field: nonplanar projection, fog effects
• Applications– Integrated synthetic virtual environment– Education, training, visualization, and entertainment
• Project originally funded by US Army STRICOM• SAIC, STRICOM, Disney, Dreamworks requested the
methods
![Page 4: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/4.jpg)
4
1.1 Liquid behavior1.1 Liquid behavior• Physically-based real-time simulation
2D Navier-Stokes Equations in 120x80 grids– raise to 3D according to the pressure
p(x,y)– method later justified by Bernoulli
equation– many new modeled behaviors in graphics:
objects interacting with the fluid, wakes, etc.
![Page 5: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/5.jpg)
5
Snapshots: water behavior• Wake, turbulence, & environment
![Page 6: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/6.jpg)
6
1.2 Dust behavior1.2 Dust behavior• Fluid behavior behind a moving vehicle• Dust particle generation and dynamics
![Page 7: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/7.jpg)
7
Turbulent fluid behavior
• Re>105: full turbulent in the wake area
![Page 8: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/8.jpg)
8
Fluid simulation method
• At low Re region, use 3D finite difference to calculate the Navier-Stokes equations. – Numerical scheme:
• Successive-Over-Relaxation (SOR) for Poisson Pressure Equation
• Alternating-Direction Implicit (ADI) for momentum equations
![Page 9: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/9.jpg)
9
Dust generation– Centrifugal, gravity,
tire and air drag– Pressure gradient
under & behind car– Tire splashing– Many parameters
related to vehicle, particle, and environment
![Page 10: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/10.jpg)
10
Animation & simulation: dust behavior
![Page 11: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/11.jpg)
11
Real-time rendering
• Pre-calculate fluid dynamics– laminar velocity volume moving & turning
• Simplify dust dynamics: 3 stages– turbulence, momentum, and drift
• OpenGL advanced rendering– texture mapping, blending and transparency
![Page 12: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/12.jpg)
12
Real-time fluid simulation
![Page 13: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/13.jpg)
13
1.3 Distortion: water drop1.3 Distortion: water drop
• Submarine periscope – water flows on the periscope when raised
form underwater– Distorted view of the world
![Page 14: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/14.jpg)
14
Real-time simulation of water droplets on glass windows
• In order to be in real-time– manipulate the framebuffer after rendering – ignore physics behavior
![Page 15: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/15.jpg)
15
1.4 Lens and depth1.4 Lens and depth--ofof--fieldfield
• Lens– Lens distortion for special effects– What would be the physically-correct scene
from the periscope?
• Depth of Field– Graphics is better than camera– Lens has focal point that relates to the depth
![Page 16: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/16.jpg)
16
Lens distortion: nonplanar projection• Different from traditional
graphics projection
![Page 17: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/17.jpg)
17
Effects of distortion
![Page 18: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/18.jpg)
18
Depth-of-field
• Graphics use pin-hole camera; water-drop adds a lens layer
Pin-hole Camera Model
Thin Lens Camera Model
image plane image plane
![Page 19: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/19.jpg)
19
Lens and depth-of-field• Only things in focus will be sharp … z-
buffer value in hardware calculation
![Page 20: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/20.jpg)
20
View plane View
point View plane
Undesirable fog artifacts
Initial observer’s orientation
After observer’s rotation
Background is not fogged
View point
![Page 21: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/21.jpg)
21
Post-processingcalculate from z-buffer value and viewpoint with
custom fog functions
Linear attenuationLayered fog
![Page 22: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/22.jpg)
22
Summary: selected publications• T. Zhou and J.X. Chen, “Fog Effects Using Post Processing,” in submission. • T. Zhou, J.X. Chen, and M. Pullen, “Generating Accurate Depth Effects in OpenGL,”
Computer Graphics Forum, to appear. • S. Liu, X. Jin, C.C.L. Wang, and J.X. Chen, “Water-Wave Animation on Mesh Surfaces,”
IEEE Computing in Science and Engineering, vol. 8, no.5, Sept. 2006, pp. 81-87.• Y. Yang, J.X. Chen, and M. Beheshti, “Nonlinear Perspective Projections and Magic
Lenses: 3D View Deformation,” IEEE Computer Graphics and Applications, vol. 25, no. 1, Jan. 2005, pp. 76-84.
• J.X. Chen, Y. Yang, and X. Wang, “Physics-based Modeling and Real-time Simulation,”IEEE Computing in Science and Engineering, vol. 3, no. 3, May/June 2001, pp. 98-102. .
• J.X. Chen, X. Fu, and E.J. Wegman, “Real-Time Simulation of Dust Behaviors Generated by a Fast Traveling Vehicle,” ACM Transactions on Modeling and Computer Simulation, vol. 9, no. 2, April 1999, pp. 81-104.
• J.X. Chen and X. Fu, “Integrating Physics-Based Computing and Visualization: Modeling Dust Behavior,” IEEE Computing in Science and Engineering, vol. 1, no. 1, Jan. 1999, pp. 12-16.
• J.X. Chen, N.V. Lobo, C.E. Hughes and J.M. Moshell, “Real-time Fluid Simulation in a Networked Virtual Environment,” IEEE Computer Graphics and Applications, vol. 17, no. 3, 1997, pp. 52-61.
• J.X. Chen, “Physically-based Modeling and Real-time Simulation of Fluids in a Networked Virtual Environment,” The Link Foundation Fellowship in Advanced Simulation and Training, PUBLISHER - Institute for Simulation and Training, Orlando, Florida, June 1995.
• J.X. Chen, and N. V. Lobo, “Toward Interactive-Rate Simulation of Fluids with Moving Obstacles Using Navier-Stokes Equations,” CVGIP: Graphical Models and Image Processing, vol. 57, no. 2, 1995, pp. 107-116.
![Page 23: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/23.jpg)
23
2. Edutainment: Learning through 2. Edutainment: Learning through PlayingPlaying
ObjectiveImplementation and integration of
Physics/math behavior with abstract equationsVirtual environment in 3D sound and haptic devicesPC-based VR platformNetworked virtual environments
ApplicationsLearning abstract scientific concepts
Computational Steering: Navier-Stokes’ equations ScienceSpace: Maxwell’ equations, Newton’s lawsDEVISE - Designing Environments for Virtual Immersive Science Education
Learning in networked virtual environmentsMUVEES – multi-user virtual environments exploration system
![Page 24: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/24.jpg)
24
2.1 Computational steering
Learn 2D and 3D Navier-Stokes equationsInteractive control of the parameters in the equationImmersive application let the student ‘feel’ the fluid
![Page 25: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/25.jpg)
25
Learning Fluid Concepts
![Page 26: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/26.jpg)
26
2.2 Project ScienceSpace: Using Immersive Virtual Worldsin Real World Classrooms
![Page 27: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/27.jpg)
27
2.3 Project DEVISE:Designing Environments for Virtual Immersive Science Education
Low-end PC Platform
Physics Real-time Simulation
Visual and Auditory Immersion
Dynamic Reconfigurable HCI for Learners with a Disability
![Page 28: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/28.jpg)
28
Analyzed the Prototype for:
Science content
Usability of interface
Appeal to our teenaged audience
Appropriate strategies for students with learning disabilities
![Page 29: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/29.jpg)
29
Example: Demo Circular Motion
Students explore and manipulate variables to discover how a shuttle’s motion is affected by:
•horizontal circular motion
•an impulse force
•friction
•mass
![Page 30: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/30.jpg)
30
2.4 PROJECT MUVEES:Multi-User Virtual Environments Exploration System
Networked multimedia environments
Multi-user avatars simultaneously navigating VR worlds
Distance users communicating among groups
Computer-generated agents joining intelligent discussions
Collaborative learning activities of various types, and
Users’ behavior analysis and documentation
![Page 31: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/31.jpg)
31
MUVEES Interface
1. 3D world space
3. Dialogue space
2. Display space
4. Map space
![Page 32: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/32.jpg)
32
MUVEES Architecture
MUVEESModerator
Server(VW a)
Server(VW b1, VW b2 )
Server(VW x)
(VW a)(VW b1)
(VW b2) (VW x)
TCPTCP
TCP
UDP UDP UDP
Participants Participants Participants
ModeratorBackup
FTP
![Page 33: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/33.jpg)
33
MUVEES Functions
Divided into six categories:
Navigation
Education
3D Object Construction
Administration
Graphics
Others
![Page 34: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/34.jpg)
34
MUVEES Snapshots
![Page 35: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/35.jpg)
35
Entering the Chemistry Lab
![Page 36: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/36.jpg)
36
Testing the Water Quality
![Page 37: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/37.jpg)
37
2.5 Synchronization in Networked Virtual Environment (NVE)
Physical behavior & effects generated locally (vehicles, water, dust, etc.)Uniform time scale & variable time-slicing: lastTime; currentTimePlayer and ghost synchronization
![Page 38: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/38.jpg)
38
Synchronization Mechanism
DIS network
Pi = Object i (on node i)Gij = Ghost of Object i on node j
Node0
G00 G10... Gn0
P0 Node1
G01 G11...Gn1
P1 Node n
G0n G1n... Gnn
Pn
MovablewallClock
![Page 39: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/39.jpg)
39
• Assumessume Δt satisfies numerical stability. • Δtn can be divided into a number of Δt’s• physical phenomena can be simulated ⎣Δtn/Δt⎦ times
Time differential for physically-based models
Δ t
state n state n+1n
timeproc. calc. calc. calc. render.
...
![Page 40: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/40.jpg)
40
Collaborative learning in NVElearners in the networked simulations see other learners’ actions and study the corresponding results
discussing experiences of manipulating various parameters mastering the theories behind the simulation by playing motivational, interactive games together.
instructors can demonstrate abstract concepts by correlations between the natural phenomena and the abstract variables. All participants can manipulate parameters and variables.
![Page 41: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/41.jpg)
41
Summary: selected publicationsJ.X. Chen, “Learning Abstract Concepts through Interactive Playing,” Computers & Graphics, vol. 30, no.1, 2006, pp. 10-19.Z. Xu, Y. Yan, and J.X. Chen, “OpenGL Programming in Java,” IEEE Computing in Science and Engineering, vol. 7, no. 1, Jan. 2005, pp. 51-55. F.T. Alotaiby, J.X. Chen, H. Wechsler, E.J. Wegman, and D. Sprague, “Adaptive Web-based Learning System,” 12th IEEE International Conference and Workshop on the Engineering of Computer Based Systems (ECBS’05), April 2005, pp. 423 - 430.F.T. Alotaiby, J.X. Chen, E.J. Wegman, H. Wechsler, and D. Sprague, “Teacher-Driven: Web-based Learning System,” ACM SIGITE’04, Oct. 2004, pp. 284-288.(32%) J.X. Chen, Y. Yang, and R.B. Loftin, “MUVEES: a PC-based Multi-User Virtual Environment for Learning,” Proc. IEEE Virtual Reality (VR’03), IEEE Computer Society Press, New York, April 2003, pp. 163-170. (28%) J.X. Chen, C. J. Dede, X. Fu, and Y. Yang, “Distributed Interactive Learning Environment,” 3rd IEEE International Workshop on Distributed Interactive Simulation and Real Time Applications (DiS-RT’99), Oct. 1999, pp. 49-56. (57%) M.C. Salzman, C. J. Dede, R.B. Loftin, and J.X. Chen, “Understanding How Immersive VR Learning Environments Support Learning through Modeling,” PRESENCE: The Journal of Teleoperators and Virtual Environments, vol. 8, no. 3, June 1999, pp. 293-316. J.X. Chen, D. Rine, and H.D. Simon, “Advancing Interactive Visualization and Computational Steering,” IEEE Computational Science and Engineering, vol. 3, no. 4, 1996, pp. 13-17. J.X. Chen, J.M. Moshell, C. E. Hughes, B. Blau, and X. Li, “Distributed Virtual Environment Real-Time Simulation Network,” Advances in Modeling and Analysis B, AMSE periodicals, vol. 31, no. 1, 1994, pp. 1-7.
![Page 42: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/42.jpg)
4242
3. Modeling and visualization 3. Modeling and visualization for knee surgery assistancefor knee surgery assistanceObjectiveObjective–– Implementation and integration of Implementation and integration of
3D patient3D patient--specific model constructionspecific model construction3D knee motion 3D knee motion Contact area calculationContact area calculationContact force and pressure distributionContact force and pressure distributionRealReal--time surgery simulationtime surgery simulation
ApplicationsApplications–– Patient diagnostics Patient diagnostics –– Problem and surgery procedure explanationProblem and surgery procedure explanation–– Specific surgery planning Specific surgery planning –– Virtual surgery simulation for trainingVirtual surgery simulation for training
![Page 43: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/43.jpg)
4343
3.1 3D patient model construction3.1 3D patient model construction
Marching cube algorithmMarching cube algorithmInterpolation between contoursInterpolation between contoursModelModel--based reconstructionbased reconstructionOur approachOur approach
![Page 44: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/44.jpg)
4444
3D knee model construction3D knee model construction
Patient Bone Model
–– Also called knee reconstructionAlso called knee reconstruction–– Find corresponding points between Find corresponding points between
the MRI boundary pixels and the the MRI boundary pixels and the references modelreferences model
–– Deform the reference model to Deform the reference model to patient bone modelpatient bone model
![Page 45: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/45.jpg)
4545
Image segmentationImage segmentation
‘‘SnakeSnake’’ algorithmalgorithm::–– Cut 3D reference model Cut 3D reference model
where the MR images are where the MR images are taken.taken.
–– Use the intersections as Use the intersections as initial 2D deformable initial 2D deformable model.model.
–– Use 2D Use 2D ‘‘snakesnake’’ algorithm to algorithm to segment MR images.segment MR images. Reference
modelReference model
![Page 46: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/46.jpg)
4646
Image segmentationImage segmentation
Snake must be close to boundaryUse previous contour for next slice
![Page 47: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/47.jpg)
4747
Image segmentation Image segmentation –– cont.cont.
Initial “snake”
position
Initial “snake”
positionAfter segmentation
After segmentation Contour modelContour model
![Page 48: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/48.jpg)
4848
Align Reference Model with Contour Align Reference Model with Contour ModelModel
Roughly align reference Roughly align reference model with knee contours model with knee contours using affine transformations.using affine transformations.
![Page 49: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/49.jpg)
4949
Establish correspondenceEstablish correspondence
Project the reference Project the reference model and contour model and contour model respectively onto model respectively onto an intermediate object.an intermediate object.Points projected to the Points projected to the same location of the same location of the intermediate object are intermediate object are paired as corresponding paired as corresponding points. points. MRI Model Feature curves
on reference model
![Page 50: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/50.jpg)
5050
Model deformationModel deformation
Define feature points and Define feature points and their influence regions.their influence regions.The The influence regioninfluence regionincludes all the pointsincludes all the pointsthat are within certainthat are within certainsurface distance from surface distance from the feature point.the feature point.
![Page 51: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/51.jpg)
5151
3D Reconstruction Result3D Reconstruction Result
Contour model Result modelContour model Result model
![Page 52: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/52.jpg)
5252
3.2 Visualization of knee motion3.2 Visualization of knee motion
Collect data from patient through a motion capture system.
Collect data from patient through a motion capture system.
Knee motion visualization with stick model.
Knee motion visualization with stick model.
Knee motion visualization with patient-specific 3D model
Knee motion visualization with patient-specific 3D model
![Page 53: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/53.jpg)
5353
Knee Motion SimulationKnee Motion Simulation
Motion definition:Motion definition:–– three rotationsthree rotations–– two kinds of translations, two kinds of translations,
vertical translationsvertical translationsare ignored.are ignored.
Definition of knee Definition of knee rotation axes.rotation axes.
![Page 54: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/54.jpg)
5454
Motion Simulation ResultMotion Simulation Result
![Page 55: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/55.jpg)
5555
3.3 Contact Area Calculation3.3 Contact Area Calculation
PurposePurpose: Detect and measure the : Detect and measure the contact area between femur and contact area between femur and menisci.menisci.Simulate the deformation of Simulate the deformation of menisci.menisci.Use collision detection to identify Use collision detection to identify and measure the contact area.and measure the contact area.
![Page 56: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/56.jpg)
5656
A New Deformation TechniqueA New Deformation Technique
Each object is Each object is bundled with bundled with a number of a number of feature wires. feature wires. Each point on Each point on a wire has its a wire has its own influence own influence region on the region on the 3D model.3D model.The deformation of feature curves are physicallyThe deformation of feature curves are physically--based.based.When a point on a feature wire is moved, all the When a point on a feature wire is moved, all the
points in its influence region will move points in its influence region will move accordingly.accordingly.
![Page 57: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/57.jpg)
5757
Menisci deformedMenisci deformed Menisci not deformedMenisci not deformed
![Page 58: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/58.jpg)
5858
Contact Area DisplayContact Area Display
![Page 59: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/59.jpg)
5959
3.4 Contact Force Calculation and 3.4 Contact Force Calculation and VisualizationVisualization
Establish a biomechanical knee Establish a biomechanical knee model.model.Solve the biomechanical knee model Solve the biomechanical knee model and obtain the contact forces and obtain the contact forces between femur and tibia.between femur and tibia.Knee contact force visualization.Knee contact force visualization.
![Page 60: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/60.jpg)
6060
Calculate contact pts & stressCalculate contact pts & stress–– Equilibrium lawsEquilibrium laws
F F Fe c lj
j+ + =∑ 0
M M Me c lj
j+ + =∑ 0
Fe: external forces, including body weight, ground reaction force, and muscle forces.
Fc: contact forces; Fl: ligament forces. There are 7 ligaments on the knee joint.
Me: external moments; Mc: contact moments.
Ml: ligament momunts.
Fe: external forces, including body weight, ground reaction force, and muscle forces.
Fc: contact forces; Fl: ligament forces. There are 7 ligaments on the knee joint.
Me: external moments; Mc: contact moments.
Ml: ligament momunts.
![Page 61: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/61.jpg)
6161
Visualizing Knee Contact ForceVisualizing Knee Contact Force
The colored circles on the knee surface show the contact forces.
The colored circles on the knee surface show the contact forces.
![Page 62: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/62.jpg)
6262
Visualization of contact stress Visualization of contact stress
The colored circles on the knee surface show the contact stress.
The colored circles on the knee surface show the contact stress.
![Page 63: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/63.jpg)
6363
3.5 Surgery assistance3.5 Surgery assistance
![Page 64: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/64.jpg)
6464
Summary: selected publicationsSummary: selected publicationsY. Zhu and Y. Zhu and J.X. ChenJ.X. Chen, , ““Simulation and Visualization of Knee Joint Simulation and Visualization of Knee Joint Contact using Deformable ModelContact using Deformable Model””, , 4th IEEE International 4th IEEE International Conference on Computer and Information Technology (CIT 2004)Conference on Computer and Information Technology (CIT 2004), , ISBN 0ISBN 0--76957695--22162216--5/04, IEEE Computer Society Press, Sept. 5/04, IEEE Computer Society Press, Sept. 2004, pp. 7082004, pp. 708--715. (26%) 715. (26%)
J.X. ChenJ.X. Chen, H. Wechsler, J.M. Pullen, Y. Zhu, E.B. , H. Wechsler, J.M. Pullen, Y. Zhu, E.B. MacMahonMacMahon, , ““Knee Surgery Assistance: Patient Model Construction, Motion Knee Surgery Assistance: Patient Model Construction, Motion Simulation, and Biomechanical Visualization,Simulation, and Biomechanical Visualization,”” IEEE Transactions IEEE Transactions on Biomedical Engineeringon Biomedical Engineering, vol. 48, no. 9, Sept. 2001, pp. 1042, vol. 48, no. 9, Sept. 2001, pp. 1042--1052. 1052.
Y. Zhu, Y. Zhu, J.X. ChenJ.X. Chen, and X. Fu, , and X. Fu, ““A Virtual Reality System for Knee A Virtual Reality System for Knee Diagnosis and Surgery Simulation,Diagnosis and Surgery Simulation,”” IEEE Virtual RealityIEEE Virtual Reality’’9999, March , March 1999, pp. 841999, pp. 84--85. (21%) 85. (21%)
Y. Zhu, Y. Zhu, J.X. ChenJ.X. Chen, S. Xiao, and E.B. , S. Xiao, and E.B. MacMahonMacMahon, , ““3D Knee 3D Knee Modeling and Biomechanical Simulation,Modeling and Biomechanical Simulation,”” IEEEIEEE Computing in Computing in Science and Engineering, vol. 1, no. 4, July 1999, pp. 82Science and Engineering, vol. 1, no. 4, July 1999, pp. 82--87. 87.
![Page 65: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/65.jpg)
65
4. 4. Temporal Bone Visualization & Temporal Bone Visualization & Virtual Ear SurgeryVirtual Ear Surgery
In collaboration with Peidong Dai, Tianyu Zhang, Zhenmin Wang, etc. at
Eye and Ear Nose Throat Hospital of Fudan University, Shanghai, China
![Page 66: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/66.jpg)
66
IntroductionIntroduction
ObjectiveObjectiveConstruct detailed temporal bone modelConstruct detailed temporal bone modelBuild up a virtual ear surgery system Build up a virtual ear surgery system
ApplicationsApplicationsSurgery training Surgery training Surgery studySurgery studyHearing system modeling, simulation, and Hearing system modeling, simulation, and understandingunderstanding
![Page 67: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/67.jpg)
67
Lateral skullbase, especially its temporal bone, is one of the most complicated area in human body.
Background
![Page 68: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/68.jpg)
68
Univ. of I l l inois Chicago, School of B i o m e d i c a l a n d Health Information Sciences, 1999 .
Three-dimensional reconstruction of temporal bone
Dai Pu, et al. ENT department, 301 Hospital of PLA, Beijing, 1998 .
ImmersaDesk system for temporal bone visualization
1,2. Labyrinth, auditory ossicles, and CNⅦ 3. Posterior tympanum
31 2
Background
![Page 69: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/69.jpg)
69
René G. van WijheMcGill University Biomedical Engineering Montreal, Quebec,1997
Ron Kikinis, et al.Surgical Planning LaboratoryDepartment of RadiologyHarvard Medical School, 2000
Background
![Page 70: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/70.jpg)
70
• 3D morphological analysis of the lateral skullbase• Visualization of the temporal bone • Computer assisted design of approaches for ear surgery
• Virtual reality for ear microsurgery• Virtual reality for sound conducting process through ear
Our Research
Our Researches
![Page 71: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/71.jpg)
71
Computer processing Computer processing flowchart diagramflowchart diagram
HE staining
Specimen disposing
Serial 50µm sections
Undecalcified bone embedded in MMA
Making serial sections of temporal bone specimen
Image processing
Image alignment
Image registration
Contour extracting
3D reconstruction
Section imaging
Computer Reconstruction
Methods
VR X6000A Virtual Lab
![Page 72: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/72.jpg)
72
Roaming virtual temporal bone with 3D glasses and stereo projection system
Performing virtual operation with Spaceball and 3D glasses
Methods
![Page 73: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/73.jpg)
73
Utricle, saccule, and footplate in relation to stapedotomy
Visualization of temporal bone
![Page 74: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/74.jpg)
74
Visualization of temporal bone
![Page 75: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/75.jpg)
75
From the lateral surface of the footplate (assumed horizontal plane or “sea level”) to “seabed”, the different sections of the utricle, saccule, and cochlear duct with different elevations were marked with different colors, and all these sections were superposed to form the contour map. The contour interval is 0.2mm. The black oval contour at the center of the figure represented the footplate.
Visualization of temporal bone
The contour map of utricle and saccule
![Page 76: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/76.jpg)
76
The other 3 contour maps of utricles and saccules
Visualization of temporal bone
![Page 77: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/77.jpg)
77
The diagrammatic sketch showing the different areas in which theshortest vertical distances between the footplate and utricle orsaccule are no less than 1.8, 1.6, 1.4, 1.2, and 1.0 mm, respectively, among 4 specimens.
Visualization of temporal bone
![Page 78: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/78.jpg)
78
Designs for the depth and orientation of the small plug column in
stapedotomystapedotomy
1-footplate2-small column3-Z axis4-saccule5-utricle6-tensor tympani7-X and Y axes8-lateral semicircular canal9-long process of incus
Visualization of temporal bone
![Page 79: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/79.jpg)
79
Visualization of temporal bone
![Page 80: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/80.jpg)
80
Summary: selected publicationsSummary: selected publications
T. Zhang, P. Dai, T. Zhang, P. Dai, J.X. ChenJ.X. Chen, L. , L. XieXie, Z. Wang, , Z. Wang, K. Wang, K. Wang, ““The Contour Map of the Vestibular The Contour Map of the Vestibular Apparatus Based on ThreeApparatus Based on Three--Dimensional Dimensional Reconstruction of the Temporal Bone,Reconstruction of the Temporal Bone,””Computing in Science and EngineeringComputing in Science and Engineering, (to appear)., (to appear).P. Dai, T. Zhang, P. Dai, T. Zhang, J.X. ChenJ.X. Chen, Z. Wang, and K. , Z. Wang, and K. Wang, Wang, ““Virtual Laboratory for Temporal Bone Virtual Laboratory for Temporal Bone Microanatomy,Microanatomy,”” Computing in Science and Computing in Science and EngineeringEngineering, vol. 7, no.2, March 2005, pp. 75, vol. 7, no.2, March 2005, pp. 75--79.79.
![Page 81: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/81.jpg)
81
5. Virtual Human Anatomy and 5. Virtual Human Anatomy and Surgery SystemSurgery System
Yanling Liu and Jim X. ChenDepartment of Computer Science
George Mason University
Ling YangSichuan Continuing Education College of Medical Sciences
Spring 2006
![Page 82: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/82.jpg)
82
Introduction• Objective
– Construct detailed virtual human body• Natural color• Graphics objects for different components
– Allow separating and labeling different components through haptic devices (virtual anatomy)
• Applications– Cadavers are in short supply in medical schools
worldwide. Our solution: virtual human anatomy for learning
– General medical and surgical training
![Page 83: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/83.jpg)
83
Virtual Human Anatomy and Surgery System (VHASS)
• VHASS uses cryosection images – natural-color images generated by slicing a frozen cadaver – to reconstruct the human body.
![Page 84: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/84.jpg)
84
VHASS functionalities so far
– Reconstruct natural-appearance volume model for each human part
– Allow grouping and labeling human parts – Provide real-time interaction and browsing– Generates arbitrary orientated natural color
human cross section in real-time– Integrate haptic device for drilling operation
simulation
![Page 85: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/85.jpg)
85
Dissection via Cryosection
• At Sichuan Continuing Education College of Medical Sciences in China
– Prof. Lin Yang teach her students the anatomic structure using cryosection images.
– students found pixels belonging to the same body part and filled these pixels with a designated color.
• Two sets of the same images: the natural color images and the colored images.
![Page 86: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/86.jpg)
86
Data preparation and acquisition (1)
• 2100 scanned cryo-section images– 3072 x 2048 pixel resolution– 18M bytes for each uncompressed image– Four different thickness:
• 0.1mm• 0.2mm• 0.5mm• 1.0mm
• 2100 colored images
![Page 87: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/87.jpg)
87
Data preparation and acquisition (2)
![Page 88: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/88.jpg)
88
Data preparation and acquisition (3)
![Page 89: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/89.jpg)
89
Data preparation and acquisition (4)
• Pixels of one certain human part were extracted and converted as voxels.
• Volume data will be used later for rendering.
![Page 90: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/90.jpg)
90
Some technical Details
• Totally we have 2011 original cryosectionimages and 2011 colored images.
• Both sets have a 3,072 x 2,048 pixel resolution, and each uncompressed image uses roughly 18Mbytes of storage space.
• Different from the Virtual Human Project, four different thicknesses are applied to reduce loss of details: 0.1mm, 0.2mm, 0.5mm and 1.0mm.
![Page 91: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/91.jpg)
91
Rendering details
• Use OpenSceneGraph to handle renderings of volume models for human parts.
• Integrate GLSL (OpenGL Shading Language) for pixel shading support.
• This movie shows rendering effect of brain cortex, cerebellar cortex and eyeball.
![Page 92: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/92.jpg)
92
High quality real-time virtual human rendering
![Page 93: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/93.jpg)
93
Real-time human part scanner (1)
• CT and MRI cannot generate natural colorcross section of human body.
• Also they can not produce human body cross sections with an arbitrary orientation.
![Page 94: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/94.jpg)
94
Real-time human part scanner (2)
• VHASS provides a scanner to perform arbitrary dissection on human parts. – The dissection operation is defined by a dissection
plane. – Parameters of the dissection plane include normal
vector, origin coordination, motion mode, movement speed, and direction.
– straight line scan and rotating scan available• Based on our new volume models, the scanner can
perform continuous scanning operation on human body similar to CT and MRI scanning.
• As a result, people can continuously view arbitrarily orientated natural color human body cross sections.
![Page 95: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/95.jpg)
95
Virtual Drilling
• drilling operation of a diamond burr on the back of skull.
• Drilling of a round hole produced by a large diamond burr.
![Page 96: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/96.jpg)
96
Virtual human anatomy for learning (1)
• Human parts browser– Each part has label and description– Material attributes changeable– Switch between natural rendering or colored
rendering
![Page 97: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/97.jpg)
97
Virtual human anatomy learning (2)
• Human body scanner– Generates continuous natural appearance
human body cross-sections at real-time– Scan multiple parts at same time
![Page 98: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/98.jpg)
98
Virtual human anatomy learning (3)
• Virtual anatomy/surgery tool– Haptics device– Virtual diamond burr– Virtual knife
![Page 99: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/99.jpg)
99
Results …
![Page 100: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/100.jpg)
100
More results …
![Page 101: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/101.jpg)
101
We just set a foot on it. It’s an on-going project …
![Page 102: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/102.jpg)
102
Summary: selected publications
• Y. Liu, J.X. Chen, L. Yang, “High Quality Realistic Virtual Human Anatomy,” IEEE Computing in Science and Engineering, (to appear).
• L. Yang, J.X. Chen, and Y. Liu, “Virtual Human Anatomy,” IEEE Computing in Science and Engineering, vol. 7, no.5, Sept. 2005, pp. 71-73.
![Page 103: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/103.jpg)
103
6. A New Graphics Pipeline for 6. A New Graphics Pipeline for Atomic PrimitivesAtomic Primitives
ObjectiveImprove line scan-conversionImprove triangle scan-conversionDesign a new graphics pipeline for atomic primitives
ApplicationsGraphics library will be faster
![Page 104: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/104.jpg)
104
The multi-segment methodA line in a raster plane may include several identical segments.
After only calculating the first segment, we can directly copy the pixel intensities and positions to the successive segments.
![Page 105: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/105.jpg)
105
Multi-segment scan-conversion
One segment line is more than 60%Speed up at 2.75 timesCompressible efficiency at: 1.37
![Page 106: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/106.jpg)
106
40%
60%
Multiple Segment LinesOne Segment Lines
Unfortunately, the percentage of the multiple segment lines in a raster plane is less than 40%.However, with the Slope Table method, the percentage of the multiple segment lines can be increased to 99%.
99%
1%
Multiple Segment LinesOne Segment Lines
The multiple segment lines
![Page 107: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/107.jpg)
107
The Slope Table method
![Page 108: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/108.jpg)
108
Approximate line scan-conversion
Multisegment line is more than 99.8% (statistics from randomly generated lines)
N element ROM memory for an NxNdisplayPossible errors generatedCompressible efficiency: 13.83
(statistics from randomly generated lines)
![Page 109: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/109.jpg)
109
Pixel pattern
Pixel pattern of a line is the pixels chosen for forming the line in a raster plane
Drawing a line with its pixel pattern can speed up the line scan-conversion process
![Page 110: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/110.jpg)
110
Storage propertyWithout the Slope Table method
To save the pixel patterns of all 524,799 lines in a 1024×1024 raster plane
This requires at least 24M byte memory
With the Slope Table method
Only needs to save the pixel patterns of 1024 GRLs
That is 52,343 bits and only needs about 8K bytememory
![Page 111: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/111.jpg)
111
Data structureData structure
0 1 10
Q=5, P=2, the length of the pixel pattern=4
Q0 P0
Qi Pi
Slope Table Pixel Pattern Buffer
Pn/ 2-1Qn/2-1
(1K byte ROM) (3.3K byte ROM)
![Page 112: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/112.jpg)
112
• most lines (87%) in a drawing are fewer than 17 pixels
• an equi-likely line length distribution is inappropriate
• an axial line likely is worthwhile for hardware or software APIs since many (50%) of lines are uni-directional,
• line drawing set-up speed and pixel rasterization loop speed
• only a quarter (22%) of applications employ line drawing.
Reality
![Page 113: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/113.jpg)
113
• With our new statistical results from real applications,
• The percentage of multiple segment lines only increases from 36.26% to 38.20% (instead of to 99%).
• The compressible efficiency changes from 1.621 to 2.256(instead of from 1.370 to 13.830)
• Nevertheless, the new methods are still practical
Reality - Statistics
![Page 114: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/114.jpg)
114
Line pixel fill rate of Technical Specifications of Line pixel fill rate of Technical Specifications of the Onyx2 Graphics Hardwarethe Onyx2 Graphics Hardware
•Onyx2 GRAPHICS / Onyx2 Reality•Pixel fill 224M to 448M
•Antialiased 3.7M
•Speed Comp 61 to 121
•Onyx2 Reality Monster•Pixel fill 5.3 gigapixels/sec
•Antialiased 60M pixels/sec
•Speed Comp 88 times slower
![Page 115: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/115.jpg)
115
Hardware for antialiasing
Save the distance to center of the lineGiven a filter, save the alpha value for the corresponding pixelsFor texture mapping, color will blend with current pixel value
![Page 116: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/116.jpg)
116
Snapshots of line antialiasing
Antialiasing with Gupta-Sproull’s algorithms
Antialiasing with the Slope Table method (about eight times faster
than the left)
![Page 117: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/117.jpg)
117
Triangle statisticsTriangle statistics
# of pixels # of edges percent
0 < # ≤17 3879974 91.410%
17 < # ≤33 182028 4.288%
33 < # ≤65 93756 2.209%
65 < # ≤129 49709 1.171%
129 < # ≤257 30157 0.710%
257 < # ≤385 6465 0.152%
385 < # ≤513 2390 0.056%
513 < # 95 0.002%
Total 4244574 100.00%
# of pixels # of triangles percent
0 < # ≤17 1255201 88.716%
17 < # ≤33 80829 5.713%
33 < # ≤65 39540 2.795%
65 < # ≤129 20747 1.466%
129 < # ≤257 14183 1.002%
257 < # ≤385 3221 0.228%
385 < # ≤513 1074 0.076%
513 < # 63 0.004%
Total 1414858 100.00%
All edges Longest edges
![Page 118: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/118.jpg)
118
Graphics PipelineViewing; ClippingPrimitive model scan-conversion
Lighting, texture mappingper polygon, vertex normals; per pixel
Hidden-surface removalPer polygon, collision detection; Per pixel, z value
Anti-aliasingPer edge/line; distance to the center of the line, per pixel
Clip againstthe normalized
Divide by wfor perspective
Transforminto the
viewing volume
Normalize the
viewportviewing volume
projection
3D Modeling Coordinates
2D Display Device Coordinates
![Page 119: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/119.jpg)
119
Image-based polygon scan-conversion
![Page 120: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/120.jpg)
120
Image-based polygon scan-conversion
![Page 121: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/121.jpg)
121
Line and polygon clipping
L1
L2
L3L4
L5
L6L7
T1
T2
T3
T4T5
T6
L4
L5
L6L7
T4T5
T6
before clipping after clipping
![Page 122: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/122.jpg)
122
Line and polygon clipping
0 0 0 1 0 0 0 00 0 1 1 1 0 0 00 1 1 1 1 1 0 01 1 1 1 1 1 1 00 0 0 0 0 1 1 1
0 0 0 1 0 0 0 00 0 1 1 1 0 0 00 1 1 1 1 1 0 01 1 1 1 1 1 1 00 0 0 0 0 1 1 1
1 1 1 1 0 0 0 01 1 1 1 0 0 0 01 1 1 1 0 0 0 01 1 1 1 0 0 0 01 1 1 1 0 0 0 0
0 0 0 1 0 0 0 00 0 1 1 0 0 0 00 1 1 1 0 0 0 01 1 1 1 0 0 0 00 0 0 0 0 0 0 0
0 0 0 0 1 1 1 10 0 0 0 1 1 1 10 0 0 0 1 1 1 10 0 0 0 1 1 1 10 0 0 0 1 1 1 1
0 0 0 0 0 0 0 00 0 0 0 1 0 0 00 0 0 0 1 1 0 00 0 0 0 0 0 0 00 0 0 0 0 0 0 0
1 1 1 1 1 1 1 11 1 1 1 1 1 1 11 1 1 1 1 1 1 10 0 0 0 0 0 0 00 0 0 0 0 0 0 0
& & =
& =
a) Pixel Matrix b) Pre-stored pattern c) Pre-stored pattern d) Clipping result
a) Pixel Matrix b) Pre-stored pattern c) Clipping result
Right clipping plane
Bottom clipping plane
Left clipping plane
Top clipping plane
I
II
![Page 123: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/123.jpg)
123
Summary: selected publicationsJ.X. Chen, H. Wechsler, and J. Cui, “Image-Based Fast Small Triangle Rasterization,” 16th International Conference on Artificial Reality and Telexistence, Nov. 2006.
J.X. Chen, “New Graphics Pipeline Approach Speeds Up Atomic Primitives Rendering,”IEEE Computing in Science and Engineering, vol. 5, no. 3, May 2003, pp. 86-91.
J.X. Chen, X. Wang and J. E. Bersenham, “The Analysis and Statistics of Line Distribution,” IEEE Computer Graphics & Application, Vol. 22, No. 6, November/ December 2002, pp. 100-107.
J.X. Chen and X. Wang, “Approximate Line Scan-Conversion and Antialiasing,” Computer Graphics Forum, Vol. 18, No. 1, 1999, pp. 69-78.
J.X. Chen, “Multiple Segment Line Scan-Conversion,” Computer Graphics Forum, vol. 16, no. 5, 1997, pp. 257-268.
J.X. Chen, “An Improvement on Line Scan-Conversion,” SIGGRAPH’97 Visual Proceeding, Aug. 1997.
![Page 124: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/124.jpg)
124
Conclusion• Survey of Research Projects in the
Computer Graphics Lab at GMU
• Future Work in Edutainment, Simulation for Training, and Virtual Reality for Medical Applications
• Collaborating with faculty at GMU, local and international units
• Searching for funding to extend our research
![Page 125: Simulation and Virtual Reality](https://reader030.fdocuments.in/reader030/viewer/2022012713/61abdad21072252a23652920/html5/thumbnails/125.jpg)
125
Acknowledgement The projects have been in collaboration with: • Fluid: Xiaodong Fu, Niels Lobo, Mark Pullen Jingfang Wang, Ed Wegman,
Yonggao Yang, Tianshu Zhou• Learning: Mike Behrmann, Chris Dede, Debra Sprague, Yonggao Yang• Knee: Edward MacMahon, Mark Pullen, Harry Wechsler, Ying Zhu• Ear: Peidong Dai, Tianyu Zhang• Human Anatomy: Yanling Liu, Ling Yang• Atomic Graphics: Jian Cui, Xusheng Wang, Harry Wechsler
THANKS!!!Jim X. Chen, Ph.D. Department of Computer ScienceGeorge Mason UniversityFairfax, VA [email protected] 993 1720 (phone)