Post on 18-Jan-2016
Client-Server Paradise
ICOM 8015
Distributed Databases
Problems
• Earth Science Application generate massive amounts data– GIS Feature– Satellite Images, Maps– Temperature, Wind Speed
• Want to store, search or disseminate these data sets.– Internet
Sample Schema & Queries
• Images(week integer, band integer, region Rectangle, data Image)
SELECT week, band
FROM Images
WHERE region overlaps BOX;
SELECT week, band, Clip(data, region, BOX)
FROM Image
WHERE energy(data) > 10293.2
Issues
• Efficient Storage of Images
• Support for Image Processing algorithms and other operations.
• Support for spatial queries– Need spatial Indexing
• Reduce communications cost
• Execute operations in Parallel
Issues
• Image Visualization:– Composites and multilayers
New Data Product
State of the Art
• OS:– Store all data in OS files.
• DBMS– Store all data on DBMS
• Hybrid– Scalar and Spatial Data in a DBMS– Images on File System
Paradise
• Store data on a client-server parallel DBMS– SHORE storage System
• Storage, buffer management, transactions, etc.
– Paradise Server• Optimizer, Execution Engine, Catalog Manager,
ADTs
– Paradise Client• Caching, GUI, ADTs
Paradise Client
• Map View – multi layer display• Layer Manager – logic to control Map View• Browser – Management of data sets, and how
should they be displayed.• Composer – Create ad-hoc queries• Local Executor – Ship queries, local processing,
cache control• Object – Cache the tuples in an external format.• Meta Cache – caching catalog information.
SHORE
• Storage Manager for OO and Relational DBMS• Support parallel access to disks, or tertiary
storage.– Disk arrays, RAID– Tape Robots
• Supports transactions, recovery, and indexing.• Can be used as a toolkit to build a DBMS on top
of it
Parallel Execution
• Multiple Paradise Servers can be used to run a query.
ParadiseServer
ParadiseServer
ParadiseServer
ParadiseServer
LAN
ParadiseClient
Image Processing in Parallel
ParadiseServer
ParadiseServer
ParadiseServer
ParadiseServer
Apply some AlgorithmTo an image
User-defined Types
• Support for GIS types such as lines, rectangle, polygons, etc.
• System can grow since new types can be added
• Need to provide operations to read, write, data from files, memory, disk.