@ ESO
Part II Implementing Day CQ5 at ESO
Rein Warmels Cristina Garcia de Juan
Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 2
@ ESO
ESO Overview
• Headquarters in Garching/Munich. Observatories in Chile: Paranal, La Silla, Chajnantor and …?
• Budget 160 M Euro per year. • Personnel ~720 Staff (International and Local) • Foremost intergovernmental astronomy organization in
Europe and the world’s most productive astronomical observatory.
• Supported by Austria, Belgium, the Czech Republic, Denmark, Finland, France, Germany, Italy, the Netherlands, Portugal, Spain, Sweden, Switzerland and the United Kingdom.
ESO, the European Southern Observatory, builds and operates a suite of the world's most advanced ground-based astronomical telescopes
Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 3
@ ESO
Sites and Locations
Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 4
@ ESO
Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 5
@ ESO
Core Activities
Operations – Development – Science
• 3 + 4++ Telescopes • 3 + 12++ Instruments • Data Calibration • Quality Control
• Instrument Monitoring • Maintenance • Development and Upgrades
Service Observing Telescopes and Instruments
• In Garching and at the Observatories
• 1,800 Proposals per year • 1,000 Observing Runs p/y
• Currently 65 TBytes • Growth rate 15 Tbytes p/y • After 2013 150 TBytes
per year • 10,000 data requests per year
Observing User Support
Archive Operations – Virtual Observatory
Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 6
@ ESO
ESO Web Operations
Statistics (www.eso.org only):
• 1 Gbps incoming, 300 Mbps outgoing; Backbone 10 Gbps • 30+ servers, mostly Dell Blades (Linux), VMware virtual
servers • 50+ Web sites • ~ 80 IP addresses for Web related servers • Pages
• > 100,000 HTML pages • > 10,000 pdf files
• Visits: • ~ 50,000,000 hits/month • ~ 5,000,000 page views/month
• Transfer > ~ 1 Pbytes/year (excl. Science Archive)
Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 7
@ ESO
CQ Project Goals
Replace the old authoring and publishing procedures and systems. Migrate the content from the old system to CQ
Explore and Install CQ functionalities to substantially ease authoring.
System, User and Content Management overheads
Easy to Use (non-technical staff)
Enforce standards
Support Efforts
Reduce
ESO Common Look and Feel Central Control
Content Structure Syndication and Synergies Bind Scripts and Applications
Reorganize and streamline
Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 8
@ ESO
Initial Conditions • Large fraction of content
operations critical • Maintenance intense • High Support needs • Competing development
activities in the Organization
Operations and Maintenance
• Static and dynamic • HTML, PHP • Perl, Java, Shell, Javascript, …
• Small (and rather) CMS Solutions
• Propriety and home-build applications
• Different formats and layouts
• Images, images, images, images, … videos, pdfs, …
Content and Assets
• No CQ Knowledge • Limited manpower • Many delays in the past:
Loss of credit and authors confidence
WoMen Power and Knowledge
Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 9
@ ESO
Constraints Budget limitations = Hw/Sw Limitations
Without DAM License
Without Clustering
2 Instances
Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 10
@ ESO
Boundary Conditions Limited Budget – Limited Staffing
No interruption of critical operations and services (Observing!)
Continue operations, maintenance and support of old system
Moderate changes of content structure
TIME
Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 11
@ ESO
Approaches & Methods
• Basic Project/Implementation Plan • No large documentation efforts: TWiki-based • Rapid Prototyping – Continuous testing on users • Split the migration in packages
Be Pragmatic
• Short communication lines • Regular meetings
(Project Team, Steering Committee, Users) • Make future authors/users part of the project
Communications
Philosophy
Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 12
@ ESO
Project Organisation
Project Steering Committee • Chairperson • Stakeholders
WoManPower
User/Authors • Testers • Validation
Project Team (4) • Architecture • Design • Development • Migration • Testing • Administration • Training • Support • Management
Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 13
@ ESO
Project Stages
Phase I
Getting Started
• Project Organization • Stakeholders Meetings
(Project Board) • Basic Project Plan • Basic Risk Analysis • Authors Demonstration
Phase II
Analysis
• Architecture Analysis • CQ Architectural Design • Layout and Content
Analysis • Review Authors
Requirements
Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 14
@ ESO
ESO Agile Approach
Architecture Vision
Architecture Agreement
PHP App. and CQ5 Live together
CQ5 PHP PHP PHP PHP
Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 15
@ ESO
Internet Users Intranet Users
Load Balancer
Publish Side
PHP
COLD/StandBy
Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 16
@ ESO
Project Stages
Phase III
Proto-typing
• Hardware and Software Configuration (Production / Testing)
• Development Component and Templates
• Prototype Look and Feel
• Demonstrations and Feedback
Phase IV
Migration I – N
• Clearly defined content • Well defined in
time and efforts • Tailored migration script
and development efforts • User Interaction!
Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 17
@ ESO
Migration
Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 18
@ ESO
Migration Process
Content Analysis
Migration Validation
Deployment
Development
Old System
Training
Users
Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 19
@ ESO
Migration Iterative Cycle - 3 Months • Content Analysis and Migration Package Definition • Migration Package Tuning • Creation of mirrors (curl commands) • Automated Migration: Parsing HTML
and mapping site structures • Agreement: migration in 95% of the site
content to Rich Text Edit Component • Risk: Performance on client side
• Quality Check • Training and additional Support • Configuration and Performance Check • Deployment • Migration Package Going Live
Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 20
@ ESO
Technical Challenges
Handling with Links, Navigation and Sitemap • Dispatcher and Load Balancer Configuration
(URL Mapping) • Rewrite & Redirect Rules • Vanity URLs • "Blank" Pages on CQ side
Import of Digital Assets
Activation Queues after Migration
Performance issues
Disable certain DAM Workflow instantiations
Process improvement and planning
Migration to CRX 2.1, Performance Packages
Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 21
@ ESO
• CQ Installed, Hardware and Software configured Fully operational and living in harmony with old system
• Implementation L&F and Styles completed • Three Migration Packages released • Demonstrations and Trainings provided, Support in place
Achievements and Status – Nine months
• Migration of small packages • The Observatories (Chile) • Inclusion of data bases (SQL) • SSO and LDAP server implementation
Outlook
Conclusions
Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 22
@ ESO
Top Related