This material is based upon work supported by the U.S. Department of Energy Office of Science under...
-
Upload
isaac-huskey -
Category
Documents
-
view
213 -
download
0
Transcript of This material is based upon work supported by the U.S. Department of Energy Office of Science under...
![Page 1: This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC0000661. Michigan State.](https://reader035.fdocuments.in/reader035/viewer/2022070306/5516ef53550346fe558b4a57/html5/thumbnails/1.jpg)
This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC0000661.Michigan State University designs and establishes FRIB as a DOE Office of Science National User Facility in support of the mission of the Office of Nuclear Physics.
EPICS Meeting April, 2013
Controls Database Collaboration
![Page 2: This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC0000661. Michigan State.](https://reader035.fdocuments.in/reader035/viewer/2022070306/5516ef53550346fe558b4a57/html5/thumbnails/2.jpg)
Goal• Provide access to an Experimental Physics Facility’s data and
knowledge
How?• By developing databases, services, interfaces, and applications• [Users can access the data through GUI, EPICS V4, REST, Java, and
Python APIs]
Partners• Brookhaven National Lab, New York, USA• Cosylab, Slovenia• European Spallation Source, Sweden• Facility for Rare Isotope Beam, Michigan, USA• Institute for High Energy Physics, Beijing, China
Started in November 2011
What is Controls Database Collaboration (CDB)?
, Slide 2
![Page 3: This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC0000661. Michigan State.](https://reader035.fdocuments.in/reader035/viewer/2022070306/5516ef53550346fe558b4a57/html5/thumbnails/3.jpg)
# DB Description Status Owner
1 Logbook Logbook entries Done: 80% Berryman
2 Traveler Production, test, design data Done: 50% Liu, Vuppala
3 Configuration Physical and logical information about the facility and its configuration
Done: 50%. Vuppala
4 Infrastructure Cables, IOCs, Racks, Rooms etc Done: 20% Vuppala
5 Lattice/Model Elements and online model Done 30% Chu
6 Inventory Spare parts, stock items Done: 20% Liu, Berryman
7 State Save/restore state of FRIB segments Done: 40% Berryman
8 Alarm Set changes, set/read mismatches Done: 40% Berryman
CDB Scope
, Slide 3
![Page 4: This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC0000661. Michigan State.](https://reader035.fdocuments.in/reader035/viewer/2022070306/5516ef53550346fe558b4a57/html5/thumbnails/4.jpg)
# Database Description Status Owner
9 Operations Beam statistics, run hours, beam on target, shift summary, downtime, bypass records
Done: 10% Berryman
10 FRIB Requirements
Parameter list, system and component requirements
Done: 20% Vuppala
11 MPS Machine state dumps Done: 0% Vuppala
12 Results Results from physics experiments Done: 0% Vuppala
13 Maintenance Preventive maintenance data, failure analysis, lifetime analysis
Done: 0% Vuppala
14 Interlocks Interlock hierarchy information [optional] Done: 0% Vuppala
15 Physics Apps Physics applications Chu
16 Unit Conversion
Current-Field Mapping Shen
CDB Scope 2
, Slide 4
![Page 5: This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC0000661. Michigan State.](https://reader035.fdocuments.in/reader035/viewer/2022070306/5516ef53550346fe558b4a57/html5/thumbnails/5.jpg)
Application Architecture
, Slide 5
Application layer• Operator interfaces• High-level applications• Libraries
Service layer• Access to data• Programming Interface
Data layer• Managed data• Instrument data• No direct access
![Page 6: This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC0000661. Michigan State.](https://reader035.fdocuments.in/reader035/viewer/2022070306/5516ef53550346fe558b4a57/html5/thumbnails/6.jpg)
Integration of myriad databases
Multiple teams from different labs
Geographically dispersed locations
Each team has different priorities
Labs have different schedules
Technology platforms are different at each lab
Differing software-engineering processes by each team
Challenges To Development
, Slide 6
![Page 7: This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC0000661. Michigan State.](https://reader035.fdocuments.in/reader035/viewer/2022070306/5516ef53550346fe558b4a57/html5/thumbnails/7.jpg)
Centralized• The entire schema (data layer) is developed by one team. • The database team understands requirements from every team, designs the
schema, develops an access layer (stored procedures or data library) on top of data, and releases the schema.
• All changes to schema go through the database team. • Database team is responsible for migrating data to new version of schema. • This can be extended to other functions: a service team for developing
services, and a GUI team for developing user interfaces etc.
Decentralized• Entire system is divided into smaller subsystems. • A team is assigned for each subsystem; the team is responsible for all
aspects of the sub-system: requirements, data design, services, GUI, packaging, release, and data migration.
• Once the sub-systems are mature, they are integrated• Integration can be done at service layer, data layer, or schema layer
Development Approaches
, Slide 7
![Page 8: This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC0000661. Michigan State.](https://reader035.fdocuments.in/reader035/viewer/2022070306/5516ef53550346fe558b4a57/html5/thumbnails/8.jpg)
Development Concurrency: • How independently can different teams work?
Differing Schedules: • How easy is to accommodate the schedules of different labs?
Iterations: • How quickly can new versions of sub-systems be released?
Data Integrity: • Will there be inconsistency in the database?
Integration: • How easily can different sub-systems be integrated?
Performance: • Time to access data
Schema Independence: • How easy is for a sub-system to change its schema?
Quality:
Comparison Criteria
, Slide 8
![Page 9: This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC0000661. Michigan State.](https://reader035.fdocuments.in/reader035/viewer/2022070306/5516ef53550346fe558b4a57/html5/thumbnails/9.jpg)
Centralized Decentralized Comments
Development Concurrency
Low High Functional teams become bottlenecks
Diff Schedule Low High Releases have to be coordinated among teams.
Iterations Low High Any changes in schema have to go through the DB team
Data Integrity High Medium Integration High Low - Medium Performance Medium Medium Schema Independence
Medium High Changes have to go through DB team
Quality Medium – High Low - High Difficult. Due to multiple iterations, the overall quality of decentralized approach may turn out to be better.
Comparison
, Slide 9
![Page 10: This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC0000661. Michigan State.](https://reader035.fdocuments.in/reader035/viewer/2022070306/5516ef53550346fe558b4a57/html5/thumbnails/10.jpg)
Entire system broken into sub-systems or ‘domains’
There can be multiple implementations for a domain
Current multi-implementations:• Configuration Domain: IRMIS and DISCS• Physics Domain: XAL, LSH, PSI• Cables Domain: IRMIS, DISCS
[IRMIS: Integrated Relational Model for Installed Systems]
[DISCS: Distributed Information Services for Control Systems]
Multiple Implementations
, Slide 10
![Page 11: This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC0000661. Michigan State.](https://reader035.fdocuments.in/reader035/viewer/2022070306/5516ef53550346fe558b4a57/html5/thumbnails/11.jpg)
Decentralized Development Approach
, Slide 11
Modules: Database, Services, Interfaces, Applications
![Page 12: This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC0000661. Michigan State.](https://reader035.fdocuments.in/reader035/viewer/2022070306/5516ef53550346fe558b4a57/html5/thumbnails/12.jpg)
Layer ESS, FRIB BNL
Data Layer MySQL MySQL
ORM JPA Django ORM
Service Layer Java EE, Java SE Django REST, C++ (V4)
Service Architecture
EPICS V4, REST EPICS V4, REST
API Java, Python Python
Web Interface JSF, PHP Django
GUI CSS CSS
Language Java Python
Technologies
, Slide 12
![Page 13: This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC0000661. Michigan State.](https://reader035.fdocuments.in/reader035/viewer/2022070306/5516ef53550346fe558b4a57/html5/thumbnails/13.jpg)
Dates: March 6-7, 2013
Venue: FRIB/NSCL, MSU
Participants: BNL, Cosylab, ESS, FRIB
15+ Presentations
Goals• Define goals for the next quarter for each domain • Ascertain performance of each domain for the last quarter• Recommend improvements
Last Collaboration Meeting
, Slide 13
![Page 14: This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC0000661. Michigan State.](https://reader035.fdocuments.in/reader035/viewer/2022070306/5516ef53550346fe558b4a57/html5/thumbnails/14.jpg)
# DB Last Quarter
1 Logbook Released CSS Viewer, CSS general logbook interface, Python API
2 Traveler Hired new resource. Dong leading the domain.
3 Configuration Productize; REST, Java, Python APIs; Measurement data; V4 Service (proto)
4 Infrastructure Cables under development
5 Lattice/Model Simple Service, Data loading, Preliminary GUI
6 Inventory Not yet initiated
7 State CSS GUI Under Development
8 Alarm 900W Cryo, D-Line
Performance For Last Quarter
, Slide 14
![Page 15: This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC0000661. Michigan State.](https://reader035.fdocuments.in/reader035/viewer/2022070306/5516ef53550346fe558b4a57/html5/thumbnails/15.jpg)
# Database Description Status
9 Operations Beam statistics, run hours, beam on target, shift summary, downtime, bypass records
Not yet initiated
10 FRIB Requirements
Parameter list, system and component requirements
Evaluate Cosylab/ESS Tool
11 MPS Machine state dumps Not yet initiated. Work with Group at BNL
12 Results Results from physics experiments Not yet initiated
13 Maintenance Preventive maintenance data, failure analysis, lifetime analysis
Not yet initiated
14 Interlocks Interlock hierarchy information [optional]
Not yet initiated
15 Physics Apps Physics applications Migrating to OpenXAL
16 Unit Conversion Current-Field Mapping
Performance 2
, Slide 15
![Page 16: This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC0000661. Michigan State.](https://reader035.fdocuments.in/reader035/viewer/2022070306/5516ef53550346fe558b4a57/html5/thumbnails/16.jpg)
Weekly Meetings• Every Wednesday, 9:00-9:45am Eastern USA• Google Hangout
Mailing List: [email protected]
Website• Under development (http://openepics.sourceforge.net/)
Contact Information• Bob Dalesio, Co-Chair: [email protected]• Vasu Vuppala, Co-Chair: [email protected]
Collaboration Information
, Slide 16
![Page 17: This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC0000661. Michigan State.](https://reader035.fdocuments.in/reader035/viewer/2022070306/5516ef53550346fe558b4a57/html5/thumbnails/17.jpg)
Presentations
, Slide 17
![Page 18: This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC0000661. Michigan State.](https://reader035.fdocuments.in/reader035/viewer/2022070306/5516ef53550346fe558b4a57/html5/thumbnails/18.jpg)
E. Berryman, 6 March 2013, Workshop
CSS Logbook Interface (Databrowser)
, Slide 18
![Page 19: This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC0000661. Michigan State.](https://reader035.fdocuments.in/reader035/viewer/2022070306/5516ef53550346fe558b4a57/html5/thumbnails/19.jpg)
P. Chu, 6 Mar 2013
Entity classes generated from MySQL
Database API via JPA
EJB project in NetBeans to call the database API• This EJB can drop to GlassFish container, for example
JavaFX client project to call the EJB
Lattice/Model: Prototype
, Slide 19
Update from Huihui Lv
![Page 20: This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC0000661. Michigan State.](https://reader035.fdocuments.in/reader035/viewer/2022070306/5516ef53550346fe558b4a57/html5/thumbnails/20.jpg)
Configuration: Component Tree
V. Vuppala, FRIB Data Services, Slide 20
![Page 21: This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC0000661. Michigan State.](https://reader035.fdocuments.in/reader035/viewer/2022070306/5516ef53550346fe558b4a57/html5/thumbnails/21.jpg)
Configuration: Component Relationships
V. Vuppala, FRIB Data Services, Slide 21
![Page 22: This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC0000661. Michigan State.](https://reader035.fdocuments.in/reader035/viewer/2022070306/5516ef53550346fe558b4a57/html5/thumbnails/22.jpg)
Configuration: Lattice
V. Vuppala, FRIB Data Services, Slide 22
![Page 23: This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC0000661. Michigan State.](https://reader035.fdocuments.in/reader035/viewer/2022070306/5516ef53550346fe558b4a57/html5/thumbnails/23.jpg)
Configuration: Measurement
V. Vuppala, FRIB Data Services, Slide 23
![Page 24: This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC0000661. Michigan State.](https://reader035.fdocuments.in/reader035/viewer/2022070306/5516ef53550346fe558b4a57/html5/thumbnails/24.jpg)
Configuration: EPICS V4 Service
V. Vuppala, FRIB Data Services, Slide 24
![Page 25: This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC0000661. Michigan State.](https://reader035.fdocuments.in/reader035/viewer/2022070306/5516ef53550346fe558b4a57/html5/thumbnails/25.jpg)
Integration with ChannelFinder and PVManager
Configuration: Signals
V. Vuppala, FRIB Data Services, Slide 25
![Page 26: This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC0000661. Michigan State.](https://reader035.fdocuments.in/reader035/viewer/2022070306/5516ef53550346fe558b4a57/html5/thumbnails/26.jpg)
Traveler
V. Vuppala, FRIB Data Services, Slide 26
![Page 27: This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC0000661. Michigan State.](https://reader035.fdocuments.in/reader035/viewer/2022070306/5516ef53550346fe558b4a57/html5/thumbnails/27.jpg)
Cables: Architectural design
V. Vuppala and D. Liu @March 6, 2013, Slide 27
![Page 28: This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC0000661. Michigan State.](https://reader035.fdocuments.in/reader035/viewer/2022070306/5516ef53550346fe558b4a57/html5/thumbnails/28.jpg)
Configuration Olog Lattice eTraveler Cable
Web User interface
JavaServer Faces (HTML/CSS), JavaScript
CakePHP, JS BootStrap (HTML/CSS/JS), jQuery
HTML, JSP PHP, jQuery BootStrap (HTML/CSS/JS), jQuery
BootStrap (HTML/CSS/JS), jQuery
Application interface
JSON/XML over HTTP
JSON/XML over HTTP
JSON/XML over HTTP
JSON over HTTP JSON over HTTP
Web Controller
Servlet Servlet Servlet PHP node.js node.js
ORM JPA JPA JPA SQL node.js node.js
Database MySQL MySQL MySQL MySQL MySQL
User auth GF JAAS GF JAAS GF JAAS GF JAAS CAS CAS
Application auth
V. auth V. auth V. auth V. auth V. auth
Management WAR/GF admin tool
WAR/GF admin tool
WAR/GF admin tool
WAR/GF admin tool node.js
node package manager
Technologies used and planned in FRIB web Applications
V. Vuppala and D. Liu @March 6, 2013, Slide 28
![Page 29: This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC0000661. Michigan State.](https://reader035.fdocuments.in/reader035/viewer/2022070306/5516ef53550346fe558b4a57/html5/thumbnails/29.jpg)
29
BLED databases
![Page 30: This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC0000661. Michigan State.](https://reader035.fdocuments.in/reader035/viewer/2022070306/5516ef53550346fe558b4a57/html5/thumbnails/30.jpg)
Authentication Service (Naming System)
V. Vuppala, FRIB Data Services, Slide 30
![Page 31: This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC0000661. Michigan State.](https://reader035.fdocuments.in/reader035/viewer/2022070306/5516ef53550346fe558b4a57/html5/thumbnails/31.jpg)
CSS: Reliability – Plugin Infrastructure
, Slide 31E. Berryman, 7 March 2013, Workshop
![Page 32: This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC0000661. Michigan State.](https://reader035.fdocuments.in/reader035/viewer/2022070306/5516ef53550346fe558b4a57/html5/thumbnails/32.jpg)
PVManager - BEAST
E. Berryman, 7 March 2013, Workshop, Slide 32
![Page 33: This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC0000661. Michigan State.](https://reader035.fdocuments.in/reader035/viewer/2022070306/5516ef53550346fe558b4a57/html5/thumbnails/33.jpg)
# DB Next Quarter
1 Logbook ITER is a new user, collect requirementsAgree on the next iteration of logbook viewerBootstrap web client
2 Traveler Clean items in backlog scheduled for the period (to May)Support new traveler requestsAdd rich editor support (by end of March)Improve the whole UI by shifting to Bootstrap (by mid-April)
3 Configuration Authorization, Online updatesImplement Repository (JCR etc)Improve: EPICS V4 ServiceIntegrate with PVManagerRelease another versionIntegration with Olog?
4 Infrastructure Cable meta information MVC and API (end of March)Cable information MVC and API (end of April)• Excel import and export (mid-May)• Label (end of May)• Integration test (mid-June)• First release (end of June)
5 Lattice/Model First-order Lattice/Model Service with basic data access (mainly forLattice), Deployment packaging
6 Inventory
7 State
8 Alarm
Goals for Next Quarter
, Slide 33
![Page 34: This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC0000661. Michigan State.](https://reader035.fdocuments.in/reader035/viewer/2022070306/5516ef53550346fe558b4a57/html5/thumbnails/34.jpg)
# Database Next Quarter Goals
9 Operations None
10 FRIB Requirements Evaluate ESS/Cosylab Design Parameter Tool
11 MPS Initiate collaboration with BNL Group
12 Results None
13 Maintenance None
14 Interlocks None
15 Physics Apps Continuing Open XAL migrationResume Linac Energy Management “Application”Study Save/Restore and Scan applications
16 Unit Conversion
Goals 2
, Slide 34
![Page 35: This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC0000661. Michigan State.](https://reader035.fdocuments.in/reader035/viewer/2022070306/5516ef53550346fe558b4a57/html5/thumbnails/35.jpg)
Integration Plan• Integrate Configuration with channelFinder (PV Domain): Configuration module gets list of channels from ChannelFinder (via REST/V4) for a selected device.
• Integrate Configuration Module with Lattice/Model Module: Explore at what level the integration can be done (service, data layer, tables etc)
• Use the central portal for integration
Integration
, Slide 35
![Page 36: This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC0000661. Michigan State.](https://reader035.fdocuments.in/reader035/viewer/2022070306/5516ef53550346fe558b4a57/html5/thumbnails/36.jpg)
Ecosystem• Data/Information Services• Controls System Studio• EPICS V4• Physics/Knowledge Services
Synergy among labs
Challenges• Integration• Commitments
Conclusion
, Slide 36