Sprint 45 review
Transcript of Sprint 45 review
![Page 1: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/1.jpg)
ManageIQ
Sprint 45 Review - Sprint End August 22, 2016
August 24, 2016
![Page 2: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/2.jpg)
Overview● Sprint Statistics (Oleg Barenboim)● Providers (Greg Blomquist)● Service Broker (Chris Kacerguis)● User Interface (Dan Clarizio)● Platform (Gregg Tanzillo)● REST API (Alberto Bellotti)● Automate (Greg McCullough)● SmartState (Rich Oliveri)● Performance (Dennis Metzger)● Quality Engineering (Dave Johnson)● Discussion
![Page 3: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/3.jpg)
Sprint Statistics (O. Barenboim)
375 Pull Requests Merged
![Page 4: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/4.jpg)
PR Breakdown by Feature Category (O. Barenboim)
* Note that some PRs have more than one category.
Providers
![Page 5: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/5.jpg)
Sprint Comparison (O. Barenboim)
![Page 6: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/6.jpg)
All Repo Stats (O. Barenboim)
Data source:
https://github.com/ManageIQthese are listed by most recent activity. go into each one that has been updated in the past 20 days and add up the PRs that have been merged
Order descending by #PRs merged
Repositorymanageiq 277integration_tests 60manageiq_docs 24manageiq-ui-self_service 2manageiq.org 8azure-armrest 6wrapanapi 4handsoap 1mangeiq-api-client 1manageiq-api-client 1manageiq-providers-amazon 4guides 5manageiq-appliance 4pg-dsn_parser 3ansible_tower_client 4more_core_extensions 1ovirt 6azure-signature 6linux_admin 3manageiq-appliance-build 3ovirt_metrics 1Total 424
![Page 7: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/7.jpg)
Providers(G. Blomquist)
![Page 8: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/8.jpg)
Providers - Hawkular (A.Bonas)
New functionality/features:
● Alerts○ Link miq alerts and hawkular events on the provider○ Convert miq alerts/profiles to hawkular group triggers/members of group
triggers○ Sync the provider when miq alerts and alert profiles are created/updated
● 2 new entities added - domains and server groups○ Including their visualization in topology○ Limitation : still missing relevant icons that need to be designed by uxd
● Deletion operation of the datasource entity● Support more event types for datasource and deployment● Cross linking to VMs added to topology● Add a button for Re-checking Authentication in the Middleware
providers list view
![Page 9: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/9.jpg)
Providers - Hawkular (A.Bonas)
Misc
● Hawkular gem upgraded to 2.4● Bugs fixed in breadcrumbs, alerts, live metrics, deployments and more areas● Core UI - new Angular toolbars - will be mentioned in the UI section shortly
![Page 10: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/10.jpg)
Providers - Google (G.Blomquist)
Preemptible Instances
Retirement support
![Page 11: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/11.jpg)
Providers - Azure (G.Blomquist)
Additional Metrics
Fix proxy for Template lookups
Caching for SmartState
![Page 12: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/12.jpg)
Providers - Containers (G.Blomquist)
Metrics status
Models for container deployments
![Page 13: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/13.jpg)
Providers - OpenStack (G.Blomquist)
Host Aggregates
Region support
![Page 14: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/14.jpg)
Providers - RHEV (G.Blomquist)
Snapshot Support
![Page 15: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/15.jpg)
Providers - vSphere (G.Blomquist)
Block duplicate events
Storage Profiles
![Page 16: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/16.jpg)
Providers - vCloud (G.Blomquist)
Video!
![Page 17: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/17.jpg)
Providers - General (G.Blomquist)
Load Balancers
supports :smartstate_analysis
![Page 18: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/18.jpg)
Service Broker
Service Designer
● Blueprint API is 90% done○ edit and publish are still in development
● Continue to connect the service designer with the API○ create, view, and delete working
Arbitration Profiles
● Arbitration profiles are a collection of pre-defined settings● Works in conjunction with the Arbitration Engine● Demo! (Jillian Tullo)
![Page 19: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/19.jpg)
Service Broker
Rules Engine
● Will allow admins to easily create rule sets for to enforce policy ○ e.g. enforcing a VPC in AWS for development servers
● UX design is in progress● API has been completed
![Page 20: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/20.jpg)
User InterfaceDan Clarizio
● PRs merged (131)○ SSUI (2)○ Bugs (54)○ Enhancements (26)○ Tech Debt / Refactoring (57)○ Backported to Darga (4)
● Refactoring○ Converted to TreeBuilder - Manage Policies, Servers/Roles, SmartProxy
Affinity, Bottlenecks, Utilization, Compare Sections○ Angular forms - Set Ownership, Time Profile Editor○ Some simple RJS use cases replaced○ Toolbar refactoring - Service Orchestration, VMs○ Toolbar functionality accessible from Angular (Karel)
![Page 21: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/21.jpg)
User Interface
● Enhancements○ I18n support for UI plugins○ Arbitration Profiles management for Service Broker○ Re-check Authentication button added to Provider list views○ Provisioning button added to the Templates & Images list and summary
screens○ Subtype option added to Generic Catalog Items○ About modal added to OPS UI
![Page 22: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/22.jpg)
User InterfaceRe-check authentication button on Provider list
![Page 23: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/23.jpg)
User InterfaceProvisioning button for Templates & Images
From list view:
From summary screen:
![Page 24: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/24.jpg)
User InterfaceSubtype option on Generic Catalog Item
![Page 25: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/25.jpg)
User Interface‘About’ modal in OPS UI
![Page 26: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/26.jpg)
PlatformGregg Tanzillo
Enhancements and Bug Fixes (90 PRs Merged)● PostgreSQL High Availability
● Tenancy
● Additional Enhancements and Bug Fixes
● Rest API
![Page 27: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/27.jpg)
PlatformGregg Tanzillo
PostgreSQL High Availability● Primary/Standby DB config in Appliance Console
● Database-only appliance config in Appliance Console
![Page 28: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/28.jpg)
PlatformGregg Tanzillo
PostgreSQL High Availability● Failover Monitor
○ Runs as a service under systemd
○ Provides automatic failover of EVM server to new
primary DB
![Page 29: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/29.jpg)
PlatformGregg Tanzillo
Tenancy
● Work continues to support sharing resources across
tenants
○ Groundwork in preparation for supporting multiple
entitlements
○ ApplicationHelper#role_allows and User#role_allows?
combined and moved to Rbac
● Post refresh hook to queue mapping of Cloud Tenants
![Page 30: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/30.jpg)
Additional Enhancements and Bug Fixes
● Upgrade ruby 2.2.5 to 2.3.1
● Configure Rails web server - Puma or Thin
○ Puma is still the default
○ Planning on adding additional servers
● DB maintenance scripts added to appliance
● Expression refactoring and cleanup
○ Relative dates and times, conversion to Ruby
PlatformGregg Tanzillo
![Page 31: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/31.jpg)
REST APIAlberto Bellotti
Continuing Refactoring
● 12 Refactoring PR’s merged
Bug Fixes
● Hide internal Tenant Groups from /api/groups● Raise 403 Forbidden for deleting read-only groups● API Request logging
![Page 32: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/32.jpg)
REST APIAlberto Bellotti
Added support for BluePrints
● New collection /api/blueprints● Supporting CRUD operations:
POST /api/blueprints to create{ “name” : "bp_name", “description” : “blueprint description", “bundle” : { “service_catalog” : { “id” : :service_catalog_id }, “service_dialog” : { “id” : :service_dialog_id }, “automate_entrypoints” : { "Provision" : "a/b/c", "Reconfigure" : "x/y/z” }, “service_templates” : [ { “id” : :st_id1 }, { “id” : :st_id2 } ] } }
POST /api/blueprints/:id action “edit” for single resource updatePOST /api/blueprints action “edit” for bulk updatesDELETE /api/blueprints/:id for single resource deletePOST /api/blueprints action “delete” for bulk deletes
![Page 33: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/33.jpg)
REST APIAlberto Bellotti
Added support for BluePrints
● GETs of blueprints include serialized content:
GET /api/blueprints/:id
{ “href” : “http://localhost:3000/api/blueprints/:id”, “Id” : 123, “description” : “blueprint description", “content” : { “id” : :st_id, “description” : “blueprint description”, ... “service_catalog” : { }, “service_dialog” : { }, “automate_entrypoints” : { "Provision" : "a/b/c", "Reconfigure" : "x/y/z” }, “service_templates” : [ ] } }
![Page 34: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/34.jpg)
REST APIAlberto Bellotti
Added support for compressed id’s in inbound requests:
GET /api/vms/1000000000002
Can now also be requested as follows:
GET /api/vms/1r2
![Page 35: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/35.jpg)
REST APIChris Kacerguis
Added support for Arbitration Rules
● New collection /api/arbitration_rules● Full CRUD support
POST /api/arbitration_rules{
“name” : “admin rule”,“operation” : “inject”,“expression” : { “EQUAL” : { “field” : “User-userid”, “value” : “admin” } }
}
POST /api/arbitration_rules/:id action “edit” for single updatePOST /api/arbitration_rules action “edit” for bulk updatesDELETE /api/arbitration_rules/:id for single DeletePOST /api/arbitration_rules action “delete” for bulk deletes
![Page 36: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/36.jpg)
AutomateGreg McCullough
● Enhanced Messaging for Provisioning
● Old Message Examples:
![Page 37: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/37.jpg)
AutomateGreg McCullough
● Enhanced Messaging for Provisioning○ Displayed elements
i. ManageIQ Server nameii. Name of VM/Service being provisionediii. Current Automate state machine stepiv. Status messagev. Provision Task Messagevi. Retry count (when applicable)
![Page 38: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/38.jpg)
AutomateGreg McCullough
● Google Compute Engine - retirement support
● New tagging method - taggable?○ Programmatically determine if a Service Model class or instance is
taggable.
● Generic Objects○ Model Updates
■ Associations■ Tagging■ Service Methods: add_to_service / remove_from_service
○ In-progress: UI and Methods
![Page 39: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/39.jpg)
AutomateMadhu Kanoor
● Git Automate support○ Branch/Tag support○ Contents are locked
i. Can be copied to other domains for editing○ Editable properties
i. Enabled/Disabledii. Priorityiii. Removal of Domain
○ Dedicated server role to store the repository● Future
○ REST API to refresh domains from a Git hook
![Page 40: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/40.jpg)
AutomateMadhu Kanoor
● Git Automate - Demo
![Page 41: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/41.jpg)
SmartStateRich Oliveri
Deployed new MiqDiskCache module for use in Azure SSA● Scan time:
○ From: Greater than 20 minutes○ To: Less than 5 minutes (some cases < 2 minutes)
● Azure backend read requests per scan:○ From: More than 7000 requests/scan○ To: Less than 1000 requests/scan (some cases < 400)
![Page 42: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/42.jpg)
PerformanceDennis Metzger
Focus - Page rendering performance
Page specific & Multi-page (common code)
Big Win (multi-page impact):
Test Page: Services -> Workload -> All VMs
Route: /vm_or_template/explorer
Database with 20,000 VMs
Before:93,770 ms
After: 524 ms
![Page 43: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/43.jpg)
Quality EngineeringDave Johnson
● Continuing to verify issues being fixed○ Some 75 passed, 8 were reopened
● Began focusing on upstream nightly build for testing○ Some 50 issues opened in the last 7 days
● Continuing to work on automation○ Building more coverage around Middleware, Containers, Azure scenarios○ Continuing to refactor for our next version of the fw
● We need a better solution around understanding when JS is complete in the UI
● We continue to seeing a lot of string changes that affect the automation, we need to get better about static element IDs
![Page 44: Sprint 45 review](https://reader030.fdocuments.in/reader030/viewer/2022021506/587097f71a28ab412b8b6dd5/html5/thumbnails/44.jpg)
Discussion
Sprint 46 Review - September 14