What's New in Oracle BI for Developers
-
Upload
datavail -
Category
Data & Analytics
-
view
77 -
download
0
Transcript of What's New in Oracle BI for Developers
What’s New in Oracle BI for Developers
B I WA C o n f e r e n c e – J a n u a r y 2 0 1 7
2/5/2017 2www.datavail.com
The latest versions of OBIEE have been released for on-premise implementation, through SaaS via Oracle BI Cloud Service, and on the desktop with Data Visualization. This session gives OBIEE Architects and Developers exposure and direction on where to best spend their time on investigating new features and enhancements with the newest releases, and how they may apply those to their real-world business use cases. Participants will get a heads-up on upgrades, migrations, regression testing, new features, and lifecycle management. At the end of this session, attendees will have a fresh set of insights on new features for OBIEE developers that they can immediately take advantage of through new releases of OBIEE.
Abstract
2/5/2017 3www.datavail.com
• DatavailChristian Screen – VP, Oracle Analytics Practice Director
• Innovator in analytics and data warehousing design, best practices, and delivery
• More than 15 years of technology implementation, project management, decision support and Data Warehouse experience to Art of BI.
• Co-author of the first book on Oracle Business Intelligence 11g• Managed, been engaged in, and successfully delivered several
of the most complex implementations of Oracle BI, Oracle BI Analytics Applications (OBIA), Hyperion Planning, and Hyperion Essbase, anywhere in the world.
Presenter
@artofbi
2/5/2017 4www.datavail.com
• Introductions• Discuss Legacy Development Options for Oracle BI• Discuss the Average Oracle BI Administrator and Developer• Becoming an OBIEE Developer - (Redefining the OBIEE Developer)• Top 5 OBIEE Developer Items• Oracle BI 11g tools for Developers• Oracle BI 12c tools for Developers• Q & A
Agenda
Introductions
2/5/2017 6www.datavail.com
Datavail Company Overview
• All major platforms: SQL, Oracle, DB2, MySQL, Mongo
• Comprehensive development & operational services
• 24x7 in-office delivery• US & Global models• Reactive and proactive
services
Database Operations
• Microsoft SSRS, SSIS, SSAS• PowerBI• Oracle OBIEE, BICS, Golden
Gate• Informatica• Oracle Data Integrator• ETL development and
operational run
• EBS / PeopleSoft• Hyperion• SharePoint• ServiceNow• Custom development
– Microsoft .NET– Oracle APEX
We are data specialists: databases, analytics, and application data
integration13+ Years delivering data services
300+ customers with average client retention of 7 years
Managed services, projects, and staffing 1 2 3
Analytics, Visualization &
IntegrationApplication
Management
2/5/2017 7www.datavail.com
Datavail BI & Analytics Overview
Datavail is the largest provider of data and database administration (DBA) services in North America with more than 600 technology professionals (analysts, DBAs, developers and consultants).
We offer 24×7 managed services and project consulting in database administration, Hyperion, BI/Analytics, Data Warehousing, and Enterprise Performance Management.
Our expert consulting team specializes in integrations, implementations, and upgrades for applications across the Oracle stack, including:
OBIEE Legacy Development Options
2/5/2017 9www.datavail.com
Has the Oracle BI Administration Tool always been enough?
Oracle BI Tools of the Past
Don’t be Average with OBIEE
2/5/2017 11www.datavail.com
Use Tools Per Your Technology Role
• Administrator• Report Developer• Metdata Modeler• ETL Developer
Becoming and OBIEE Developer
2/5/2017 13www.datavail.com
Developer as an Umbrella Term
• Can a Weblogic administrator stand alone in an OBIEE and Hyperion world?
• Does a report developer need more tools than provided?• What place does a Java developer have in Oracle BI?• What about DevOps?
(also, being referred to as AppOps)
Remember the OBIEE 11g Developer Tools
2/5/2017 15www.datavail.com
What OBI Tools Do You Use? And Why?
• OBIEE 10g had very few externalized tools to make use of for programmatically working with the OBIEE system
• OBIEE 11g increased functionality exposing .EXE (Windows OS) only tools for use in attempting to programmatically integrate third-party systems or administer the OBIEE system
2/5/2017 16www.datavail.com
Holy Grail: RPD Automation & Patching
• Patching each environment to have only the OBIEE RPD Changes is integral to storing only the deltas between builds
• Using output as an XML file that will also be stored in the OBIEE Git SCM
• Commands from OBIEE Client/Server Tools• comparerpd• patchrpd• validaterpd• biserverxmlexec• nqscmd
2/5/2017 17www.datavail.com
Ex: XML SCM to RPD Binary Automation
• Scripting and Automation• There are many different scenarios for complex
situations or many developers.• Basics are taking the MDS XML and convert back to
binary so a CI Server can “Validate”. Patch as needed thereafter.
MDS XML FoldersOBIEE Git Repository
OBIEE Dev ServerOBIEE Test Server
failReturn Response of Failure and Issue
pass
OBIEE RPD to Temp Snapshot
OBIEE RPD + Artifacts Snapshot
2/5/2017 18www.datavail.com
Compared to MicroStrategy Holy Grail LCM
• Scripting and Automation through System Manager• One tool w/ multiple components and code interfaces
Top 6 OBIEE 12c Developer Tools & Changes
2/5/2017 20www.datavail.com
Top Developer Tools for Oracle BI 12c
1. Command Scripts Centralized Across OS’s2. OBI Web Services3. High Availability Configuration Toolset4. BI Cloud Service – SQL Developer & Data Sync Tool (REST)
5. DVT - Validation Tool6. BAR File
2/5/2017 21www.datavail.com
Top Developer Challenges for Oracle BI xx
1. No depth of understanding for OBIEE2. Lack of programming skills3. Lack of caring (or too busy)4. No architecture leadership5. No standards6. Lack of OBIEE API/Programmatic
Extensibility
OS Specific OBIEE Command Scripts
2/5/2017 23www.datavail.com
Centralizing Command Scripts Across OS’s
• OBIEE 12c is a game-changer for automation development
• New script locations• C:\Oracle\OBIEE12cHome\
user_projects\domains\bi\bitools\bin
• Centralized regardless of OS
2/5/2017 24www.datavail.com
OBI Server Tools Compared to the OBI Client Tools
• Still only Windows OS specific with the OBI 12c client tools
• OBI 12c full server allows for the same logic but across OS’s
2/5/2017 25www.datavail.com
Lifecycle Management Centralized
• Starting and Stopping the OBI System and Server no longer a challenge
• WebLogic start and other WLST script still reside in similar location, C:\Oracle\OBIEE12cHome\user_projects\domains\bi
2/5/2017 26www.datavail.com
Patching XML Should be Executed Mainly Via CLI
• Compare RPDs• Capture environment specific
deltas such as connection pool passwords
• Use biserverxmlexec to create a patch XML file
• Use patchrpd to merge the patch XML file to next target environment
"%BI_HOME%/biserverxmlexec" -P Admin123 -I %PATCH_XML% -B %SOURCE_RPD% -O %OUTPUT_RPD%
OBIEE Web Services
2/5/2017 28www.datavail.com
Web Services for Developers
• Don’t confuse OBI Web Services with the OBI Metadata Services• New Metadata Service allows RPD metadata data changes such as
Patching on the fly.
“For example, a developer who wants to update the server repository with new metadata, doesn't have to open Administration Tool or restart the server with a modified repository. The developer can use a stored procedure to directly apply the patch XML created from two different versions of the repository.”
2/5/2017 29www.datavail.com
Metadata Services for Developers
• Don’t confuse OBI Web Services with the OBI Metadata Web Services
• New Metadata Service allows RPD metadata data changes such as RPD patching on the fly.
• Use JDBC in Java apps
2/5/2017 30www.datavail.com
OBIEE Web Services for Developers
• For active connectivity for read and write of web catalog mainly• Different service types allow for different integrations• Updated per each version to reflect new features or enhancements
• AnalysisExportViews Service• ConditionService Service• HtmlViewService Service• iBotService Service• JobManagementService Service• KPIAssessmentService Service• MetadataService Service• ReportEditingService Service
• SAWSessionService Service• SchedulerService Service• ScorecardAssessmentService Service• ScorecardMetadataService Service• SecurityService Service• UserPersonalizationService Service• WebCatalogService Service• XMLViewService Service
OBIEE12c High-Availability
2/5/2017 32www.datavail.com
High Availability Re-Configured
• OBI 12c gives OBI administrators and network admins more control and ease of deployment
2/5/2017 33www.datavail.com
High Availability Re-Configured
• Copy over main configuration files to secondary node• Set up clustering• Execute pack (source server), copy to target, and unpack on target server• Start the server.
• Done!
OBIEE Developers – Reach for the Clouds
2/5/2017 35www.datavail.com
Cloud is on the move for OBIEE Developers
• Cloud interface uses REST protocol with authentication key
• Retrieves or pushes data/metdata via JSON• Make use of standard applications such as SQL
Developer to assist connectivity with developer GUI integration
• Potentially connect to a CI system to run SQL for validation of result, or boundary exceptions to approve code version before moving to production server
• CURL, anyone?
• [ Larry Video on Virtual PC / Cloud ]
2/5/2017 36www.datavail.com
CURL – A great place to start for REST
• CURLing your way to OBIEE REST API interactions
2/5/2017 37www.datavail.com
More OBIEE Developer Tools
• SQL Developer Cloud Connection
• Data Sync Tool
2/5/2017 38www.datavail.com
Developer Tools
• Syncing to Oracle Database Cloud Service • After lift and shift• Use SQLDeveloper CLI• REST API
• APEX is an option here
OBIEE Baseline Validation Tool (BVT)
2/5/2017 40www.datavail.com
Regression Testing to the Rescue!
• OBI 12c release giving anytime validation of data, web catalog, logical sql, and visualizations of reports and dashboards
• Compare two compatible OBIEE versions (11g to 12c, 12c to 12c)
• Provides confidence in migrations or upgrades of OBI
2/5/2017 41www.datavail.com
Baseline Verification Steps
1. Install or run the JAR file2. Define the “Baseline”• Single report or set of reports or whole catalog• A standard set is for litmus tests is usually good
3. Edit the config file4. Generate a baseline result and target result5. Update thresholds6. Execute BVT for comparisons baseline to target7. Review
Warning: Can take a long time depending on content depth
2/5/2017 42www.datavail.com
Baseline Verification Results
• Results depends on what you are comparing• Data, Logical Query, etc.
• Comparison output in HTML reports style for easy review
BI Application Archive(BAR)
2/5/2017 44www.datavail.com
What is the BAR?
• OBI 12c and Oracle BI Cloud Service container for all BI artifacts required for a consistent deployment between two environments
• .BAR file extension
2/5/2017 45www.datavail.com
Moving the BAR
• Export all content to a .bar extension file• Import .bar to target environment• Excellent for Dev-to-Test and Test-to-Production
migration scenarios
2/5/2017 46www.datavail.com
Demonstration
• Review new Oracle BI tools• Review on-premise to cloud integration tools• Major strategy for OBIEE Developers going forward
OBIEE 12c Lifecycle Management(LCM)
2/5/2017 48www.datavail.com
OBIEE 12c Movement After Upgrading
• Caveats After Upgrade• Web Catalog may be warped/corrupted• Security Issues• Application Roles don’t sync to RPD any longer, so create new ones in both places if
needed for security, etc.• New upload, download, refresh, storage, and migration processes
Life Cycle Management(LCM)
2/5/2017 49www.datavail.com
OBIEE 12c LCM
• BAR• Uses WLST in offline mode to accept commands
• ExportServiceInstance• ImportServiceInstance
• All command line interface right now. WLST can be used remotely in online mode
2/5/2017 50www.datavail.com
OBIEE 12c LCM
• BAR
• ExportServiceInstance
• exportServiceInstance('/u01/Oracle/Middleware/Oracle_Home/user_projects/domains/bi', 'ssi', '/u01/workDir', '/u01/exportDir', applicationName=None, applicationDesc=None, applicationVersion=None, includeCatalogRuntimeInfo=false, includeCredentials=None)
2/5/2017 51www.datavail.com
OBIEE 12c LCM
• BAR• ImportServiceInstance• importServiceInstance('/scratch/mydir/oraclehome/user_projects/
domains/bi', 'demosvc1', '/scratch/mydir/orahome/bi/bifoundation/samples/sampleapplite/test/SampleAppLite1.bar', importRPD=true, importJazn=false, importWebcat=false, includeCredentials=‘Test123’)
• Keep in mind the reset needed to empty.bar or SampleAppLite.bar files
http://docs.oracle.com/middleware/1221/biee/BIESG/configrepos.htm#BIESG9320
2/5/2017 52www.datavail.com
OBIEE 12c LCM
• BAR
• ResetServiceInstance
• resetServiceInstance('/oraclehome/user_projects/domains/bi', 'ssi')
http://docs.oracle.com/middleware/1221/biee/BIESG/configrepos.htm#BIESG9320
Beware!
2/5/2017 53www.datavail.com
OBIEE 12c LCM
• Upload and Download RPD• data-model-cmd.sh uploadrpd -I repository.rpd -SI bi -U weblogic -S
server1.example.com -N 7777 -SSL• data-model-cmd.sh downloadrpd -I repository.rpd -SI bi -U weblogic -
S server1.example.com -N 7777 -SSL
http://docs.oracle.com/middleware/1221/biee/BIESG/configrepos.htm#BIESG9320
datamodel.sh instead of data-model-cmd.sh since Oracle BI 12c version 12.2.1.2
Summary & Questions
2/5/2017 55www.datavail.com
Summary
• Summary of what you just heard/saw is to move to using programmatic features to enable easier management of your Oracle BI work.
• Start using Oracle BI 12c LCM• Begin having your developers become “developers” using OBIEE tools to
the fullest for maximum efficiency• Optimize the LCM Process for your organization – save time and reduce
errors/issues
2/5/2017 56www.datavail.com
• Ask questions now or raise one later
Questions?
2/5/2017 57www.datavail.com
http://biteamwork.comhttp://datavail.com
2/5/2017 58www.datavail.com