Enabling Web 2.0 User Experience for Oracle E-Business Suite
Oracle Database In-Memory: Enabling Real-time Analytics · Oracle BIWA Summit 2017 Oracle Database...
Transcript of Oracle Database In-Memory: Enabling Real-time Analytics · Oracle BIWA Summit 2017 Oracle Database...
Oracle BIWA Summit 2017
Oracle Database In-Memory: Enabling Real-time AnalyticsAndy Rivenes, Product ManagerOracle
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
SafeHarborStatementThefollowingisintendedtooutlineourgeneralproductdirection.Itisintendedforinformationpurposesonly,andmaynotbeincorporatedintoanycontract.Itisnotacommitmenttodeliveranymaterial,code,orfunctionality,andshouldnotberelieduponinmakingpurchasingdecisions.Thedevelopment,release,andtimingofanyfeaturesorfunctionalitydescribedforOracle’sproductsremainsatthesolediscretionofOracle.
2
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
WhatisDatabaseIn-Memory
3
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
OracleDatabase In-MemoryGoals
4
Real-TimeAnalytics TrivialtoImplement
NoApplicationChangesNotLimitedbyMemory
100X
AccelerateMixedWorkload
AnalyticsTransactions
RunanalyticsonOperationalSystems
EnableReal-TimeBusinessDecisions
Real-TimeAnalytics100X
Risk-Free
ProvenScale-Out,Availability,Security
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
Breakthrough:DualFormatDatabase
• BOTH rowandcolumnformatsforsametable
• Simultaneouslyactiveandtransactionally consistent
• Analytics&reportingusenewin-memoryColumnformat
• OLTPusesprovenrowformat
5
BufferCacheNewIn-MemoryColumnStore
SALES SALESRow
FormatColumnFormat
SALES
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
OracleDatabase12c• DatabaseIn-MemoryisanoptionforOracleDatabase12cEnterpriseEdition
• DatabaseIn-Memoryisincludedinthefirstpatchset (12.1.0.2)for12.1
• AvailableintheCloudon12.2• Noadditionalstepsrequired
6
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
Oracle Database In-Memory: Simple to Implement
1. Configure Memory Capacity• inmemory_size = XXX GB
2. Configure tables or partitions to be in memory• alter table | partition … inmemory;
3. Later drop analytic indexes to speed up OLTP
7
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
OracleIn-MemoryAdvisor• NewIn-MemoryAdvisor• AnalyzesexistingDBworkloadviaAWR&ASHrepositories
• ProvideslistofobjectsthatwouldbenefitmostfrombeingpopulatedintoIMcolumnstore
Note:DatabaseTuningPacklicenserequired
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
Howdoesitwork
9
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
OracleIn-MemoryColumnarTechnology
10
SALES
SALES
PureIn-MemoryColumnar• Purein-memorycolumnformat
• Enableforsubsetofdatabase• Cheaptomaintain– nologgingorIO• AllowsefficientOLTP• Nochangetodiskformat
• Builtseamlessly intoOracleDatabase• Appearsasanewstoragetype• Transparent toApplications• AllEnterpriseFeatureswork..
• Availability– RAC,Flashback,DataGuard,etc.• Security– Encryption,Auditing,etc.
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
In-MemoryArea:NewStaticAreawithinSGA
SystemGlobalAreaSGA
BufferCache
SharedPool
LogBuffer
LargePool
In-MemoryAreaOther
• ContainsdatainthenewIn-MemoryColumnFormat
• ControlledbyINMEMORY_SIZEparameter- Minimumsizeof100MB
• SGA_TARGETmustbelargeenoughtoaccommodatethisarea
11
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
ScanningandfilteringdatamoreefficientlyReal-TimeAnalytics
StorageIndexesCompression
Scan&filterdataincompressedformat
Accessonlythecolumnsyouneed
ColumnarFormat SIMDVectorProcessing
ProcessmultiplecolumnvaluesinasingleCPUinstruction
VectorRegister
Loadmultipleregionvalues
VectorCompareallvaluesan1cycle
CPUCA
CACA
CA
Min1Max3
Min4Max7
Min8Max12
Pruneoutanyunnecessarydatafromthecolumn
12
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
• Speedofmemory• ScanandFilteronlytheneededColumns
• VectorInstructions
Real-timeAnalyticsImprovesallaspectsofanalyticqueries
DataScans
VectorRegisterCPU
CA
CACA
CA
In-MemoryAggregation
•CreateIn-MemoryReportOutlinethatisPopulatedduringFastScan
•RunsReportsInstantly
Joins
•ConvertStarJoinsinto10XFasterColumnScans
•Searchlargetableforvaluesthatmatchsmalltable
HASHJOIN
TableA TableB
SALES
STATE=CA
13
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
What’sNew
14
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
• In-Memoryalwaysavailable• 248GBofRAMpernode• EasywaytohavecustomerstryDBIM
• Note:Memorytobeupgradedto768GBofRAMpernodewithX6basedservers
• In-MemoryavailableinDatabaseX50IM– 50GBofstorage/10GBSGA
• Limitedto5GfortheIn-MemoryArea
• Intendedfordevelopersandsmalldepartmentalusers
15
• In-MemoryavailableinExtremePerformanceservice– NotavailableinSE,Enterprise,orHighPerformanceEditions
– Upto240GBRAMpernode
• EasywaytohavecustomerstryDBIM
DatabaseIn-MemoryAvailableNOW intheCloud
Exadata Express Exadata CloudServiceDatabaseAsaService
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
What’snewin12.2forDatabaseIn-Memory
2X FasterJoins5X FasterExpressions
Real-TimeAnalytics Automation
DynamicDataMovementBetweenStorage&Memory
MassiveCapacity
In-MemoryonExadataFlash
MixedWorkload
ActiveDataGuardSupport
Multi-model
NativesupportforJSONDatatype
16
{}JSON
Column
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
DatabaseIn-MemoryandotherOracleDatabasefeatures
17
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
DatabaseIn-Memory:ScalestoAnySize
18
Scale-Up
•Scale-UponlargeSMPs•NUMAOptimized
•Scale-OutAcrossServerstoGrowMemoryandCPUs
• In-MemoryQueriesParallelizedAcrossServers
Scale-Out CombinewithFlashandDisk
DISKPCIFLASHDRAM
ColdDataHottestData
ActiveData
•Easilyplacedataonmostcosteffectivetier
•SimultaneouslyAchieve:•Speed ofDRAM• I/OsofFlash•Cost ofDisk
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.| 19
RAC
ASM
RMAN
Data Guard & GoldenGate
• Pure In-Memory format does not change Oracle’s storage format, logging, backup, recovery, etc.
• All Oracle’s proven availability technologies work transparently
• Protection from all failures- Node, site, corruption, human error, etc.
DatabaseIn-Memory:IndustrialStrengthAvailability
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
DatabaseIn-Memory:TrivialtoImplement
20
SimpletoConfigure
NocomplexsetupSetcolumnstoresize
DeclareIn-Memorytables
FullFunctionality
NoSQLrestrictions
100%Compatible
Noapplicationchanges
Nodatamigration
EasytoDeploy
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
HowarecustomersusingOracleDatabaseIn-Memory
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
AT&TWiFi – DataWarehouse• BusinessObjectsreports100X faster
• ETLprocessesimprovedby50% faster
• NochangestoSAPBusinessObjectsreports
Villeroy &Boch – SAPBW• SAPBWCOPAqueries30– 33X faster
• SAPTransactionlistqueries4– 4,800Xfaster
• Avoidedexpensive&riskyupgradetoS4/Hana
22
BOSCH – SAPCRM• Dropped allcustomindexes
• Analyticqueries2-20Xfaster,DML2-3X faster
• Nochangestoapplicationrequired
DieMobiliar – MixedWorkload• Analyticqueries50-200X faster
• Databasesizereduced considerably
• PhaseoutofNetezza andmainframesystems
DatabaseIn-MemoryReferences
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
WherecanIgetmoreinformation
23
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
JointheConversation
24
https://twitter.com/TheInMemoryGuyhttps://blogs.oracle.com/in-memory/
WhitePapers(otn.com)• OracleDatabaseIn-MemoryWhitePaper• OracleDatabaseIn-MemoryAggregationPaper• WhentouseOracleDatabaseIn-Memory• OracleDatabaseIn-MemoryAdvisor
Videos• OracleDatabaseIn-MemoryYouTubeChannel• oracle.com- PoweringtheReal-TimeEnterprise- IndustryExpertsSharePerspectivesoracle.com/us/corporate/events/dbim/index.html
• YouTube- JuanLoaiza:SoftwareinSilicon
AdditionalQuestions• In-Memoryblog:blogs.oracle.com/In-Memory• Myemail:[email protected]
https://www.facebook.com/OracleDatabasehttp://www.oracle.com/goto/dbim.html
AdditionalResources