Better, Faster, Stronger! Migration to 3.0

Post on 14-Apr-2017

542 views 1 download

Transcript of Better, Faster, Stronger! Migration to 3.0

© 2

015

Amad

eus I

T Gr

oup

SA

Better, Faster, Stronger! Migration to 3.0

Upgrade MongoDB in the enterprise environment

Attila Tozser, Amadeus Data Processing GmbH, MongoDB Days

Germany, 20/10/2015

© 2

015

Amad

eus I

T Gr

oup

SA

Amadeus IT Group1

Amadeus is a technology company dedicated to the global travel industry. We are present in 195 countries with a worldwide team of more than 13,200 people. 

Our solutions help improve the business performance of travel agencies, corporations, airlines, airports, hotels, railways and more.

_ Introduction1Amadeus in a few words

© 2

015

Amad

eus I

T Gr

oup

SA

Our solutions facilitate journeys and enrich the travel experience for hundreds of millions of people every year. 

to shape the future of travel 

_ Introduction1

We are working together with our customers and partners

We have a clear purpose

© 2

015

Amad

eus I

T Gr

oup

SA

Page 6

A history of shaping the future of travel _ Amadeus history2

1987Amadeus is founded

1995World leader in number of travel agency locations

19981 MILLIONbookings made on a single day for the first time

2010Amadeus diversifiesinto IT for hotel, railand airport

1992First booking made through Amadeus

1996e-Commerce division launched

2000Partnership with BA and Qantas to launch Amadeus Altéa – our core Airline IT offering

2014Contracts with Ryanair and Southwest Airlinesand a strategic technology relationship with IHG

© 2

015

Amad

eus I

T Gr

oup

SA

Page 7

_ Amadeus today3Robust global operations

© 2

015

Amad

eus I

T Gr

oup

SA

1.6+billiondata requests processed per day

526milliontravel agencybookings processed in 2014

695millionPassengers Boarded (PBs) in 2014

95%of the world’s scheduled network airline seats

Page 8

Close to our customers

© 2

015

Amad

eus I

T Gr

oup

SA

Page 9

A global team of 13,200+ professionals

_ 118 nationalities_ Cultural diversity_ Clear focus on recruiting

and developing talent_ Values based culture

© 2

015

Amad

eus I

T Gr

oup

SA

MongoDB at Amadeus2

Page 11

Business needsGathered from customers

user-friendly way to query any datain our main operational databases_ Unpredictable ad-hoc search_ Many advanced reporting requirements

A way to store orders of magnitude more different data from various sources, but still maintain low latency

Sustain Organic growth of data and throughput (time-to-time 2X or more a year) without degradation

Page 12

Runs on standard x86 architecture

C++, Python & Java drivers

Enterprise-grade security_ SSL encryption_ Kerberos authentication_ Data-at-rest encryption

MongoDB is perfect match to our needs

IntegrationIn the Amadeus standards

© 2

015

Amad

eus I

T Gr

oup

SA

New features in MongoDB 3.02

© 2

015

Amad

eus I

T Gr

oup

SA

© 2

015

Amad

eus I

T Gr

oup

SA

WiredTiger our observations• Compression ratio 3x-10x• IO characteristic tunable

• Better latency• Enhanced security

In-memory our observations• On OOM instant crash

• Sustained 150K/4KB IOPSOn a single box• 1-6ms latency

© 2

015

Amad

eus I

T Gr

oup

SA

Upgrade MongoDB in the enterprise environment

2AmadeusClients

© 2

015

Amad

eus I

T Gr

oup

SA

AmadeusClients

© 2

015

Amad

eus I

T Gr

oup

SA

SS

S

S

S

S

Application servers MongoDB

© 2

015

Amad

eus I

T Gr

oup

SA

SS

S

S

S

S

This appserver consist of• Operating System• Application code• MongoDB driver• Mongos binary

Database sever:Operating SystemMongoDB binariesMisc. processes:

Ops manager agentsMonitoring codeAutomation code

© 2

015

Amad

eus I

T Gr

oup

SA

MongoDB Cluster

MMS/Ops Manager

_Always Sharded and replicated

_Over 10 test levels

_Monitoring_Backup_(automation)

Mongodb 3.0 needs Ops Manager > 1.6.0

© 2

015

Amad

eus I

T Gr

oup

SA

Upgrading MMS3

MMS application database

Backup Database

Backup Database

Backup Database

MMS App Server MMS App Server MMS App Server

Backup Daemon

Backup Daemon

Backup Daemon

Backup agents

Monitoring agents

Automation agents

Upgrade separately as any other MongoDB cluster3.0 only from MMS 1.6

The server processes contain the new versions

Should be on the same version: Upgrade together

© 2

015

Amad

eus I

T Gr

oup

SA

Upgrading MMS3MMS App Server

REST API

Corporate Monitoring

API callsMetrics

Corporate Automation

API callsConfig options

© 2

015

Amad

eus I

T Gr

oup

SA

SS

S

S

S

S

http://docs.mongodb.org/manual/release-notes/3.0-upgrade/

_Upgrade MongoDB_Be prepared for fallback funnies

_Backup, MONGODB-CR auth_Lucky case: Give a try to Ops Manager

automation_Less lucky case: Do it by hand

_Start from a 2.6 installation

© 2

015

Amad

eus I

T Gr

oup

SA

Upgrading MMS3

S

Upgrade the Mongos processes

Config 1 Config 2 Config 3

S, 3.xUpgrade cluster metadata

Upgrade all the mongos processes

Upgrade config

© 2

015

Amad

eus I

T Gr

oup

SA

3

PrimaryMMAP v1

2.6

SecondaryMMAP v1

2.6SecondaryMMAP v1

2.6

Upgrade the Shards

SecondaryWT 3.0

Install binaries

Install binaries

Install binaries

PrimaryWT 3.0

SecondaryWT 3.0

SecondaryMMAPv1

2.6Secondary

WT 3.0PrimaryWT 3.0

SecondaryWT 3.0

© 2

015

Amad

eus I

T Gr

oup

SA

Look into the future3MY MongoDB wishlist

_ Cross cluster replication _ Filtered / delayed / batched

_ Multimaster (AP operation)_ Multithreaded queries_ Transactions

_ On multi update

© 2

015

Amad

eus I

T Gr

oup

SA

Divider title here1Thank you!Questions?