Oracle SHARDING

©2015 LinkedIn Corporation. All Rights Reserved.

Vinoth Govindaraj www.linkedin.com/in/vgovindaraj

©2015 LinkedIn Corporation. All Rights Reserved.

About LinkedIn LinkedIn is the world's largest professional network with 380 million members in over 200 countries and territories around the globe.

Connect the world's professionals to make them more productive and successful.

Mission

ORACLE SHARDING

Home Grown Sharding Architecture: LinkedIn

©2015 LinkedIn Corporation. All Rights Reserved. 3

SHARD1 SHARD2 SHARD3 SHARD4 SHARD5

ORACLE - DB01

ORACLE - DB03

ORACLE - DB02

……..

1-2,000,000 2 MM – 4 MM 4 MM – 6 MM 6 MM – 8 MM 8 MM – 10 MM

…..

txMgr txMgr txMgr txMgr txMgr

APPLICATION

ShardLocator shard.config

ORACLE SHARDING

Pros: §  Config. based addition/rebalancing of shards. No code change.

§  Key based migration for re-balancing. No impact to the application.

§  Efficient use of cap-ex.

©2015 LinkedIn Corporation. All Rights Reserved. 4

Cons:

§  Manual re-configuration of golden gate during rebalancing/new table additions.

§  No cross shard query capability.

§  No composite sharding capability.

ORACLE SHARDING

Where we want to be - Oracle 12c Sharding

©2015 LinkedIn Corporation. All Rights Reserved. 5

….. …..

Shard Group 1 - Rep factor - 1

Data Guard Standby

…..

Shard Group 2 - Rep factor - 1

Shard Group 3 - Rep factor - 1

APP

APP

APP

…..

…..

ORACLE SHARDING

12c Rel2 Beta Testing: Linkedin Feedback

§  “Out of box” cross shard query functionality.

§  Automatic DG/FSF configuration during deploy/rebalancing.

§  Auto CDR and Column group based CDR are good.

§  RESTful interfaces for easy configuration of GG.

§  Composite SHARDING

©2015 LinkedIn Corporation. All Rights Reserved. 6

Positives:

ORACLE SHARDING

12c Rel2 Beta Testing: Linkedin Feedback

§  Deploy does not support combination of GG + ADG configuration currently.

§  Single query coordinator limits scalability for cross-shard queries.

§  In Beta - Single connection pool can be exposed to connection starvation due to problems in a single shard. Oracle is addressing this via a configurable property in the prod release.

§  Chunks being Read Only for the duration of last incremental backup during chunk move.

©2015 LinkedIn Corporation. All Rights Reserved. 7

Suggestions:

ORACLE SHARDING ©2015 LinkedIn Corporation. All Rights Reserved. 8