#atlassian

GRAHAM CARRICK • DEV MANAGER • ATLASSIAN • @GREM000

Clustering JIRAFrom concept to clustered JAC

Concept - Massive teams

Concept - Massive teams

Concept - Massive teams

“JIRA will never be clustered” - JIRA Architect

Our Principles

!

•Keep it simple!

•Boy scout - leave the code better than you found it!

Architecture

• Complete index on each node

• Synced via DB queue• Poll every 5s

Lucene index

• Complete index on each node

• Synced via DB queue• Poll every 5s

Lucene index

• Complete index on each node

• Synced via DB queue• Poll every 5s

Lucene index

• In memory caches• Use Ehcache• Distributed invalidation

pattern

Caches

• In memory caches• Use Ehcache• Distributed invalidation

pattern

Caches

• In memory caches• Use Ehcache• Distributed invalidation

pattern

Caches

• Schedule on all nodes or once per cluster

Scheduler

• Schedule on all nodes or once per cluster

Scheduler

• Schedule on all nodes or once per cluster

Scheduler

• Schedule on all nodes or once per cluster

Scheduler

• Database backed lock• Used sparingly but

needed for cases like upgrade tasks

Locking

• Database backed lock• Used sparingly but

needed for cases like upgrade tasks

Locking

APIs

• Makes the code more future proof• Consistency of API cross product• Collaboration cross product• Plugins

- Make it possible and try to make it easy for them- Restricted architecture choices

The hard work

141 Caches

More hard work

15 Locks

Even more hard work

200+ Synchronized blocks

Then the plugins

80+ Plugins each with caches, scheduled jobs, locks and synchronized block

But wait, there’s more

Complete rewrite of ranking algorithm in JIRA Agile

1

Performance Testing

Performance Testing

Performance Testing

Performance Testing

Performance Testing

Performance Testing

Performance Testing

Performance Testing

Performance Testing

Performance Testing

Performance Testing

Performance

“Better than theoretically possible”

- Me

Performance

Dogfooding: jira.atlassian.com

~200,000 users 270,000 issues

167 custom fields

~75,000 attachments68 workflows

~500,000 comments

139 projects

Dogfooding: jira.atlassian.com

Monitoring

Hardening: from Coal to Diamond

• User cache race• Invalidation vs. Eviction• Excessive locking

“We can do hard things” - JIRA Team

Questions?

Graham Carrick • Dev Manager • Atlassian • @Grem000

Ask live: bit.ly/ask-atlassian !

Log in with your email you used to register

Thank you!

Graham Carrick • Dev Manager • Atlassian • @Grem000