Server Infrastructure of Wikimedia · Wikimedia Server Locations pmtpa – Main Site 285 servers...

8
2007 December 13 th Manuel Schneider Server Infrastructure of Wikimedia Wikipedia – Wikibooks – Wikinews – Wiktionary – Wikiquote – Wikisource – Wikimedia Commons – Wikiversity – ...

Transcript of Server Infrastructure of Wikimedia · Wikimedia Server Locations pmtpa – Main Site 285 servers...

Page 1: Server Infrastructure of Wikimedia · Wikimedia Server Locations pmtpa – Main Site 285 servers Tampa, USA (Florida) hosted by Wikimedia Foundation knams – Europe Cluster 28 servers

2007 December 13th Manuel Schneider

Server Infrastructureof Wikimedia

Wikipedia – Wikibooks – Wikinews – Wiktionary – Wikiquote – Wikisource – Wikimedia Commons – Wikiversity – ...

Page 2: Server Infrastructure of Wikimedia · Wikimedia Server Locations pmtpa – Main Site 285 servers Tampa, USA (Florida) hosted by Wikimedia Foundation knams – Europe Cluster 28 servers

2007 December 13th Manuel Schneider

Wikimedia Server Locations

● pmtpa – Main Site285 serversTampa, USA (Florida)hosted by Wikimedia Foundation

● knams – Europe Cluster28 serversAmsterdam, Netherlandshosted by kennisnet

● yaseo – Asian Cluster23 serversSeoul, Coreahosted by Yahoo

Page 3: Server Infrastructure of Wikimedia · Wikimedia Server Locations pmtpa – Main Site 285 servers Tampa, USA (Florida) hosted by Wikimedia Foundation knams – Europe Cluster 28 servers

2007 December 13th Manuel Schneider

Maintenance

● 3 paid server technician

● 1 paid software developer

● several volunteers

● knams & yaseo sponsored hostingpmpta, servers, staff paid by donations

Page 4: Server Infrastructure of Wikimedia · Wikimedia Server Locations pmtpa – Main Site 285 servers Tampa, USA (Florida) hosted by Wikimedia Foundation knams – Europe Cluster 28 servers

2007 December 13th Manuel Schneider

Server Infrastructure

● Apache as application server (pmtpa)LAMP

● MySQL clusters (pmtpa)3 master servers11 slavesdata replication to toolserver cluster (knams)

● eAccelerator as PHP encoder / cache (pmtpa)

● memcache for session data (pmtpa)

● NFS storage for files (pmtpa)

Page 5: Server Infrastructure of Wikimedia · Wikimedia Server Locations pmtpa – Main Site 285 servers Tampa, USA (Florida) hosted by Wikimedia Foundation knams – Europe Cluster 28 servers

2007 December 13th Manuel Schneider

Server Infrastructure

● geographically distributed proxy serversreading access for anonymous usersstatic content (worldwide)

● poor-man geographical DNS (worldwide)

● loadbalancer distribute HTTP requestbased on URL hash value (worldwide)

● cache purging using HTCP (worldwide)UDP multicastrewritten HTCP extension for squid

Page 6: Server Infrastructure of Wikimedia · Wikimedia Server Locations pmtpa – Main Site 285 servers Tampa, USA (Florida) hosted by Wikimedia Foundation knams – Europe Cluster 28 servers

2007 December 13th Manuel Schneider

Overview 2006

Page 7: Server Infrastructure of Wikimedia · Wikimedia Server Locations pmtpa – Main Site 285 servers Tampa, USA (Florida) hosted by Wikimedia Foundation knams – Europe Cluster 28 servers

2007 December 13th Manuel Schneider

Overview 2004

Page 8: Server Infrastructure of Wikimedia · Wikimedia Server Locations pmtpa – Main Site 285 servers Tampa, USA (Florida) hosted by Wikimedia Foundation knams – Europe Cluster 28 servers

2007 December 13th Manuel Schneider

Overview Toolserver Cluster