Cloud Computing: What it Means for Libraries, Library Staff, Training and Skills
Cloud Libraries
-
Upload
peter-brantley -
Category
Technology
-
view
5.552 -
download
0
description
Transcript of Cloud Libraries
![Page 1: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/1.jpg)
Cloud libraries
April 2008
![Page 2: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/2.jpg)
cloud computing concepts
![Page 3: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/3.jpg)
get fuzzier over time ...
many different broadly similardefinitions abroad
![Page 4: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/4.jpg)
generally means:widely distributed, network based -- storage,- computation,- SaaS models
![Page 5: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/5.jpg)
single datacenter or -hosted apps >
moving to network based solutions
![Page 6: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/6.jpg)
usually provided by external parties on a quanta basis, e.g. compute cycle or byte traffic
![Page 7: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/7.jpg)
a concept of “virtualization”
of infrastructure or web serviceor application
![Page 8: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/8.jpg)
Poster Child:Poster Child:
Amazon’s services --S3 (simple storage system) and EC2 (elastic compute cloud)
![Page 9: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/9.jpg)
NY Times converted its TIFF backlist to PDFwith Amazon services (EC2 / S3)and bill was ~ $500
![Page 10: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/10.jpg)
“I then began some rough calculations and determined that if I used only four machines, it could take some time to generate all 11 million article PDFs. But thanks to the swell people at Amazon, I got access to a few more machines and churned through all 11 million articles in just under 24 hours using 100 EC2 instances, and generated another 1.5TB of data to store in S3.” - Derek Gottfrid, NYT
![Page 11: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/11.jpg)
services are offeredor increasinglydefined by
Google, Amazon,Microsoft (maybe), IBM and others.
![Page 12: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/12.jpg)
Google’s MapReduce
break up a problemallocate to many machinesreassemble for use
![Page 13: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/13.jpg)
[1, 2, 3].map{|i| i * 10}
map{} returns new array[10, 20, 30]
![Page 14: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/14.jpg)
map{} could be
{image processing}{text search}{metadata extraction}
![Page 15: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/15.jpg)
reduce{} transforms output of map{}
![Page 16: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/16.jpg)
It doesn’t matter how many parameters in listevery item handled independentlyfrom every other item
![Page 17: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/17.jpg)
• means computation • over each item in list• can be distributed• to many computers• eg one VM per item
![Page 18: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/18.jpg)
reduce{} combines results
![Page 19: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/19.jpg)
“... a new super-group of tech companies [will] dominate the cloud computing market, each of them managing what amounts to a giant centralised computer made up of a number of big datacentres.”
- Steve Ballmer, MSFT
![Page 20: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/20.jpg)
“NSF Partners With Google and IBM to Enhance Academic Research Opportunities”(Press Release 08-031)
even very high end universitieslag behind corporate computing
![Page 21: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/21.jpg)
“Fundamental changes in computer architecture and increases in network capacity are encouraging software developers to take new approaches to computer-science problem solving.”
![Page 22: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/22.jpg)
“In order to bridge the gap between industry and academia, it is imperative that academic researchers are exposed to the emerging computing paradigm behind the growth of "Internet-scale" applications.”
![Page 23: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/23.jpg)
IBM is deeply committed
![Page 24: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/24.jpg)
![Page 25: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/25.jpg)
IBM Kittyhawk
http://domino.research.ibm.com/comm/research_projects.nsf/pages/
kittyhawk.index.html
![Page 26: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/26.jpg)
IBM Kittyhawk
"We postulate that efficient, balanced machines with high-performance internal networks such as Blue Gene are not only significantly better choices for web-scale companies but can form the building blocks of one global-scale shared computer. Such a computer would be capable of hosting not only individual web-scale workloads but the entire Internet. ...”
![Page 27: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/27.jpg)
in other words:
not your father’sdatacenter
![Page 28: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/28.jpg)
“Hiding in Plain Sight, Google Seeks More Power”
Photo Credit: Melanie Conner for The New York Times
![Page 29: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/29.jpg)
cloud computinghas already revolutionized many content basedinformation services
![Page 30: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/30.jpg)
Google Books virtualizes libraries
![Page 31: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/31.jpg)
Flickr virtualizes image collections
![Page 32: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/32.jpg)
iTunesvirtualizesaudio recordings
![Page 33: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/33.jpg)
YouTubevirtualizes video
![Page 34: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/34.jpg)
Is there space for HE to contribute to
virtualization layers ?
![Page 35: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/35.jpg)
Most new initiativesdo not directly involveresearch libraries as central constituents
![Page 36: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/36.jpg)
OpenLibrary
![Page 37: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/37.jpg)
Zotero and Internet Archive
![Page 38: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/38.jpg)
LibraryThing
![Page 39: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/39.jpg)
If (ARTStor) did (Flickr) ...
![Page 40: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/40.jpg)
libraries provide fairlylightweight applicationsor “soft infrastructure”
![Page 41: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/41.jpg)
e.g. faculty repository systemsonline publishing platformsboutique special collections
![Page 42: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/42.jpg)
not fundamental infrastructureprovision
![Page 43: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/43.jpg)
power is in aggregation
![Page 44: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/44.jpg)
but there are problems with library collaboration at scale
![Page 45: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/45.jpg)
(it doesn’t happen)
![Page 46: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/46.jpg)
similar to classic political science issueson sovereignty
![Page 47: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/47.jpg)
EU one of the most successfultrans-national political efforts
![Page 48: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/48.jpg)
Europe tightly integrated due to - physical and - historical and - economic issues
![Page 49: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/49.jpg)
consider the difficulties establishing
League of Nations
![Page 50: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/50.jpg)
![Page 51: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/51.jpg)
and post WW-II,
United Nations
![Page 52: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/52.jpg)
![Page 53: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/53.jpg)
United Nations (as it exists today)not (at all) what itsplanners wished
![Page 54: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/54.jpg)
Tremendous conflict arose in San Francisco between Russia (Molotov)other Allied war parties
![Page 55: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/55.jpg)
Even in the face of the possibility of world-ending
NUCLEAR WAR
![Page 56: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/56.jpg)
Libraries have little beyond established workflow
interoperation like ILL
![Page 57: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/57.jpg)
a few dominance hierarchieslike the CICor OhioLinkor the CDL
which do well in core operations
![Page 58: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/58.jpg)
OCLC
I see primarily as a vendorin important but established bibliographic service space
![Page 59: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/59.jpg)
Difficult to establish - much less maintain - a of large libraries
with serious long term resource commitments
![Page 60: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/60.jpg)
maybe the best model issupport of the equivalent of something like the IAEA
![Page 61: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/61.jpg)
contribute - dollars - staff - expertise- technology
![Page 62: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/62.jpg)
workingwith othersbut relying onan independentorganizationalframework for action
![Page 63: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/63.jpg)
a possible role for the DLF
“marriage broker”
![Page 64: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/64.jpg)
make introductionsbetween nascent efforts and potential partners
![Page 65: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/65.jpg)
like libraries and museumsand archives and tech firmsand societies
![Page 66: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/66.jpg)
figure out domain- or discipline-based early-stage faculty teams seeking to develop new services
![Page 67: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/67.jpg)
aid and abet --
encourage faculty and professional societiesto assume leadership
![Page 68: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/68.jpg)
current thrusts for the DLF ...
![Page 69: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/69.jpg)
mobile apps virtual worlds moving images science CI
![Page 70: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/70.jpg)
focus today on mobile :fundamentally reliant on net- scale applications
![Page 71: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/71.jpg)
mantra
connectcommunicatecollaborate
(CCC)
![Page 72: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/72.jpg)
mobile apps
iPhone Android
wholly game changingdevelopment platforms
![Page 73: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/73.jpg)
coming :social collaborative learning environments
![Page 74: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/74.jpg)
wild assed designs• portable • networked• computing• interfaces
![Page 75: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/75.jpg)
petiteinvention
![Page 76: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/76.jpg)
areas to watch
Rudy de Waele Plugg.eu - March 19, 2008 dot.Open
![Page 77: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/77.jpg)
sensoringbiometrics
transactionslifestreaming
recommendationimage recognitionaugmented reality
mobile connected gameslocation based social media
retail proximity media consumption
Rudy de Waele Plugg.eu - March 19, 2008 dot.Open
![Page 78: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/78.jpg)
in ...
where ? librariesin the future
![Page 79: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/79.jpg)
university libraries will not bandtogether in virtual organizationsto establish
bigger, better librariesoffering cloud based information services
![Page 80: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/80.jpg)
probably this is against theirinstitutional nature
![Page 81: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/81.jpg)
a significant difficulty inmoving into wholly differentdomain areas (like mobile)
![Page 82: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/82.jpg)
IN NEW ecological niches
– zero platform expertise– no collaboration : industry– a paradigm shift in IT
![Page 83: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/83.jpg)
libraries MUSTMUST
STOPSTOP defining solutions
(in terms of) libraries
![Page 84: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/84.jpg)
libraries must learn how to :
- partner ||- collaborate || - contribute ||- coordinate
![Page 85: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/85.jpg)
via organizational frameworks
- external to us - friendly to us - supported by us- sponsored by us(but not us.
![Page 86: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/86.jpg)
that’s a differentkind of library
more diversemore opportunistic more open
![Page 87: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/87.jpg)
it’s a smaller libraryit’s a more nimble library it’s a library of pieces
broken up from somethingunwieldy lethargic stifling
![Page 88: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/88.jpg)
( It should bea
more funmore fun
LIBRARY )
![Page 89: Cloud Libraries](https://reader034.fdocuments.in/reader034/viewer/2022051815/54050ed38d7f729b768b4a86/html5/thumbnails/89.jpg)
thanks
peter at diglib.orgnaypinya {twitter, twine, skype}