Search as a Service with Xapian - Search Solutions 2009
-
Upload
richard-boulton -
Category
Technology
-
view
502 -
download
3
Transcript of Search as a Service with Xapian - Search Solutions 2009
![Page 1: Search as a Service with Xapian - Search Solutions 2009](https://reader033.fdocuments.in/reader033/viewer/2022052908/55949ad51a28abc55d8b45b9/html5/thumbnails/1.jpg)
This page intentionally left somewhat blank
![Page 2: Search as a Service with Xapian - Search Solutions 2009](https://reader033.fdocuments.in/reader033/viewer/2022052908/55949ad51a28abc55d8b45b9/html5/thumbnails/2.jpg)
Search as a service with XapianRichard Boulton
![Page 3: Search as a Service with Xapian - Search Solutions 2009](https://reader033.fdocuments.in/reader033/viewer/2022052908/55949ad51a28abc55d8b45b9/html5/thumbnails/3.jpg)
![Page 4: Search as a Service with Xapian - Search Solutions 2009](https://reader033.fdocuments.in/reader033/viewer/2022052908/55949ad51a28abc55d8b45b9/html5/thumbnails/4.jpg)
![Page 5: Search as a Service with Xapian - Search Solutions 2009](https://reader033.fdocuments.in/reader033/viewer/2022052908/55949ad51a28abc55d8b45b9/html5/thumbnails/5.jpg)
?
![Page 6: Search as a Service with Xapian - Search Solutions 2009](https://reader033.fdocuments.in/reader033/viewer/2022052908/55949ad51a28abc55d8b45b9/html5/thumbnails/6.jpg)
![Page 7: Search as a Service with Xapian - Search Solutions 2009](https://reader033.fdocuments.in/reader033/viewer/2022052908/55949ad51a28abc55d8b45b9/html5/thumbnails/7.jpg)
“Every six months, a dozen web developers go to an easily defensible location, without the internet, and build a website”
– James Aylett
/dev/fort
![Page 8: Search as a Service with Xapian - Search Solutions 2009](https://reader033.fdocuments.in/reader033/viewer/2022052908/55949ad51a28abc55d8b45b9/html5/thumbnails/8.jpg)
wildlifenearyou.com
![Page 9: Search as a Service with Xapian - Search Solutions 2009](https://reader033.fdocuments.in/reader033/viewer/2022052908/55949ad51a28abc55d8b45b9/html5/thumbnails/9.jpg)
Async, out-of-process, scalableHTTP/JSON
http://server/dbname/addhttp://server/dbname/deletehttp://server/dbname/search
Djape
![Page 10: Search as a Service with Xapian - Search Solutions 2009](https://reader033.fdocuments.in/reader033/viewer/2022052908/55949ad51a28abc55d8b45b9/html5/thumbnails/10.jpg)
Throw one away!
![Page 11: Search as a Service with Xapian - Search Solutions 2009](https://reader033.fdocuments.in/reader033/viewer/2022052908/55949ad51a28abc55d8b45b9/html5/thumbnails/11.jpg)
Back to work...
● “Flax”● Rewrite from ground up● Design a clean REST based protocol
![Page 12: Search as a Service with Xapian - Search Solutions 2009](https://reader033.fdocuments.in/reader033/viewer/2022052908/55949ad51a28abc55d8b45b9/html5/thumbnails/12.jpg)
Interfaces matter
![Page 13: Search as a Service with Xapian - Search Solutions 2009](https://reader033.fdocuments.in/reader033/viewer/2022052908/55949ad51a28abc55d8b45b9/html5/thumbnails/13.jpg)
Guardian offices, March 2009
![Page 14: Search as a Service with Xapian - Search Solutions 2009](https://reader033.fdocuments.in/reader033/viewer/2022052908/55949ad51a28abc55d8b45b9/html5/thumbnails/14.jpg)
PUT to /v1/dbs/dbnamePOST to /v1/dbs/dbname/schema/fields/text { 'type': 'text', 'freetext': {'language': 'en'} } }
POST to /v1/dbs/dbname/docs { 'text': ['foo'] }(or PUT to /v1/dbs/dbname/docs/docid)
Present the API so far
![Page 15: Search as a Service with Xapian - Search Solutions 2009](https://reader033.fdocuments.in/reader033/viewer/2022052908/55949ad51a28abc55d8b45b9/html5/thumbnails/15.jpg)
Present the API so far
● Don't throw this one away!
![Page 16: Search as a Service with Xapian - Search Solutions 2009](https://reader033.fdocuments.in/reader033/viewer/2022052908/55949ad51a28abc55d8b45b9/html5/thumbnails/16.jpg)
Yahoo Hackday24 hours to make a site
![Page 17: Search as a Service with Xapian - Search Solutions 2009](https://reader033.fdocuments.in/reader033/viewer/2022052908/55949ad51a28abc55d8b45b9/html5/thumbnails/17.jpg)
Newspan – learning which news is interesting
![Page 18: Search as a Service with Xapian - Search Solutions 2009](https://reader033.fdocuments.in/reader033/viewer/2022052908/55949ad51a28abc55d8b45b9/html5/thumbnails/18.jpg)
Another gathering – more ideas and refinement
![Page 19: Search as a Service with Xapian - Search Solutions 2009](https://reader033.fdocuments.in/reader033/viewer/2022052908/55949ad51a28abc55d8b45b9/html5/thumbnails/19.jpg)
● Separate search from indexer● More modularity● Easier ways to specify searches
![Page 20: Search as a Service with Xapian - Search Solutions 2009](https://reader033.fdocuments.in/reader033/viewer/2022052908/55949ad51a28abc55d8b45b9/html5/thumbnails/20.jpg)
What's next?
● Performance – rewrite in C++● Lower memory overhead● Expose horizontal scaling features of Xapian● Easier install – fewer dependencies● Produce an AMI for Amazon cloud● Run a fully open source hosted search.
![Page 21: Search as a Service with Xapian - Search Solutions 2009](https://reader033.fdocuments.in/reader033/viewer/2022052908/55949ad51a28abc55d8b45b9/html5/thumbnails/21.jpg)
What's next?
● Keep talking to developers and users, to be led by them!
![Page 22: Search as a Service with Xapian - Search Solutions 2009](https://reader033.fdocuments.in/reader033/viewer/2022052908/55949ad51a28abc55d8b45b9/html5/thumbnails/22.jpg)
Credits
Richard [email protected]
Andree Stephan: - http://upload.wikimedia.org/wikipedia/commons/thumb/d/d6/ Alderney_-_Fort_Clonque_02.jpg/800px-Alderney_-_Fort_Clonque_02.jpg
Ted Drake: - http://www.flickr.com/photos/draket/3517960655/
Gruntzooki: - http://farm4.static.flickr.com/3044/2710669746_c973e8b766.jpg