Proactive Displays IIIA 20080627

download Proactive Displays IIIA 20080627

If you can't read please download the document

description

Presentation given at IIIA @ CSIC in Barcelona on 27 June 2008.

Transcript of Proactive Displays IIIA 20080627

  • 1.Proactive Displays: Bridging the Gaps betweenOnline Social Networks and Shared Physical Spaces Joe McCarthy Principal Instigator Strands Labs, Seattle

2. Outline

  • A few shameless plugs
  • What I learned from AI
  • Overview: A brief history of Proactive Displays
  • An example: the Context, Content & Community Collage
  • Related work: commercial & academic
  • Future plans

(Slides available online athttp://www.slideshare.net/gumption ) 3. Strands: social recommendation & discovery http://www.strands.com/corp http://blog.strands.com 4. Strands: social recommendation & discovery What you play counts! 5. Recommender System Startup Contest Deadline: 15 September 2008 ACM RecSys 2008 23-25 October Lausanne, Switzerland 6. UbiComp 2008

  • 10th International Conference on Ubiquitous Computing
  • Seoul, Korea, 21-24 September 2008
  • Open participation categories (thru 27 June 2008, 23:59 PDT):
    • Workshops
    • Panels
    • Demonstrations
    • Posters
    • Doctoral Colloquium
    • Student Volunteers
  • http://ubicomp.org/ubicomp2008/

Program Co-Chairs Joe McCarthy(Strands Labs Seattle, USA) James Scott(Microsoft Research, UK) Woontack Woo(GIST, South Korea) 7. My AI Background

  • A Trainable Approach to Coreference Resolution for Information Extraction
    • Ph.D. Dissertation, 1996, University of Massachusetts
    • Machine Learning, Natural Language Processing

Conference Year Text Source Topic (Domain) MUC-11987Mil. reportsFleet Operations MUC-21989Mil. reportsFleet Operations MUC-31991News reportsTerrorist activities in Latin America MUC-41992News reportsTerrorist activities in Latin America MUC-51993News reportsCorporate Joint Ventures, Microelectronic Production MUC-61995News reportsLabor Disputes and Corporate Management Succession MUC-71997News reportsAirplane crashes, and Rocket/Missile Launches 8. What I learned from AI

  • A little bit of AI goes a long way
    • Intelligence is a large problem space
    • The only way to make progress is to impose appropriate constraints
    • News articles vs. all of language
    • Small number of entities vs. all of the world
  • The same applies to ubiquitous computing
    • Ubiquitous computing = computing everywhere(beyond the desktop)
    • Everywhere is a large problem space
    • Certain places vs. everywhere
    • Certain activities vs. everything

Neat vs.Scruffy Strong AI vs.Weak AI 9. Proactive Displays: Definition ( )pr- ak-tivadjective acting in anticipation of future problems, needs, or changes di- splnoun a setting or presentation of something in open view 10. Proactive Displays + Online Profiles PhysicalTokens + Large Displays Better Real-world Interactions Bridging the gaps between people by bridging the gaps between the online and offline worlds = Large visual or aural displays that can sense & respondto the people and activities taking place in their vicinity 11. 1st Generation Proactive Displays MusicFX MusicFX: An Arbiter of Group Preferences for Computer-Supported Cooperative Workouts Joseph F. McCarthy and Theodore Anagnost 1998 ACM Conference on Computer-Supported Cooperative Work (CSCW 98) A Multi-Agent System for Meting Out Influence in an Intelligent Environment M. V. Nagendra Prasad and Joseph F. McCarthy Eleventh Innovative Applications in Artificial Intelligence Conference (IAAI 99) http://www.youtube.com/watch?v=WLgXLl4uGYk a fitness center environment that knowswho is working out, what they like to listen to,and dynamically adjusts the musicto best suit the group of exercisers at any given time. 12. 2nd Generation Proactive Displays Visual Awareness Location Tools (ActiveMap & EventManager) ActiveMap: A Visualization Tool for Location Awareness to Support Informal Interactions Joseph F. McCarthy and Eric S. Meidel First International Symposium on Handheld and Ubiquitous Computing (HUC '99) EventManager: Support for the Peripheral Awareness of Events Joseph F. McCarthy and Theodore D. Anagnost. Second International Symposium on Handheld and Ubiquitous Computing (HUC 2000) a suite of tools for creating greater awarenessof the location and activities of colleagues within a workgroup,with an aim to provide more opportunities for informal communication 13. 3rd Generation Proactive Displays UniCast, OutCast, GroupCast: Ubiquitous Peripheral Displays UniCast, OutCast & GroupCast: Three Steps Toward Ubiquitous Peripheral Displays Joseph F. McCarthy, Tony J. Costa and Edy S. Liongosari Third International Conference on Ubiquitous Computing (UbiComp 2001) Promoting Awareness of Work Activities through Peripheral Displays Elaine M. Huang, Joe Tullio, Tony J. Costa and Joseph F. McCarthy 2002 ACM Conference on Human Factors in Computer Systems (CHI 2002) 14. 4th Generation Proactive Displays AutoSpeakerID Ticket2Talk Neighborhood Window Augmenting the Social Space of an Academic Conference Joseph F. McCarthy, David W. McDonald, Suzanne Soroczak, David H. Nguyen and Al M. Rashid ACM 2004 Conference on Computer Supported Cooperative Work (CSCW 2004) Proactive Displays: Supporting Awareness in Fluid Social Environments David W. McDonald, Joseph F. McCarthy, Suzanne Soroczak, David H. Nguyen and Al M. Rashid ACM Transactions on Computer-Human Interactions (TOCHI), Vol. 14, No. 4, January 2008 15. 4th Generation Proactive Displays (v 2) 16. 5th Generation Proactive Displays The Context, Content & Community Collage @ Nokia Research Center Palo Alto The Context, Content & Community Collage: Sharing Personal Digital Media in the Physical Workplace Joseph F. McCarthy, Ben Congleton, F. Maxwell Harper To appear: ACM 2008 Conference on Computer Supported Cooperative Work (CSCW 2008) 17. The Latest Generation of Proactive Displays

  • Shortcomings of previous efforts
    • Special-purpose sensors(IR badges, RFID tags)
    • Special-purpose profiles
    • Special-purpose installations
  • Goals of present / future efforts
    • Multi-purpose sensors(BT mobiles NFC)
    • Multi-purpose profiles
    • Multi-purpose installations

18. The Problem

  • Employees feel un[der]appreciated
    • #1 reason people leave jobs (US Labor Dept)
    • 2/3 of workers receivenorecognition (Gallup)
    • Active disengagementcosts US$300B / year
  • Employees feel disconnected
    • Lack of community in workplace
    • Us vs. them
  • Managers have less time, broader responsibilities
    • Difficult to manage frequent,sustained personal touch

19. Friendships at Work 30% of employees have a best friend at work (BF@W) 20% of employees dedicate time to building relationships at work Employees with a BF@W are 50% more satisfied with their company Employees with a BF@W are 7 times more likely to be engaged in their work 20. Maintaining Friendships through Social Media

  • ambient intimacy
    • being able to keep in touch with people with a level of regularity and intimacy that you wouldnt usually have access to
    • Leisa Reichert
    • http://www.disambiguity.com/ambient-intimacy/
    • http://www.slideshare.net/leisa/ambient-intimacy
  • continuous partial friendship
    • David Weinberger
    • http://www.hyperorg.com/backissues/joho-may04-07.html

21. Friendships through Social Media @ Work? @ 22. The Context, Content & Community Collage: A proactive display application Opening physical windows into onlinecontent in workplacecontexts to foster a greater sense ofcommunity 23. A New Generation of Proactive Displays

  • Goal: increase the sense of community in the workplace
  • Method: open windows in shared physical spacesinto the social media co-workers are creating
    • SituatedSocial Software (SiSoSo) [vs.MobileSocial Software (MoSoSo)]
  • Hypotheses
    • Adding a physical dimension of audience will promote greater social media usage
    • Social media sharing in the workplace will enhance personal relationships
    • Enhanced personal relationships will lead to more productive professional relationships
  • Challenges
    • Privacy / benefit tradeoff (usability vs. security)
    • Sustainable engagement (after novelty factor has worn off)
    • How to measure the impact? (measuring community, relationships)

24. Signup / Login 25. Select / Configure Module 26. Select Bluetooth Device(s) 27. Locations (mock-up) 28. Hardware & Software 29. Details

  • Location / proximity detection
    • Bluetooth sampling (MAC addresses, BT names)
    • Location server (separate component)
  • Priority queue management
    • New / old, near / far, 70/30
  • Display management
    • Firefox + Javascript
  • Flickr module
    • Ruby API
  • Remote administration
    • Process, power
  • Modular, flexible framework
    • Front-end (time / space sharing)
    • Back-end

30. 31. Flickr API 32. Interactions with / through the displays 33. Interactionswithdisplays 34. The Highest Rated Content (5 up votes) 35. Edge detection http://www.snopes.com/horrors/robbery/kidney.asp 36. Everything in moderation 37. Moderation: NSFW[ N otS afeF orW ork] 38. Moderation: SFW 39. 40. 41. 42. 43. Evaluation: interactions through displays

  • Context
    • 8 displays, deployed July 19, evaluated after 4 weeks
    • 75 full-time / part-time residents
    • 44 proactive display accounts (34 non-empty)
    • Perpetual alpha (location sensing, new modules, new features)
  • Hypotheses
    • Adding a physical dimension of audience will promote greater social media usage
    • Social media sharing in the workplace will enhance personal relationships
    • Enhanced personal relationships will lead to more productive professional relationships
  • Web-based Survey
    • Mix of multiple choice and open text questions
    • 32 responses

44. Positive / Negative Impact (Personal / Professional) 45. A few choice comments

  • I was surprised by some of the photos taken by [a colleague]. I had no idea of his very diversified and, in some cases, adventurous interests, and his photos showed me a side of him I would have never realized. The photos also give you an appreciation of other people's interests and unique travels. I find the photos absolutely fascinating and a very strong method of bringing all of us closer.
  • I[t] was nice to see people putting up "themes". One person had a Star Wars theme, actually happening just by tags, but appeared to me as if a themed series of photos.
  • Somewhat negative: I was surprised to see a photo of my family (my husband and my two kids) with another female friend. They were all sprawled on the grass. It reminded me of a picnic we all had together. But it also made me self-conscious: what would other people think of seeing this scene. Who is the "mystery lady"? Positive: walking into the kitchen and spotting my daughter's happy face on the screen. It was a nice greeting! Positive: I am delighted to see other peoples pics of exotic places they visited. Negative: seeing a picture of a guy in his underwear. The face was not in the pics so I couldn't tell who it is. Somebody esle in the room "killed" the photo. Positive: seeing people cluster around displays. I like that!

46. Impact of Displays on Social Media 47. Influence of Rank & Role 48. Influence of Team Membership 49. Influence of competition Wii Tournaments 50. Future Work: Algorithms

  • Location / Proximity detection
    • Near / far
    • Proxemics, biosemiotics
  • Priority queue management
    • People, streams
    • Recommender System
  • Module management
    • Space, time, displays

51. Future Work: Modules

  • Other sources of content
  • Other interaction modalities
  • Other dimensions of experience

52. Future Work: Interfaces & Interactivity

  • Interfaces
    • Signup page
    • Display interface
    • Administrator interface
  • Interactivity
    • Authentication
    • Phones
    • Touchscreens
    • Other?

53. Future Work: Replicability and Sustainability

  • Deployments
    • Nokia: NY, Dallas, Helsinki, LA
    • Academia: UMich, UMN, Stanford,
    • ?: Yahoo!, Flickr,
  • Mobiquitous Marketing(Mobile + Ubiquitous)
    • Holistic approach toengagement marketing
    • Co-promotional opportunities
    • Contextual advertising in physical world

54. Future Work @ Strands Labs Seattle New Content Sources (http://beta.strands.com) New Physical Spaces (third places) 55. Related Work: Commercial Awareness / Interactions at Events Digital Signage Captivate TV ClearChannel,et al. RippleTV 56. Related Work: OneKeyAway / MatchlinC

  • OneKeyAway
    • Singles mixers in LA / SF Bay area; since May 2004
  • Questionnaire:
    • 64 true-false questions about sex, religion, drug use, how you spend your spare time, etc
    • I just want to get people together and talk about relationships to discuss the questions, talk about their habits and personality traits.I think the device facilitates that. Edwin Duterte
  • MatchlinC: personality compatibility device
    • a mini relationship advisor
    • Infrared zapping
    • Three color codes (stoplight): red, amber, green)
  • Reminiscent of Lock & Key, Lovegety, Meme Tags

57. Related Work: partyStrands (1) New Years Eve Times Square, NYC Paul Van Dyk Crystal Ballroom, Portland Buda del Mar Bar Madrid http://www.partystrands.com http://blog.mystrands.com/category/partystrands 58. Related Work: partyStrands (2) 59. Related Work: Research (1)

  • Meme Tags (MIT)
    • Interpersonal display :display for other people
    • RF + LEDs + programming
  • CityWall (Helsinki IIT)
    • Multi-touch display in city center
    • Flickr photos tagged with helsinki
    • Interactions with display vs. through display
  • Twitterspaces (Indiana U)
    • Large display in campus lounge
    • Dynamic visualization of group tweets (Twitter)

60. Related Work: Research (2)

  • PlasmaPoster (FXPAL)
    • Interactive community bulletin board
    • Corporate, conference, caf contexts
  • Opinionizer (Sussex)
    • Shared display at social events
    • Interaction through typed input
  • Dynamo (Sussex)
    • High school setting
    • Interaction via USB disk
  • AgentSalon (ATR)
    • Interaction via PalmGuides (PDAs)
    • Conversations mediated by animated agents

Public and Situated Displays OHara, Perry, Churchill, Russell 61. Thanks!

  • For more information:
    • [email_address]
    • http://interrelativity.com/joe
    • http://gumption.typepad.com
    • http://www.slideshare.net/gumption
  • C4 made possible by
    • Ben Congleton (U. Mich), Max Harper (U. Minn)
    • Nokia Context, Content & Community (C3) team
    • All my former colleagues at Nokia
  • Future work being made possible by Strands [Labs [Seattle]]

Yogi Patel Sameer Ahuja Shelly Farnham Richie Hazlewood 62. Backup 63. Related Work: Alone Together Two Hours of Joint Solitude http://www.coffeegeek.com/opinions/cafestage/10-19-2005 Alone Together http://blogs.parc.com/playon/ 64. Related Work: Addictive Games

  • Amy Jo Kim, Social Architect, Shufflebrain
  • Putting the Fun in Functional: Applying Game Mechanics to Functional Software
  • Incentives for games, communities
    • Collecting
    • Points
    • Feedback
    • Exchanges
    • Customization

http://www.shufflebrain.com/etech2007.html 65. Early proactive displays Dangling String (PARC) Bus Mobile (UC Berkeley) 66. Proactive Displays in the large Sunset @ 200MHz (PARC) Love Board (Hachiko Crossing) 67. Proactive Displays on the road Alaris E-boards (www.alaris.net) 68. Proactive displays, circa 2054