INTER-NET OFTHINGS- about how media industries can benefit from a network of connected things

a pocket guide from Media Evolution

This publication is published by the media cluster Me-dia Evolution. We are working to boost growth in the media industries in southern Sweden. One of our key areas is gathering intelligence to monitor what’s going on in the media industries across the globe. We take that information and use it to highlight opportunities and business models that our members, and media in-dustries in general, can exploit and develop.

www.mediaevolution.se

Media Evolution

When the world’s major telecom companies are vying to outdo each

other in predicting how many connected devices we will have around us in the fu-ture — the head of Ericsson believes it will be 50 billion by 2020 — we can safely say there is much that will be connected.

In this publication we will look into what opportunities there are for the media in-dustries to take advantage of the Internet of Things.

Miranda Edner at IBM writes about how their technology can be used by media producers, David Cuartielles, a founder of the open hardware platform Arduino, ex-plains how to use it and Dennis Rosinder from Magisty writes about the data that are already available on which services can be built.

INTRO by Media Evolution

4 A network of connected devices 6 Imagining an Internet of Things 8 The music of Traffic Lights – how would that sound? 10 Collaboration allows us to work with the new material 12 Arduino in the Internet of Things 14 Today, utility, tomorrow fun 16 Telcos provide the connectivity 18 Internet of Things creates A Smarter Planet 20 Ability to create stories in time and space 22 Glossary

“the head of Ericsson believes there will be 50 billion connected things by 2020”

An opportunity for the media industries

Internet of ThingsFebruary 2012

Publisher: Media EvolutionEditors: Caroline Lantau, Sara Ponnert och Martin Thörnkvistmartin@mediaevolution.seDesign: You Us and Them

WHAT by Martin Thörnkvist

A network of connected devices

The Internet of Things is not a vision of the future, it’s happening. In particular, it’s happening in industrial

sectors where the need for efficiency is high.

The idea is to link together various sensor systems so they can talk to each other in order to save time, money, and the environment by keeping better track of where things are.

We’ve been connected to the internet for over a decade. With sensors (especially GPS) linked to us to a greater ex-tent, we are now also thoroughly connected (at least on the jogging path and on the road). Quite a few years ago we learned that things around us will also be connected, in the context of well-stocked shelves in the refrigerator.

Since all the hype about the connected refrigerator, the complexity level has risen and opportunities are starting to arise for those of us working with media production, marketing and visualization.

Media and the Internet of ThingsWith sensors everywhere, we will be able to make more informed decisions that will enable us to become more ef-fective. But the big question for those of us who create the media is how to use all these connected sensors.

The question is, where does media content fit into this equation? Text, video, audio, and games? What role will it play? Is our knowledge the piece of the puzzle that makes the technology utilitarian, providing the impetus for the Internet of Things to finally take off for real?

The major IT companies are investing in building in-

Martin Thörnkvist

frastructure – an excellent signal for us that it’s time to start thinking about what the network of interconnected things will trigger and what things will be triggered by the media.

Interfaces between us and thingsThe Internet of Things is essentially about things that are connected, but it is just as much about the interfaces between the connected things and people. Right now, the spotlight is on technologies like NFC, RFID and QR codes in this context.

For the media industries, however, I believe that the deve-lopment of screens will be the key. Ultimately, we’ll have screens everywhere that can display the media we create, using the interfaces we are developing. In most cases me-dia is being looked at: movies, games, television, literature.

Connected screens everywhere, may be what makes media and the Internet of Things a really interesting combina-tion.

If we assume that every surface is a connected display the opportunities for the media industries become easier to understand and the potential for clear-sighted future sce-narios increases.

When the Prime Minister of China is talking about the In-ternet of Things, it’s time for the media industries to do the same.

“If we assume that every surface is an online display, the Internet of Things connection and the media become ea-sier to understand.”

Martin Thörnkvist is a business intelligence analyst at Media Evolution.

Have you tried to surf the Internet of Things? Have you seen the new user interface they made for it? Me

neither. Or perhaps we have but didn’t realise it? We have had ’things’ for ages, and recently almost everyone have gotten used to the Internet, but it’s a bit difficult to pin-point exactly what they become when mixed together. Not to mention how to actually use it? Would you ”browse” it? Will there be ”apps”?

There is a built-in pedagogical design challenge in the Internet of Things. At Ericsson’s User Experience Lab we interviewed people about their understanding of net-worked technology and found that most people seem to have a very weak understanding of the “networkedness” of networked devices, meaning the invisible intangible inter-relationships between everything that is networked.

Understanding with design It seems like people understand the concept of “the net-work” as something that is a medium for many a-to-b connections and this is why they didn’t have any intuitive feeling for the network as a structure of simultaneous ma-ny-to-many interconnections. This puts the whole point, it’s relevance, meaning and potential value of an Internet of Things in a mental blind spot for the big masses of “nor-mal” internet and things users.

How can we then make people “get” the Internet of Things, from a user perspective? To make them see beyond all the single connections and give them a natural understanding of the sum of all the interconnections, i.e. the Network as such. Not to mention that they should also intuitively un-derstand how to use it.

WHAT by Joakim Formo

Imagining an Internet of Things

”Sociality as a core metaphor for the user interaction could solve the pro-blem since social re-lations is something that virtually all humans have an intuitive understan-ding of”

We got the idea that the key could be to substitute the mental model of the network as connections with a mental model bor-rowed from social networking. Sociality as a core metaphor for the user interaction could solve the problem since social rela-tions is something that virtually all humans have an intuitive understanding of, and thus could be a way to make users naturally aware of the ”networkedness” itself.

Social Web of ThingsSo we designed and built something that basically is a social network for connected objects and we called it the Social Web of Things. We tested it on people in different parts of the world and listened to what they said about it. What we found was that it really did help them to ”see” the network, intuitively and in a much more holistic way.

Immediately and almost without any explanation it be-came apparent to people that many very different things would be able to literally talk to each other, and to coope-rate in order to for example be more cost efficient and ener-gy aware. The key seems to be using the familiar and very human notion of ”friendship” rather than the much more technical ”connection”. Presenting the Internet of Things as if it is a social network proved to be very effective for making people understand the ”networkedness” which we believe is the true power of an Internet of Things.

Joakim Formo is Senior Researcher at the User Experience Lab at the research department of the global telecommunications com-pany Ericsson.

Social web of things.

It often takes time for new technologies to become a natural part of daily life. Players like IBM and Ericsson

create the premises for technology within the Internet of Things. But how can smaller players take advantage of the technology for which the large companies are laying the foundation?

We are the ones—service providers, media companies and innovators—who will play a major role in developing the true benefits, making the new technology useful and valuable. The idea of how “everything” in the future could be con-nected is staggering in terms of both public benefit and commercial benefit. We are still decades behind Hollywood’s futuristic scenarios, and we need to start so-mewhere, but where? The IoT, all things interconnected, needs to be accomplished gradually in order to achieve a healthy development.

Start with what we’ve gotBut do we really need to start from scratch? One idea is to start with what is available in our immediate environment. Cities contain tremendous amounts of data that are stored for statistical purposes, as well as the type of data collected in real time by various sensors located all over the city.

A typical example of how this openness can be used is www.dataSF.org – an initiative from the city of San Fran-cisco a few years ago. They made the majority of public data available to the citizens, including data and informa-tion on tourism, transportation, police, parking, politics, the environment, civic studies, history, business, etc. Private individuals and companies could then develop

HOW by Dennis Rosinder

The music of Traffic Lights – how would that sound?

“all things intercon-nected needs to be accomplished gradually to achieve a healthy develop-ment”

web and mobile services for the benefit of citizens, businesses and visitors. Accessibi-lity combined with people’s mobile inter-net presence made it possible to achieve a completely new level of civic engagement and belonging. From that point new types of commercial, cultural and tourism servi-ces had the potential to be created.

Media and the Internet of ThingsIt is not hard to imagine the incredible pos-sibilities that can arise when creative urban minds have access to all this data. Perhaps curious businesspeople might reveal the city’s historical data archive and then in-volve the movie and gaming industry to create a historical experience through the city streets?

And wouldn’t it be great to be able to see, as soon as you enter the city limits, exactly which car park has a vacant place close to your final destination? What if the ar-tists created an LED art project from the city’s energy flows, or what would it sound like if a composer created street mu-sic from the traffic light signals at the base station?

So my questions are: which Swedish municipal commis-sioner will be the first to walk in Armstrong’s footsteps: one small step for man, a huge leap for mankind?

Dennis Rosinder, CEO of Magisty, which help companies to make contemporary technology useful.

When the traffic lights have their say.

flick

r.com

/eye

deaz

CC

BY-

NC

-SA

2.0

“The material we have to work with is complex in nature and I believe that in the future the ability to work across traditional industry boundaries will be invaluable.”

We media producers, programmers, scientists and ordinary users have new material to work with cal-

led the Internet of Things. This material is at the boun-dary between digital and analog, virtual and physical, and between private and public.

People have been talking about the Internet of Things as a technical infrastructure for a long time, but it’s getting to be time to think about the values we can create using this infrastructure.

This new material is often created without us having to make an effort. It’s already easy to create and have access to data about how you move about the city without ma-nually entering data in a spreadsheet. Open application programming interfaces allow you to create services and products based on publicly available data.

Applications for the materialThere are already many examples of applications ba-sed on the new material: apps that automatically send reimbursement claims when your train is delayed, art installations that illustrate how to translate the number of bicycles passing by into dollars, gasoline or carbon di-oxide; washing machines that start when the electricity price is lowest, a home that talks to you through social media channels or a car that automatically makes an ap-pointment at the garage when it’s time for an oil change.

From the examples above, we can conclude that we have a long way to go when it comes to developing applica-tions that are actually useful for people. The material we have to work with is complex in nature and I believe that

HOW by Richard Topgaard

Collaboration allows us to work with the new material

in the future the ability to work across traditional industry boundaries will be invaluable.

What happens, for example, if we let aut-hors and poets work with interaction de-signers and publishers to create digital poetry?

The result may be I Am Poem, a poetry machine that draws its material from the millions of tweets that people, bots and sensors are churning out every day. I Am Poem took shape partly on a website, but also as a hacked label printer and a lever that could “control the speed of the inter-net”.

If we allow many skills to work together, I think we will look back in ten years and wonder why we thought the Internet of Things was so difficult to understand.

If we start focusing on human needs and what these needs look like in different types of environments—pu-blic spaces, at home, at a concert or on public transporta-tion—then we will be able to create services and products that not only help us with daily chores, but also make us laugh and cry.

Svet

lana

Suv

orin

a

Richard Topgaard is a media strategist and developer at Malmö University’s research center for collaborative media, Medea.

Printed stream from Pär Thörns poem “I am”.

Back in the 80’s, scientists imagined a world where we would be surrounded by a multiplicity of computers.

Nowadays, any home appliance is using microcontrollers more powerful than some of the first personal computers. There are so many computers surrounding us, that if all of them had a screen and a keyboard, it would be impos-sible for us to interact with them.

The Internet of Things (IoT) adds one extra degree of complexity to this equa-tion. It brings to our attention that those computers are not living in isolation, they talk to other computers through the inter-net. Connecting to the net opens up for a world of possibilities where products and services come in bundles offering functio-nalities we never dreamed of.

The IoT deals with simplifying the way we generate and consume information that is sensitive to be shared online. The issue is then how to create objects that will help designers thinking about new devices.

An open source hardware platformArduino is an open platform with a whole series of docu-mentation that allows doing just that: creating new con-nected devices that will serve or collect data in ways that are more meaningful to us. It addresses the fact that you don’t need to be an engineer to envision a new product.

In 2005 our platform was used by industrial designers to implement visions of future devices. Back then we didn’t

HOW by David Cuartielles

Arduino in the Internet of Things

David Cuartielles

ambition it to leave the university labs or to be used by a broader audience.

Nowadays it can be found at retail stores like Radioshack in the US or Kjell&Co in Sweden. It is manufactured by tens of thousands each month. Students use it when bringing their ideas to life, hobbyist spend time building new concepts out of them, engineers study its develop-ment at universities, companies like Apple ask for cv’s of people with ”Arduino knowledge”. It is being cloned at a ratio of one copy for each original board.

Use around the worldWe are crafting collaborations with companies dedicated to the internet as a business model. In May 2011, Google launched their accessory development kit based on one of the Arduino designs. In February 2012 Telefonica an-nounced Arduino’s official M2M (machine-to-machine) board to allow the ”long tail” of the communication bu-siness building connected objects including reasonable data-plans attached to them.

Arduino has grown beyond expectations and we keep on getting amazed by projects like the one of Sebastian, a 14 year old Chilean teen that managed to get over 30.000 followers on Twitter thanks to an Arduino machine he designed that would post a message when detecting an earthquake. Arduino is a tool to bring us a little closer to a more connected world.

“Connecting to the net opens up for a world of possibili-ties where products and services come in bundles offering functionalities we never dreamed of.”

David Cuartielles founded Arduino five years ago together with an international team and is a researcher at Malmö University.

Why should a device be connected to the internet, really; what is the purpose and what is driving this

trend? Basically, the idea is that if we can get devices to talk directly with each other, we should be able to deve-lop new services that improve our daily lives, create new business, or maybe even raise the entertainment industry to new heights.

Already today, applications are being developed for use in the car, with both utility functions and entertainment features. Homes are getting smarter, particularly from an energy perspective. Televisions are disappearing, to be re-placed by the media hub: the computer-games console-TV-radio are merging with the private media collection; photo albums, home movies and music collection are being inte-grated into one.

But information flows today are by no means connected in a simple manner. Information has to meet somewhere in order to be refined and then generate new intelligent solutions. Service providers will drive developmentBased on developments in recent years, we can conclude that service providers, not communications providers, had the solutions. They did so simply by developing services that are not dependent on communication channels and instead developing services from a user perspective: Sky-pe, Spotify, 100Koll, or any service in a mobile that works as long as there is internet connection.

Already now, it seems like we more or less deliberately al-low these “services” to share information. Information from

WHAT by Robert Bellwaldius

Today, utility, tomorrow fun

“We should be able to develop new ser-vices that improve our daily lives, cre-ate new business or maybe even raise the entertainment indus-try to new heights.”

the music service tells Facebook friends what music I play, while the professional networking site receives information from the travel service that I am taking a trip to London. Meanwhile, my energy consumption drops and notifies the contest service along with all the other contest participants that I’m about to win the energy saving contest.

Visions for filmmakersConsider the filmmaker who can not only display video and audio at home. Add the dimension of smell; clearly there will be a gadget that can generate different types of scents. Obviously, film should be able to au-tomatically generate the right experiences in terms of scents.

Personally, I think film should be expe-rienced in a dark atmosphere; it’s not un-reasonable to let the filmmaker take advan-tage of the opportunity to turn off all the lights in my living room. Or perhaps the cinematic experience should be comple-mented with light in room, controlled by the film’s story-line. Lightning flashes across the movie screen; why not a weak echo in my environment, too?

Of course it could work; “smart” lamps are already avai-lable, it just has to be controlled from a movie. Who will be first to provide me with this next generation film expe-rience?

“Lightning flashes across the movie screen; why not a weak echo in my environment, too?”

Robert Bellwaldius is COO at Maingate, which provides solu-tions using M2M communication.

A greater film experience.

flick

r.com

/mgo

ulet

CC

BY-

ND

2.0

WHY by Javier Zorzano

It can be considered that in developed countries a practical totality of consumers own a mobile phone

and nearly all computers have an Internet connection.

For the worlds Telecommunication providers (the Tel-cos), this is a notable achievement, but also a considera-ble challenge. User base will not grow, meaning bigger revenues will not be generated in the way it used to. Furthermore, market forces drive revenues and margins down.

Global roamingThe Internet of Things opens up a dif-ferent landscape. On the one hand and as Robert Louis Stevenson’s verse says: ”The world is so full of a number of things, I’m sure we should all be as happy as kings.” In an IoT-world the numbers managed are simply overwhelming. It may take generations to fully connect the physical world.On the other hand, providing this con-nectivity is something Telcos do natu-rally, without reinventing themselves.

Telcos have the scale, the technology and the processes to connect anything, anywhere in the world to the Internet. 2G or 3G networks cover pervasively most of the world’s surface. Satellites reach even the remotest locations. Th-rough Telcos networks Internet connected Things can run out of the box, seamlessly, with no configuration by the owner.

Telcos provide the connectivity

“Telcos have the scale, the technology and the processes to connect anything, anywhere in the world to the Inter-net.”

flick

r.com

/dea

dair

CC

BY-

NC

-SA

2.0

A wired world.

New kinds of interactionKeyboards and screens have been our interface to the Internet and its content for a long time. Internet con-tent and services lie in a separate world, the cyberspace, that people sporadically view through a ever-shrinking glass.

The Internet of Things allows creators to provide Inter-net interaction through any kind of physical object. It is especially interesting considering the common objects we use every day as a part of this interface.

On the one hand common objects have simpler interfa-ces, with reduced expressivity. This is a problem.But, on the other hand, these objects fit human tasks and accompany them silently through their lives. Besides, human beings interact strongly with objects, putting lots of feelings into them.

So, physical objects give new chances to media com-panies. People will receive or interact with content th-rough their environment, in a completely immersive experience. Creators will be able to coordinate different interfaces, such as sensors, tools, furniture, screens and, of course, web pages or mobile apps.

Of course creators will have to imagine new content structures that fit this new scenario. The challenge is huge but the tools are there and the prize is a fully new world.

Javier Zorzano, Physical Internet Lab at Telefónica Digital

“The Internet of Things allows creators to provide Internet interaction through any kind of physical object.”

At IBM, we have our own name for the The Internet of Things – A ‘Smarter Planet’ ibm.com/smarterplanet.

The initiative can be summarized by the words Intercon-nected, Intelligent and Instrumented. It involves how we can use sensors placed out in our world and that commu-nicate with each other, or with data centers, which in turn compile and use the information from the sensors to create better grounds for decision making.

Not being on board is not an optionSo why do we want to create a smarter planet, why now? Because that’s where the world is headed. Because the possibilities are there, the sensors are deployed and pe-ople and things are constantly connected and can com-municate data to smart analytics systems. Because we will need to take advantage of the opportunities to optimize the systems from an overall perspective that the Internet of Things offers, in order to meet the challenges of the next century.

Climate change, the financial crisis, growing conflict hot-beds around the world and unevenly distributed resour-ces. Thanks to intelligent smarter systems that optimize transport systems, disease diagnosis, law enforcement control and supply chains, we can reduce the equivalent corresponding amount of greenhouse gases, medical ex-penses, crime and wasted resources.

In Denmark, IBM is participating in a research project on Bornholm involving smarter grids, allowing for a cycle flow of electricity in both directions between wind turbines, electric cars and homes, to charge in one direction when the wind blows and the other on calm days when it doesn’t.

WHY by Miranda Edner

Internet of Things creates A Smarter Planet

“For the media and experience indus-tries, the opportuni-ties are enormous”

The islanders inhabitants of the island will also have ac-cess to a web interface where they can monitor the avai-lability and price of electricity in real time to decide what time of day they prefer to charge their cars.

Unimaginable opportunities for mediaThe opportunities for the media and experience indu-stries are enormous. With the recent boom in smartpho-nes and the fact that there will be an estimated 15 billion (twice the world population!) more mobile phones in the next four years, it is easy to see how mobiles will change the game.

I envision a future reminiscent of something like the sce-ne in Minority Report, where Tom Cruise enters a store and a digital shop assistant asks him how he liked his last suit and gives him a recommendation on what could be appropriate for him the next time.

Although we don’t use the iris of our eyes as a sensor, or eye scanning as a method of position measurement, smart phones offer us a good way to reach out with spe-cific messages that the outside surrounding world wants to give us when we move pass by strategically placed sensors.

I’m waiting curiously to see how the media and entertain-ment industries chooses to implement these capabilities in the near future.

Miranda Edner, customer account manager at IBM for custom-ers in the retail, wholesale and consumer product industries.

Miranda Edner

The Internet of Things could be constructed so that things become ”bridges” that enable people to come

into contact with each other and understand their envi-ronment in new ways. Imagine you are in a square and you can talk not only with the people there, but also with the fountain, sculptures, benches, and pigeons. What can they say to you? What can you say to them? Who else has talked to them before? What have they said?

The bench would be able to convey thoughts, impressions, and stories from everyone who ever sat on it. The pigeons could tell about where they prefer to sleep and about what is in the air you breathe.

Bridge between local and digitalWith an Internet of Things that has be-come as natural as texting is today, we can expect a completely different accessibility and response from and through the phy-sical environment. The boundary between local and nonlocal (digital) is erased, at the same time that places become deeply meaningful.

A fantasy landscape in the midst of daily life. Inspiration can be taken from geocaching, which is based on ente-ring GPS coordinates where a “treasure” is hidden. Then you have to get there.

Participants interact with a digital space, but what really happens is that they discover and explore real locations and the path that leads to them. If they could talk to all manner of things along the way—and find out what ideas,

WHAT by Per Johansson

Ability to create stories in time and space

flick

r.com

/wili

CC

BY-

NC

2.0

A place full of stories.

“An essential task for the media savvy will be to make this complexity transpar-ent and relevant”

information, pictures others left behind here and there—then the entire physical space could convey an ongoing, more vibrant account of life in the here and now, alt-hough, paradoxically, without physical limitations. End-less games and potential meetings could be constructed as needed.

Making sense of large amounts of dataMeaningful experience is intimately linked to stories. The sum of all the data constantly generated, most of it beyond anyone’s consciousness, can in turn be harvested and illustrated in countless ways, both useful and useless, humorous and serious.

Different time dimensions gain a new, immediate signifi-cance. Each place, each thing has a future and a history and a series of simultaneous relationships. Enhancing accessibility for all this can raise awareness about what is going on and what we are doing. History can literally be created and recreated on site and in a way that both deepens and broadens the sense of presence. And both intentional and unintentional patterns can be visualized through different interfaces.

As more things are actively included in communicating networks, complexity will increase exponentially. An es-sential task for the media savvy will be to make this com-plexity transparent and relevant in a way that strengthens human benefit and inspires a sense of participation.

Per Johansson runs his own company, Diakrino, and is co-found-er of the think tank Infontology.

CONTEMPORARY BUZZWORDS by Media Evolution

Glossary

ArduinoArduino is an open-source electronics prototyping plat-form based on flexible, easy-to-use hardware and soft-ware. It’s intended for artists, designers, hobbyists, and anyone interested in creating interactive objects or en-vironments.

IoT – Internet of ThingsA concept coined by Kevin Ashton in 1999. It refers to things and sensors that can be identified as unique items that are interconnected in a web-like structure.

M2M – Machine-to-MachineA generic term for technologies that allow communica-tion between devices.

NFC – Near Field CommunicationA technology for wireless data exchange over short dis-tances. The standard is a further development of RFID and unlike its predecessor, allows two-way communica-tion between devices.

This publication comprises texts previously published at www.mediaevolution.se. The idea is to repackage our regular analysis as focused in-depth looks at areas that we think the media industries need to understand a little bit better.

We release four publications annually. At our web site you can download or order mail copies of previous and future editions.

Internet of Things is published under the Creative Commons licence by-nc-sa. Read more at creativecommons.se

About this publicationContact Media Evolutioninfo@mediaevolution.se0706-37 28 47 (Pernilla Lavesson)

Media EvolutionAnckargripsgatan 3211 19 MalmöSwedenmediaevolution.se

twitter.com/mediaevfacebook.com/mediaevolution

www.mediaevolution.se