http://Learning-Layers-eu

Learning Layers

Scaling up Technologies for Informal Learning in SME Clusters

Making Sense of Bits and Pieces

Sebastian Dennerlein, Matthias Rella, Vladimir Tomberg, Dieter Theiler, Tamsin

Treasure-Jones, Micky Kerr, Tobias Ley, and Christoph Trattner

A Sensemaking Tool for Informal Workplace Learning

http://Learning-Layers-eu

• „Scaling up Technologies for Informal Learning” (Ley et al., 2014)

• Design-Based Research:

• Balanced an iterative development of :

• Bits & Pieces (B&P): one out of 4 design teams

Framework – EU-IP Learning Layers

(Tomberg et al., 2013) I’ll tell you more now ;)

http://Learning-Layers-eu

Design Problem

(Domain Understanding)

• Situation: Wealth of informal learning experiences in healthcare (e.g. putting guideline into practice)

• Problem: High time pressure prevents collection and connection of experiences

Evidence: Practice of Boxfile

• Result: Experiences are forgotten or traces lost on cluttered information bits and related chances for individual development are missed!

3

http://Learning-Layers-eu

Design Idea

4

more busy time more flexible working time Evernote

AchSo!

KnowBrain

B&P

http://Learning-Layers-eu

Theoretical Concept

• Eraut (2004): – Informal learning experiences stored in the episodic memory

– Need to be remembered and organized later on turn them into semantic memory

• We study these activities as a Sensemaking Process (Russell et al., 1993; Pirolli et al., 2005) two meta loops: – Information foraging &

– Organizing

• This perspective excludes the individual creation of ‘data’!

Understand Sensemaking in Informal Learning!

5

http://Learning-Layers-eu

Design Solution

6

http://Learning-Layers-eu

Study Design

7

• Field study in realistic setting

• Sample: 4 HC professionals – 2 diabetes specialist nurses

– 1 healthcare assistant

– 1 doctor

• Procedure: 2 phases

– Collection : gathering of informal learning experiences over 2 weeks in Evernote

– Sensemaking : remembering and making sense out of collected experiences in Bits and Pieces

http://Learning-Layers-eu

Evaluation

8

• Timeline Widget: – Reminds about past experiences , provides a view of things to work on

at a glance & indicates one’s own learning activity

– Time cues are working:

• ‘That’s the card sort photo, I remember that [. . . ]. Just check I’ve remembered all the things I thought about last time.’

– Necessity of re-evaluating bits:

• ‘[D]o I still need this? If I do need this, what am I going to do with it?’

• ‘What you really need, is to be able to go back to something you’ve collected, go into it, read it and then [. . . ] make your own notes.’

http://Learning-Layers-eu

Evaluation

9

• Organizing Widget: – Interactive nature of sensemaking via the organizing and categorizing

of bits into circles was valued

– Example for successful sensemaking effort by grouping experiences on diabetes treatment according to their influence on blood pressure:

• ‘[P]eople’s blood sugar levels have gone down through exercise as opposed to diet’.

– Demand to make the transition of pieces of information from the timeline to the organizing view permanent:

• ‘[T]hey’re on the timeline [. . . ] so I know now that I have to [. . . ] read them[. T]hen once I’ve read them, put them into whichever category [. . . ,] I would have thought to take that off the timeline means then that’s finished.’

http://Learning-Layers-eu

Conclusion

• Initial support for the effectiveness of B&P for supporting – retrieval and foraging traces for informal learning experiences via

timeline

– relating experiences to each other and making sense out of them via venn diagrams

• First evidence for a re-evaluation step as part of the sensemaking process

Need of possibility to remember and make sense out informal learning

experiences traced in cluttered bits and pieces

Need to understand sensemaking in informal learning

Need for ‘Bits and Pieces’! ;)

10

http://Learning-Layers-eu

Outlook

• Further theoretical refinement of this view on sensemaking of informal learning experiences

• Extend design solution to include additional widgets and cover collaboration

11

http://Learning-Layers-eu

References

• Eraut, M. (2004). Informal learning in the workplace. Studies in Continuing Education 26(2), 247–273

• Ley, T., Cook, J., Dennerlein, S., Kravcik, M., Kunzmann, C., Pata, K., Purma, J., Sandars, J., Santos, P., Schmidt, A., Al-Smadi, M. & Trattner, C. (2014). Scaling informal learning at the workplace: A model and four designs from a large‐scale design‐based research effort. British Journal of Educational Technology.

• Pirolli, P. & Card, S. (2005). The Sensemaking Process and Leverage Points for Analyst Technology as Identified Through Cognitive Task Analysis. In: Proceedings of International Conference on Intelligence Analysis

• Tomberg, V., Al-Smadi, M., Treaure-Jones, T. & Ley, T. (2013). A Sense Making Interface for Doctors’ Learning at Work: A Co-Design Study Using a Paper Prototype. ECTEL meets ECSCW 2013: Workshop on Collaborative Technologies for Working and Learning.

• Russell, D.M., Stefik, M.J., Pirolli, P. & Card, S.K. (1993). The cost structure of sensemaking. In: Proceedings of the SIGCHI conference on Human factors in computing systems, 269–276.

12

http://Learning-Layers-eu

Thanks for your attention!

sdennerlein@know-center.at twitter: @SDennerlein linkedin researchgate

More information: Open Dev Library: developer.learning-layers.eu

Open Design Library: odl.learning-layers.eu