3b5 oncept coded graphic symbol

download 3b5 oncept coded graphic symbol

of 17

  • date post

    26-Jan-2015
  • Category

    Education

  • view

    344
  • download

    1

Embed Size (px)

description

 

Transcript of 3b5 oncept coded graphic symbol

  • 1. Concept Coded Graphic Symbol support in OpenOffice.org from basic functionality to UI refinement for different user needsMats LundlvDART, Sahlgrenska Univ. HospitalGteborg, Sweden

2. Content:Graphic symbol support why within GIS ? and why in OpenOffice.org ?The foundation of the symbol support: Concept Coding and the Concept Coding Framework - CCFA brief presentation of the first alpha versionPreliminary results from the Pilot testing with users and expertsPlans for coming versionsConclusions and OutlookMats Lundlv, DART, Sahlgrenska Univ. Hospital, Gteborg, Sweden 3. Graphic symbol support why within GIS ? and why in OpenOffice.org ?GIS has the goal of contributing to the foundation of open and standardised infrastructures for general accessibility in ICT servicesGIS took the important decision to include the challenging needs of people with cognitive and communication impairments in this overall ambitionAccess to communication and language is the key to human development and participationMultimodal language support including graphic symbols is fundamental for this accessibility goalOpenOffice.org as a free and open source office suite of growing adoption is an ideal platform for the manifestation of a free stock component for graphic symbol supportBut ...Mats Lundlv, DART, Sahlgrenska Univ. Hospital, Gteborg, Sweden 4. The foundation of the symbolsupport: ... though strong motivations for language and graphic symbols support, this is not quite enough for inclusion in GIS:If we had just thrown in a couple of graphic symbol libraries and made symbols appear in documents based on quick fix solutions, this would not be sustainable even if looking impressiveLuckily we came into GIS with a suitable open technology foundation for multimodal and multilingual language support in the baggage: The Concept Coding Framework (CCF)*This makes the CCF based graphic symbol support manifested as an OO.org extension a natural and vital part of the GIS project* defined in the WWAAC project - www.wwaac.euMats Lundlv, DART, Sahlgrenska Univ. Hospital, Gteborg, Sweden 5. Concept Coding and theConcept Coding Framework - CCFMats Lundlv, DART, Sahlgrenska Univ. Hospital, Gteborg, Sweden 6. A brief presentation of the firstalpha versionScreen captures of the CCF Symbol Support Plugin 1st alpha version in action:Mats Lundlv, DART, Sahlgrenska Univ. Hospital, Gteborg, Sweden 7. A brief presentation of the firstalpha version (2)The Concept Coding Options menu :Mats Lundlv, DART, Sahlgrenska Univ. Hospital, Gteborg, Sweden 8. A brief presentation of the firstalpha version (3)Full Document Scanning & Multiple symbols options:Top: Full Document Scanning; On + Multiple Symbols; OffBottom: Full Document Scanning; Off + Multiple Symbols; OnMats Lundlv, DART, Sahlgrenska Univ. Hospital, Gteborg, Sweden 9. A brief presentation of the firstalpha version (4)Symbol representations and text language options:Left: English + ARASAAC (Bliss as second choice one chosen for English as no ARASAAC found)Right: Swedish + Bliss (ARASAAC as second option none chosen)Mats Lundlv, DART, Sahlgrenska Univ. Hospital, Gteborg, Sweden 10. Preliminary results from the Pilottesting with users and expertsMuch positive interest and reactions (among those familiar with this range of needs) to having this kind of functionality available in a standard office environment such as OpenOffice.org Writer.Not really functional for end-users at this point, but with a great potentialShould be made available in more environments on the web etc.Unsatisfactory insertion of symbol representations before the corresponding words should be above words and/or display outside the text and/or on demandUnsatisfactory frequency of erroneous symbol representationsNeed for the user to be able to conveniently see and choose between alternative concepts and symbol representationsUnsatisfactory slow symbol lookup speed should ideally be close to instantaneousThe obvious request for added natural language support from the Spanish and Belgian pilot test sitesRequest for added support for Sclera Pictos symbols from the Belgian participantsRequest for smooth interaction with text-to-speech synthesis reading supportMats Lundlv, DART, Sahlgrenska Univ. Hospital, Gteborg, Sweden 11. Preliminary results from the Pilottesting with users and experts (2)Swedish Users: For those familiar with symbols this feature was very interesting Bliss-users seemed to have the greatest benefit Users who didnt benefit themselves often mentioned other personsthey thought would use this. Several also thought - useful when reading English texts.Mats Lundlv, DART, Sahlgrenska Univ. Hospital, Gteborg, Sweden 12. Preliminary results from the Pilottesting with users and experts (3)Swedish Experts Focus Groups: Positive and even enthusiastic appreciation of the potential.(Only one individual without previous contact with the use of graphic symbolsupport was spontaneously unsure if useful) potentially useful for many kinds of users, including: Users with more general or specific cognitiveimpairments, AAC users, users with language development delays, some users with writing/readingdifficulties, and also more widely for early writing/reading acquisition and early 2nd language learning;Useful for reading comprehension support, support for early writing, graphic spell-checker, etc. On the other hand none of them thought that the extension is practically useful atthe current early stage Three major shortcomings: Insertion of symbols in the text inserted symbols should be placed above the wordsLacking handling of ambiguous and/or incorrect symbol representations - rate of incorrect suggested representations too high - there must be a user-friendly interface for inspecting symbol alternatives and selecting a desired onespeed of symbol look-up needs to be substantially faster also: easier access to settings neededMats Lundlv, DART, Sahlgrenska Univ. Hospital, Gteborg, Sweden 13. Plans for coming versions Preliminary revised design goals: Based on suggestions from the pilot testers and experts, as well as fromimplementation experiences, it is likely that the support for choosingbetween several available symbol representation options will be offeredwithin a side panel, supporting selection by pointing and clicking togetherwith keyboard navigation and selection see Preliminary design sketch (1). For users who primarily need temporary graphic symbol representationsupport while composing text, an option will possibly be offered to turn offthe symbol insertion, while still maintaining the display of matching symbolsin a side panel as of Preliminary design sketch (1). An alternative option is considered; providing on-demand symbol display onmouse-over of words in a text, that is; by pointing to words for whicha symbol representation display is desired primarily for readingcomprehension support see Preliminary design sketch (2).Mats Lundlv, DART, Sahlgrenska Univ. Hospital, Gteborg, Sweden 14. Preliminary reviseddesign sketch (1)Possible interface for display and selection of alternative conceptsand symbol representationsMats Lundlv, DART, Sahlgrenska Univ. Hospital, Gteborg, Sweden 15. Preliminary reviseddesign sketch (2) Tentative interface for on demand mouse-over display of concepts and symbol representations of wordsMats Lundlv, DART, Sahlgrenska Univ. Hospital, Gteborg, Sweden 16. Conclusions and Outlook It will be possible to provide a reasonably well functioning basic open sourcemultilingual and multimodal language support in the form of a free extensionfor concept coded graphic symbol representation of text within OpenOfficeWriter, possibly also within Impress and other applications of OO.org. The levels of refinement that may be achieved in disambiguation of languagemodality transformations and user interface and interaction support remain tobe further investigated, prototyped and tested. The further developed Concept Coding Framework technology will be madeavailable for application in other areas, first for AAC support on mobileplatforms within GIS, but hopefully soon in several external environments. The current state-of-the-art special needs and educational software withcorresponding functionality will not in any way be made redundant, but animportant complement may be provided, opening for wider application instandard open source as well as proprietary environments.Mats Lundlv, DART, Sahlgrenska Univ. Hospital, Gteborg, Sweden 17. Acknowledgements - References This work is partially funded by the EC FP7 projectGIS - Open Accessibility Everywhere: Groundwork, Infrastructure,Standards, Grant Agreement No. 224348.http://www.aegis-project.eu The WWAAC project: www.wwaac.eu CCF: www.conceptcoding.org The SYMBERED project: www.symbolnet.org Blissymbolics Communication International (BCI): www.blissymbolics.org ARASAAC pictografic symbols: www.catedu.es/arasaac/ Sclea Pictos: www.sclera.be Lundlv,M.;Farre,B.;Brnnstrm,A.;Nordberg,L. (2010) Open-Source Concept Coded Graphic Symbol support in OpenOffice.org.ETAPS FOSS-AMA March 2010 (www.slideshare.net/aegisproject/1-opensource-concept-coded-graphic-symbol-support-in-openofficeorg)Mats Lundlv, DART, Sahlgrenska Univ. Hospital, Gteborg, Sweden