Knowledge Science & Engineering Institute, Beijing Normal University, http://ksei.bnu.edu.cn

Analyzing Transcripts of Online Asynchronous Discussion Groups with VINCAYanyan Li

Knowledge Science & Engineering Institute, School of Education Technology,Beijing Normal Universityliyy1114@gmail.com

Knowledge Science & Engineering Institute, Beijing Normal University, http://ksei.bnu.edu.cn

Outline

Existing tools VINCA introduction Further development

Knowledge Science & Engineering Institute, Beijing Normal University, http://ksei.bnu.edu.cn

Existing Tools

Annotation aids Nvivo (http://www.qsrinternational.com/) Atlas-ti (http://www.atlasti.de).

Dictionary-based content analysis CATPAC LIWC (http://www.erlbaum.com)

Development environments Profiler Plus DIMAP (http://www.clres.com)

Knowledge Science & Engineering Institute, Beijing Normal University, http://ksei.bnu.edu.cn

Shortcomings of the tools

Not integrated Coding process is largely manual Not learnable Display coding results in text or tables Lack of freestanding content analysis

packages incorporating text mining.

Knowledge Science & Engineering Institute, Beijing Normal University, http://ksei.bnu.edu.cn

Our goal

Can we design and implement an integrated tool to assist identifying features of interaction and provide feedbacks to facilitate the collaboration in CSCL?

Knowledge Science & Engineering Institute, Beijing Normal University, http://ksei.bnu.edu.cn

Implementing a Tool to Support Discussion Transcripts Analysis

Knowledge Science & Engineering Institute, Beijing Normal University, http://ksei.bnu.edu.cn

Multidimensional Analysis

How do the students talking with others? What are the students talking about? Who are talking to whom?

Process Pattern

SpeechTopics

MemberRelationship

Interaction Discourse

Keywords in context

Semi-auto Coding

Statistics for Social Network Analysis

Knowledge Science & Engineering Institute, Beijing Normal University, http://ksei.bnu.edu.cn

Tool Design Framework

Knowledge Science & Engineering Institute, Beijing Normal University, http://ksei.bnu.edu.cn

Vinca ‘s Features

Learnable semi-automatic coding support Analyze text in Chinese (traditional and

simplified) Utilize computational language & text mining

technologies Support assessing for CKBUnderlying technologies

Syntax analysis Domain ontology Association rules mining

Knowledge Science & Engineering Institute, Beijing Normal University, http://ksei.bnu.edu.cn

1) Data preparation

Data preparation to convert Knowledge Forum (KF platform) discourse in html to database format From Version 3.4 From Version 4.5

Knowledge Science & Engineering Institute, Beijing Normal University, http://ksei.bnu.edu.cn

2) Annotation Aids

Edit Coding Scheme New, Modify, Delete

Associate feature keywords to specific codes

Annotation Support segment & merge *Automatic discover the code hint, highlight it and

attach possible codes with confidence probability. During the process of coding, users are allowed to

select the hint to mark the final coding. View Coding Result

Suggested codes

Knowledge Science & Engineering Institute, Beijing Normal University, http://ksei.bnu.edu.cn

3) Text Analysis

Keywords retrieval & frequency counting Concordance *Discourse pattern discovery *Category analysis

Similarity Computation *Text clustering Ontology-based assessing for CKB

Knowledge Science & Engineering Institute, Beijing Normal University, http://ksei.bnu.edu.cn

Word Frequency (Keywords Retrieval)

Select Data From KF From Speech File From Single Text File

Exclusive List Special Common

Tag Filter Picked List Find Keywords in Word List Export Keywords & User Keywords Distribution

Import user’s lexicon

Select exclusive list

Select the words with specified

tags

Knowledge Science & Engineering Institute, Beijing Normal University, http://ksei.bnu.edu.cn 14

Concordance

List of extracted keywords

Concordance

Knowledge Science & Engineering Institute, Beijing Normal University, http://ksei.bnu.edu.cn

Check the original text

Knowledge Science & Engineering Institute, Beijing Normal University, http://ksei.bnu.edu.cn

Discourse Pattern Discovery

Pattern configuration interface

Frequent pattern mining results

Knowledge Science & Engineering Institute, Beijing Normal University, http://ksei.bnu.edu.cn

Category Analysis

Open Category File Search Para Synonyms in Interaction Text

Based on Similarity Computation Category List

Lexicon specified by tutors and auto-found synonyms

Knowledge Science & Engineering Institute, Beijing Normal University, http://ksei.bnu.edu.cn

Text Clustering

Select Data.. Get Keywords.. Set Option Export Result of Text Clustering

Knowledge Science & Engineering Institute, Beijing Normal University, http://ksei.bnu.edu.cn 19

Assessing for CKBGroup

Performance

Member Contribution

Topic similarity between members

Domain ontology

Knowledge Science & Engineering Institute, Beijing Normal University, http://ksei.bnu.edu.cn

4) Data Export for SNA

Export KF Data Export Relation Matrix Export Coding Result Export Coding Matrix Export Coding Frequency

Knowledge Science & Engineering Institute, Beijing Normal University, http://ksei.bnu.edu.cn

Annotation aids Semi-automatic coding with enhanced precision

Text analysis Category analysis for topic recognition Discourse Pattern discovery

Visualization Topic space Social network

Further Development

Knowledge Science & Engineering Institute, Beijing Normal University, http://ksei.bnu.edu.cn

Thanks!Welcome Questions and Comments