Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction...
-
date post
21-Dec-2015 -
Category
Documents
-
view
215 -
download
0
Transcript of Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction...
![Page 1: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/1.jpg)
Methodologies
Setting up a Study
![Page 2: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/2.jpg)
Review
Problem Statement Problem Originality Direction Significance
Literature Review & Theoretical Framework Logical Structure Research Questions Population Sampling
![Page 3: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/3.jpg)
Methodologies
Specific systems/ tools/ approaches to gathering and analyzing data.
Structure of the research Builds on and draws from previous sections:
problem statement, research questions, literature review, theoretical framework
Influences analysis How to choose an appropriate method?
![Page 4: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/4.jpg)
Methodologies: Options
Quantitative Numbers, statistics
Qualitative Words, narrative
Mixed Methods Both Quantitative and
Qualitative Triangulation
More than one method, may be two of the same type
![Page 5: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/5.jpg)
Methods: Options
Quantitative Qualitative Mixed
PredeterminedInstrument-based questionsPerformance data, attitude data, observational data, and census dataStatistical analysis
EmergingOpen-ended questionsInterview data, observation data, document data, and audiovisual dataText and image analysis
Predetermined and emergingOpen- and close-ended questionsMultiple forms of data Statistical and textual analysis
-Creswell, J.W.
![Page 6: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/6.jpg)
Methodologies: Options Quantitative
Surveys Structured Interviews Questionnaires Bibliometrics Transaction Log Analysis
Qualitative Case Studies No Contact
Examining Documents Citation Analysis Diaries
One-to-one Unstructured Interviews Think-Aloud Ethnographic methods Observations
Group Interaction Focus Groups Delphi Method Concept Mapping
![Page 7: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/7.jpg)
Quantitative: Bibliometrics
Quantitative study of literature Patterns of publishing within a field or body of
literature Quantitative study of information associated
with published works: authorship, publishers, citations
![Page 8: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/8.jpg)
Quantitative: Transaction Log Analysis Quantitative study of user behavior as
exhibited through computer logs Domains (.gov, .edu, .com) “Hits” Paths followed Time spent (searching, viewing, downloading) Errors Applications used
![Page 9: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/9.jpg)
Qualitative: Case Study
In-depth review of a single situation: program, process, phenomenon
![Page 10: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/10.jpg)
Qualitative: Examining Documents
Systematic review of text/ images: content analysis
Classifies textual or visual material Uses analytical constructs or rules to draw
inferences about recurring aspects of text.
![Page 11: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/11.jpg)
Types of Documents?
Policy Manuals Digital reference transcripts Comment/ complaint cards Job ads Published Literature Blogs, listserv postings, etc. Open-ended responses
![Page 12: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/12.jpg)
Evaluation Research
Published Books Journal articles Conference proceedings Theses/dissertations Web ALA. ACRL. CIP Notes CLIR.
www.clir.org/pubs/pubs.html ARL Other
Peer ReviewPeer Review
Unpublished Internal reports Local use only reports
![Page 13: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/13.jpg)
Qualitative Analysis: Examining Documents Focus on:
Word choice Word frequency Word sequence Intensity of feeling/ expression (how to
measure?) Key word in context
Typology of concepts/ categories?
![Page 14: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/14.jpg)
Example
Regional Accreditation Organizations’ Treatment of Information Literacy
![Page 15: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/15.jpg)
Qualitative Study: Citation Analysis
Systematic review of bibliographies/ references within published literature.
Focus on Authorship Form of publication (periodical, monograph,
etc.) Class of material (primary, secondary, etc.) Language Subject Currency
![Page 16: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/16.jpg)
Citation Analysis
What can citations tell us? How scholarly is the cited literature? How current are the citations? How research-oriented is it? How interdisciplinary is it? How writes the literature? How collaborative? Where does the literature appear?
![Page 17: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/17.jpg)
Citation Analysis
Growth of literature on a subject Dispersion of writings on a subject across
form and journals Obsolescence of literature Scholarly networks: who cites whom? Publishing productivity
![Page 18: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/18.jpg)
Citation Analysis
Advantages Shows what is cited Does not involve
interaction with subjects
Profiles a literature Shows changes in a
field over time?
Disadvantages How complete is the
work from which citations are drawn?
How accurate are citations?
Are all materials cited? Choosing easy to find/
retrieve items over better quality?
How easily retrievable are works?
![Page 19: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/19.jpg)
Citation Analysis: Issues
From where are citations drawn? How far can you generalize findings?
Does citation reflect use? Self-citations and/ or gratuitous citations Half-life Impact factor (to what extent are recent articles in
journals cited?) Calculated annually: divide the number of current
citations a journal receives to articles published in the previous two years by the number of articles published in those same years
![Page 20: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/20.jpg)
Web Citations
How “prestigious” are different online sources- ejournals, open access, etc.
References to and from a Web site Retrievability
![Page 21: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/21.jpg)
Qualitative Study: Diaries
Participants record activities, thoughts, reactions, etc. daily (weekly, etc.) over a set period of time.
Blogs- equivalent? When to use? Issues
How faithful are participants? How can you help ensure full participation?
How much guidance to give? Too much/ too little detail.
Advantages and disadvantages?
![Page 22: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/22.jpg)
Students’ World
Nicole Henning/ Photo Diary Study (MIT) 16 students tracked their information seeking
behavior for one week. Used diaries and screen shots to record their
thoughts and actions
![Page 23: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/23.jpg)
Qualitative Study: Interviews
Attempt to gain in-depth knowledge on a topic In a less structured format, interviewer may
act more as facilitator, asking open ended questions and drawing the participant out.
Structured, semi-structured, or unstructured? Format- in person, telephone, email?
![Page 24: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/24.jpg)
Interviews
Types of questions: Experience/ behavior Feeling Opinion/ value Knowledge Sensory Demographic
![Page 25: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/25.jpg)
Interviews
Issues Logistics Building trust Delicate questions/ situations- ensuring
honesty Accuracy of transcripts
Advantages and disadvantages? Appropriate uses?
![Page 26: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/26.jpg)
Qualitative Study: Think-Aloud
Asks respondent to verbalize their thoughts while performing an assigned activity or task
Attempt to gain more insight into thought processes
Correct for mistakes/ assumptions of observer
![Page 27: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/27.jpg)
Think Aloud
Requires participants that are highly verbal in nature
Adding this layer of feedback may affect their cognitive processes and behaviors- more “self-concious.”
How to transcribe while observing? Accuracy?
Appropriate use of clarifying questions? Appropriate uses?
![Page 28: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/28.jpg)
Qualitative Study: Ethnographic
Tools developed in the field of cultural anthropology
Attempt to better understand people/ behavior by observing it within natural setting
Can study observable material items, individual behaviors and performances, or ideas
Requires careful attention to detail within cultural context
![Page 29: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/29.jpg)
Ethnographic
Possible Tools: Observation in context Key informant interviewing Drawing pictures Taking photos Using maps to track activities Videotaping
![Page 30: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/30.jpg)
Ethnographic: Examples
Susan Gibbons and Nancy Fried Foster of University of Rochester: Understanding Users to Develop Better Library Services (ACRL/NEC 2006) User-centered studies of library use… Mapping Diaries Photo Elicitation Interviews
![Page 31: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/31.jpg)
Photo Elicitation
![Page 32: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/32.jpg)
Mapping Diaries
![Page 33: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/33.jpg)
Sweeping Studies
A type of spatial data analysis Useful for mapping out the physical spaces of
a library and investigating how people use those spaces
![Page 34: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/34.jpg)
Qualitative Study: Observation
Attempt to understand activities/ behaviors Obtrusive or Unobtrusive Role of the observer:
Complete observer Observer and participant Participant with individual being observed
![Page 35: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/35.jpg)
Qualitative Study: Focus Groups
Attempt to learn about the attitudes/ beliefs/ feelings of groups and how those influence behavior
Why groups? One individual’s comments can trigger important responses from others.
Can explore large ranges of topics
![Page 36: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/36.jpg)
Focus Groups
Issues How structured? Importance of facilitator’s role- how well
trained? Building trust Finding reliable representative volunteers Ensuring accuracy of transcription- audio/
video tape? Outside observation? Facilities
![Page 37: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/37.jpg)
Qualitative Study: Delphi Method
A “systematic interactive forecasting method.” Involves interviewing/ surveying of experts
within a field- generally 9 to 99 Experts are provided with hypotheses, trigger
statements, scenarios, etc. and asked to respond.
First round responses are shared with the group anonymously, so participants can revise earlier statements, react to responses.
![Page 38: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/38.jpg)
Delphi Method
After several rounds, hypotheses may be refined, group may reach “consensus”
Facilitator reviews responses to each round- can filter out irrelevant content, choose presentation of information, ask questions.
Advantages and disadvantages?
![Page 39: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/39.jpg)
Qualitative Study: Concept Mapping
“Any process that represents ideas in pictures of maps.”
A method of organizing the ideas and thoughts of a group to form a common framework
Can be used to integrate ideas from less structured activities such as brainstorming
![Page 40: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/40.jpg)
Concept Mapping
Typical steps: Focus: determine desired outcomes/ questions to be
addressed Generating ideas: Brainstorm, use trigger statements,
ask questions Analysis: Sort ideas into large sets
Unstructured idea sorting: ask individuals to sort ideas into groups and label
Sorting by stakeholders: organize ideas by group that generated those ideas
Ratings: assign values to ideas (importance, feasibility, etc.)
![Page 41: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/41.jpg)
Concept Mapping
Map analysis: generate map based on idea sorting (could use statistical software, or do by hand)
Interpret map: Share with other groups to obtain understanding
![Page 42: Methodologies Setting up a Study. Review Problem Statement Problem Originality Direction Significance Literature Review & Theoretical Framework Logical.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d6d5503460f94a4cd49/html5/thumbnails/42.jpg)
Example: IR and IL