September 2010 USER NEEDS IDENTIFICATION FOR CONTENT MODEL DEVELOPMENT OIDAP Quarterly Meeting...
-
Upload
britney-joseph -
Category
Documents
-
view
216 -
download
1
Transcript of September 2010 USER NEEDS IDENTIFICATION FOR CONTENT MODEL DEVELOPMENT OIDAP Quarterly Meeting...
September 2010
USER NEEDS IDENTIFICATION FOR USER NEEDS IDENTIFICATION FOR
CONTENT MODEL DEVELOPMENTCONTENT MODEL DEVELOPMENT
OIDAP Quarterly MeetingOIDAP Quarterly Meeting
Boston, MABoston, MA
Shirleen Roth Social Security Administration
Office of Program Development and Research
Presentation OverviewResearch Purpose and QuestionResearch ActivitiesMethodology for Identification of User Needs
for Content Model DevelopmentCompilation of sourcesSelection criteria for data elements,
dimensions, and data elements for research purposes
Methods for defining selectionsMethods for resolving differences in selections
September 2010 Social Security Administration 2
Presentation Overview (continued)
Methodology (continued)Process for documenting the selectionsAnalysis conducted by Project StaffExamples
Next Steps
September 2010 Social Security Administration 3
Research Purpose and Question
Research Purpose: The purpose of the occupational information system (OIS) project is to create an OIS tailored specifically for SSA’s disability programs and adjudicative needs.
Research Question: What occupational information does SSA need or desire in order to effectively adjudicate claims for disability benefits?What person-side data elements are critical to
assessing an individual’s residual functional capacity?What work-side dimensions are critical to assessing
an individual’s vocational profile?
September 2010 Social Security Administration 4
Research ActivitiesOccupational Information Development Advisory
Panel (Panel) ActivitiesPublic testimony and comments at quarterly
meetingsPanel investigationsContent Model and Classification Recommendations
for the Social Security Administration Occupational Information System (September 2009)
Findings Report: A Review of the National Academy of Sciences Report A Database for a Changing Economy: Review of the Occupational Information Network (O*NET) (June 2010)
September 2010 Social Security Administration 5
Research Activities (continued)Occupational Information System Development
Workgroup (Workgroup) ActivitiesInternal SSA Workgroup comprised of
representatives from stakeholder components within the agency Office of Disability Adjudication and Review (ODAR), Office of
Appellate Operations (Appeals Council) ODAR, Office of Chief Administrative Law Judge Office of Disability Determinations Office of Disability Programs Office of Program Development and Research Office of Quality Performance National Council of Disability Determination Directors
(NCDDD)
September 2010 Social Security Administration 6
Research Activities (continued)Workgroup Activities (continued)
Guidance and support to ensure that the OIS meets user needs and the requirements of SSA’s regulations
Assistance to Project Staff for OIS developmentOutreach to stakeholder components to obtain
input for development of OIS, including identification of user and other programmatic needs
Development of a list of data elements for the OIS that the Workgroup recommends for testing
September 2010 Social Security Administration 7
Research Activities (continued)Project Staff Activities
Support of Panel and Workgroup activitiesSSA User Needs Analysis (UNA)Federal register notices requesting public
comment on the Panel’s September 2009 report. Public comment period closed on June 30, 2010.
Project staff investigationsParticipation in and support of Workgroup
discussions toward development of a list of data elements for the OIS that the Workgroup recommends for testing
September 2010 Social Security Administration 8
Research Activities (continued)Project Staff Activities (continued)
Occupational-Medical Vocational Study of claimsSynthesis of input received from Panel, SSA
UNA, and public testimony/comments through June 30, 2010 Compiled list of all recommendations and comments Organized the list according to the Panel’s seven main
recommendations Added category of “Other” to capture those comments
not related to the seven recommendations
September 2010 Social Security Administration 9
Research Activities (continued)Project Staff Activities (continued)
Synthesis (continued) Established criteria for compiling list of
ideas/comments Combined identical ideas/comments into one item
that noted all groups in support of that item/comment
Did not combine those ideas/comments that were different, even if difference was only slight
For results of survey received from one stakeholder organization, included those data elements that were recommended by 50% or more of respondents
September 2010 Social Security Administration 10
Sample Synthesis Page
September 2010 Social Security Administration 11
Comment Commenter Cross-
Reference Staff Action
Fingering OIDAP; NADE; IARP; APTA
Need information on what’s being picked up. For example, a coin or button
UNA; NCDDD
Finger dexterity required UNA Other term used: fine manipulation, fingering, picking, pinching
UNA
Does the job require them to type UNA Finger dexterity (ability to move the fingers and manipulate small objects with the fingers rapidly or accurately)
APTA
Measure by attitude/skill APTA Make a distinction between fingering and fine fingering ABVE
Gripping (simple, forceful) OIDAP; NADE; APTA; APTA
For gripping /grasping, how much force or strength is required
UNA
Other term used grabbing, grasping UNA
Define as grasping an unsupported object(s) weighing 10 or more lbs per hand, or gripping with a force of 10 or more lbs per hand
APTA
Measure by frequency APTA
Compilation of SourcesSources Used for Identification of User Needs
for Content Model Development Built upon all OIS research activities that have
taken place to dateIn addition to input received from Panel,
Workgroup, SSA UNA, and public, considered: Social Security Act and Regulations Social Security policy guidance including Social
Security Rulings, operating manuals, and training materials
Current SSA forms used to document the assessment of an individual’s residual functional capacity (RFC) (SSA-4734 and SSA-4734-SUP)
September 2010 Social Security Administration 12
Compilation of Sources (continued)
Resources Used for Identification of User Needs for Content Model DevelopmentAlso considered other materials such as
Department of Labor’s Revised Handbook for Analyzing Jobs
Information about Essential Skills compiled by Human Resources and Skills Development Canada
International Classification of Functioning American Medical Association guides to physicians
September 2010 Social Security Administration 13
Selection CriteriaSelection Criteria for Identification of User
Needs for Content Model DevelopmentIncluded all concepts recommended by Panel
or WorkgroupConsidered all concepts suggested by the SSA
UNA or through public testimony/commentsIncluded underlying concepts for DOT data
elements that SSA needs to adjudicate claimsIncluded concepts required by SSA regulationsIncluded concepts contained in the RFC formsIncluded concepts that reflect SSA’s needs
September 2010 Social Security Administration 14
DefinitionsDefinitions for Identification of User Needs for
Content Model DevelopmentEstablished sequential process
1. Definitions required according to SSA regulations. If not available, then
2. DOT definitions. If not available or if the definition has caused difficulty in adjudicating claims, then
3. Panel definitions. If not available or if the definition may need clarification for disability adjudicators, then
4. Definitions identified through other research (e.g., supplied by public commenters, identified in references, found through internet searches, etc.)
September 2010 Social Security Administration 15
Resolving DifferencesThe concept is primaryMethods for resolving differences in selections
If the same concept was represented by both a general term and detailed terms, then the general term was identified as the data element or dimension while the detailed terms were provided as additional occupational information desired by users.
If the same concept was represented by different names, then a sequential process for naming the concept was followed.
September 2010 Social Security Administration 16
Documenting SelectionsDocumentation of selections for the Identification
of User Needs for Content Model Development includesIntroduction, including methodologyChart
Person-side data elements with definitions and related inquiry (first column)
Placeholders for corresponding work-side dimensions with definitions and related work activities (second column). Note, a few work-side dimensions required for vocational analysis were also identified in the second column.
Additional details about the related occupational information desired by users (third column)
September 2010 Social Security Administration 17
Documenting Selections (continued)
Documentation of selections (continued)Endnotes
Source of data element or dimension Rationale for including data element or dimension Explanation of resolution of differences in the data
element or dimension from various sources
September 2010 Social Security Administration 18
Analysis Conducted by Project Staff
Analysis conducted by Project Staff for the Identification of User Needs for Content Model Development Started with a data element or dimension
recommended by the PanelIdentified related data element or dimension
recommended by the WorkgroupIdentified related information from other sources
(e.g., public testimony/comments, SSA UNA, etc.)Reviewed SSA regulations and agency guidance
related to the data element or dimension
September 2010 Social Security Administration 19
Analysis Conducted by Project Staff (continued)Analysis Conducted by Project Staff
(continued)Reviewed RFC formsApplied criteria and methodology describedReached agreement/consensus
September 2010 Social Security Administration 20
Example 1
September 2010 Social Security Administration 21
PERSON-SIDE WORK-SIDE
OCCUPATIONAL INFORMATION DESIRED BY USERS
Data Element: Fine Manipulation Definition: Picking, pinching, or otherwise working primarily with fingers rather than with the whole hand or arm as in handling Related Inquiry: Is the person’s capacity for fine manipulation limited by a medically determinable impairment?
Dimension: Definition: Related Work Activities:
To assess disability for an individual with a limitation in fine manipulation, it would be helpful to know what is and what is not required by the occupation in terms of specific fine manipulation job demands. For example, users desire information about whether the job incumbent is required to use fine manipulation:
Bilateral vs. unilateral Fingering Handwriting Pinching (forceful, simple) Picking Using keyboard or other manual
input devices
Example 1 (continued)Data element is “fine manipulation,” as
recommended by the Workgroup Occupational information desired by users
identifies need for information about:Whether the work activity can be performed using
one arm/hand or whether both arms/hands are needed to perform the work activity, as recommended by the Panel and others
Specific types of fine manipulation, such as fingering, handwriting, pinching (simple, forceful), and using keyboard, mouse, touchpad or other manual input devices, as recommended by the Panel and others
September 2010 Social Security Administration 22
Example 2Examples of data elements not selected
DizzinessStress
September 2010 Social Security Administration 23
Next Steps“Identification of User Needs for Content Model
Development” is one of many steps in process of developing a final OIS content model.
Data elements, dimensions, and data elements for research purposes will need to be tested.
Testing may result in refinement to these data elements, dimensions, and data elements for research purposes.
This testing and refinement process will continue until the final OIS Content Model is an accurate and appropriate reflection of the adjudicative needs of SSA’s disability programs as well as the world of work.
September 2010 Social Security Administration 24