Clarke, R. J (2001) L951-06: 1 Critical Issues in Information Systems BUSS 951 Lecture 6 Analysis...
-
Upload
lesley-gallagher -
Category
Documents
-
view
213 -
download
0
Transcript of Clarke, R. J (2001) L951-06: 1 Critical Issues in Information Systems BUSS 951 Lecture 6 Analysis...
Clarke, R. J (2001) L951-06: 1
Critical Issues in Information Systems
BUSS 951
Lecture 6Analysis and ModelingTechnical and Social Modeling
Clarke, R. J (2001) L951-06: 2
Notices (1)General
Pick up Assignment 2 now from the BUSS951 website atwww.uow.edu.au/~rclarke/buss951/buss951.htm
the purpose of this assignment is to assist you in developing useful skills when Summarising and Evaluating IS Research, and then to Apply it to an actual IS and create a Description of a System from the perspective of the theory
I will hand back Assignment 1 at next week’s lecture- if I finish these earlier then I will announce it on the website
Clarke, R. J (2001) L951-06: 3
Agenda (1)
Analysis and Requirements Engineering
Analysis as Research
Clarke, R. J (2001) L951-06: 4
Readings Week 6
3.Randal, D.; Hughes, J. and D. Shapiro (1993) “Systems Development- The Fouth Dimension: Perspectives on the social organisation of work”
8. Button, G. and W. Sharrock (1994) “Occasioned practices in the work of software engineers”
9. Johnson, R. ed/ (1996)
Clarke, R. J (2001) L951-06: 5
Agenda (1)
the point of this lecture is demonstrate that choices in theory are not ever just technical choices but are also necessarily social choices
in the first part of the lecture we will look at information and revisiting Shannon & Weaver to discuss it political and social effects
as we will see these political and social effects are a result of individualism
Clarke, R. J (2001) L951-06: 6
Agenda (2)
last week we discussed aspects of Design Problems and Solutions- neither are as simple as is claimed
we continue this theme in the second half of the lecture by looking at how to make ‘almost useless’ objects- this tells us a great deal about the design process
Clarke, R. J (2001) L951-06: 7
Analysis/Requirements Engineering
Clarke, R. J (2001) L951-06: 8
Requirements Engineering
the problem of requirements engineering is to determine ‘requirements’ for computer based systems
currently a lively debate about the definition and scope of this term
there are in fact many definitions for this activity
Clarke, R. J (2001) L951-06: 9
Requirements EngineeringVarious Definitions
‘…analysis, documentation and ongoing evolution of both user needs and the external behaviour of the of the system being built’ (Davis 1992)
“…the process of establishing the services the system should provide and the constraints under which it must operate” (Somerville 1992)
‘…requirements are properties that as system should have in order to succeed in the environment in which it will be used’ (Goguen 1992)
Clarke, R. J (2001) L951-06: 10
Requirements EngineeringGoguen’s Definition emphasises the social
this definition betrays a bias through its explicit reference to the system’s context in the phrase ‘the environment where it will be used’
this acknowledges the involvement of both social and technical concerns in requirements
‘social’ is largely implicit in most definitions and methods for requirements- in fact this is really what this weeks readings are about
Clarke, R. J (2001) L951-06: 11
Requirements EngineeringRelationship between ‘social’ and ‘technical’
just as the terms ‘analysis’ and ‘requirements engineering’ betray the training and communities of the developers that use them…
so does the relationship between the ‘social’ and the ‘technical’ differ depending on the type of authors you read and the kind of traditions they work in
Several words that signify different meanings in relation to analysis or requirements engineering: Capture Specify Elicit Construct
Clarke, R. J (2001) L951-06: 12
Requirements EngineeringRequirements
Capturing Requirements: Suggest that although they may be elusive, they are out there somewhere
Specifying Requirements: suggests that it is probably a straightforward engineering job to be done, and that the issues involves are largely technical in nature (see readings this week)
Eliciting Requirements: suggest that requirements are to be found among people- the users, managers etc. and that it might be in the form of tacit knowledge
Constructing Requirements: suggest that requirements are not out there but instead are a somewhat arbitrary product of the requirements engineering process
Clarke, R. J (2001) L951-06: 13
Requirements EngineeringIn relation to the Lifecycle
there is no term as yet in current use which suggests the ongoing evolution of requirements from processes of interaction, both social and technical
Often considered to be a distinct phase of the lifecycle- in practice this is often found to be not true as analysis activities appear to be smeared across all stages in the development of systems
Following the work of Suchman (1987) on plans, Goguen (1994) argues that it is more accurate to think of the division of the lifecycle into phases as a (project) management technique or a post hoc reconstruction rather than as a model of how systems development actually proceeds
Clarke, R. J (2001) L951-06: 14
Analysis as ResearchBased on Walliman (2001)
Clarke, R. J (2001) L951-06: 15
Analysis as Research
independent of the particular methods that are used in order to conduct actual analysis activities systems analysis/ requirements engineering is a kind of research interestingly as we will see in the Seminar
tonight these technical methods are still deployed sociaslli and are also constructed in particular disciplinary communities that adhere to views which are part of the cultural property of these groups
Clarke, R. J (2001) L951-06: 16
Analysis as Research
the purpose of this section is to start thinking about analysis and design as a kind of applied research into workplaces
this is usually not done in systems analysis and design subjects or in subjects which focus on methodologies- none-the-less it is an interesting way of looking at core activities in our discipline
we will use the research methods literature as a way of investigating analysis and design
Clarke, R. J (2001) L951-06: 17
Analysis as Research Types of Research
different kinds of questions which instigate or start research require approaches to research which are distinguished by their theoretical background and methodologies
we will consider only those that have immediate relevance to IS interestingly you could apply any of these approaches to IS: mostly because of the fact that IS is an applied discipline
and therefore lends itself to a range of different interpretations
also because IS is multidisciplinary and so its theoretical and methodological basis is in many different disciplines and therefore makes many kinds of research project possible
Clarke, R. J (2001) L951-06: 18
Analysis as Research Types of Research (Walliman 2001)
1. Historical Qualitative2. Comparative Qualitative3. Descriptive Qualitative4. Correlation Quantitative5. Experimental Quantitative6. Evaluation Qualitative7. Action Qualitative8. Ethnogenic various- not quantitative9. Feminist/Identity Politics various- not quantitative10. Cultural various- not quantitative
Broadly interpretivist methodologies which include Postmodernism, Post structuralism, Critical Theory Discourse Analysis, Critical Linguistics, Semiotics
Clarke, R. J (2001) L951-06: 19
Analysis as Research Historical Research
1. Historical2. Comparative3. Descriptive4. Correlation5. Experimental6. Evaluation7. Action8. Ethnogenic9. Feminist10. Cultural
the systematic and objective location, evaluation and synthesis of evidence in order to establish facts and draw conclusions about past events
involves: Where the events take place? Which people are involves? When the events occurred? What kind of human activity
was involved?
Clarke, R. J (2001) L951-06: 20
Analysis as Research Comparative Research
1. Historical2. Comparative3. Descriptive4. Correlation5. Experimental6. Evaluation7. Action8. Ethnogenic9. Feminist10. Cultural
Often used together with historical research to compare people’s experience of different societies, either between times in the past or in parallel situations in the present
conducted at a macro level (revolutions) or at a micro level (individual experiences)
Experimental research- where the researcher controls causal factors- is not really possible in social research, but history and comparisons can supply researchers with a natural experiment in which non-essential characteristics of a phenomena can be eliminated by looking at multiple instance of it
Clarke, R. J (2001) L951-06: 21
Analysis as Research Descriptive Research
1. Historical2. Comparative3. Descriptive4. Correlation5. Experimental6. Evaluation7. Action8. Ethnogenic9. Feminist10. Cultural
Instead of examining records or artifacts, descriptive research relies on observation as a means of collecting data
attempts to examine situations in order to establish what is the normal- what can be predicted to happen again under the same circumstances
Observations are written down or recorded in some way in order to be subsequently analysed
Depends on human observations and responses- distortions in data can occur in biased questions in interviews, questionnaires, selective observation of events
Clarke, R. J (2001) L951-06: 22
Analysis as Research Correlation Research
1. Historical2. Comparative3. Descriptive4. Correlation5. Experimental6. Evaluation7. Action8. Ethnogenic9. Feminist10. Cultural
‘analytical survey’ or correlation research is quantitative
Correlation is a word which describes the statistical measure of association or the relationships between two phenomena
Two types of studies Relational studies: an exploratory form of
study which investigates the possible relationships between phenomena to establish if a correlation exists and if so to what extent
Prediction studies: carried out in research areas where correlations are already known- attempts to predict possible behaviour or events
Clarke, R. J (2001) L951-06: 23
Analysis as Research Experimental Research
1. Historical2. Comparative3. Descriptive4. Correlation5. Experimental6. Evaluation7. Action8. Ethnogenic9. Feminist10. Cultural
researchers try to isolate and control every relevant condition which determines the events investigated, so as to observe the effects when the conditions are manipulated
Different types of experimental design: Pre-experimental: unreliable assumptions are made
despite the lack of control over variables True experimental: rigorous check of the identical
nature of groups before testing the influence of a variable on a sample of them under controlled circumstances
Quasi-experimental: not all conditions of true experimental design can be fulfilled but the shortcomings are identified
Correlation and ex post facto: correlation looks for cause and effect relationships between two sets of data; ex post facto reverse experimentation - interprets the cause of phenomenon by observing its effects
Clarke, R. J (2001) L951-06: 24
Analysis as Research Evaluation Research…
1. Historical2. Comparative3. Descriptive4. Correlation5. Experimental6. Evaluation7. Action8. Ethnogenic9. Feminist10. Cultural
Descriptive type of research designed to deal with complex social issues (the latest so called fourth generation evaluation research has the following properties): outcomes do not represent ‘how things are’ or ‘how they
work’, rather they represent meaningful constructions which groups create to make sense of situations they find themselves in
It is recognised that these constructions are shaped by the values of the constructors
inextricably linked to particular physical, psychological, social and cultural contexts within which they are formed and in which they are used
evaluation of these constructions is highly dependent on the involvement and viewpoint of the evaluators
evaluation should be action oriented, define a course which can be practically followed- usually requires negotiation
participants are equal partners in every aspect of the design, implementation, interpretation and resulting action
Clarke, R. J (2001) L951-06: 25
Analysis as Research …Evaluation Research (Systems Analysis)…
1. Historical2. Comparative3. Descriptive4. Correlation5. Experimental6. Evaluation7. Action8. Ethnogenic9. Feminist10. Cultural
One type of evaluation research is (would you believe): Systems analysis: holistic type of research
which reverses the three stage order of thinking which is typical of scientific enquiry (that is, breaking the problem into researchable parts, then separately evaluating the parts and then aggregating the evaluations into an explanation of the whole). In contrast, systems analysis is involved with:
Identifying the encompassing whole (the system) of which the phenomenon or problem is a part
Evaluating the behaviour or properties of the encompassing whole
Explaining the behaviour or properties of the phenomena or problem in terms of its roles or functions within the encompassing whole
Clarke, R. J (2001) L951-06: 26
Analysis as Research …Evaluation Research (Responsive)
1. Historical2. Comparative3. Descriptive4. Correlation5. Experimental6. Evaluation7. Action8. Ethnogenic9. Feminist10. Cultural
Another kind of evaluation research is called: Responsive Evaluation: in which a series
of investigative steps is undertaken in order to evaluate how responsive a program is (an advertising campaign, new degree course etc) to all those taking part in it:
Data collection: identifying issues from the people directly involves in the programme; identifying further issues from the program documents; observing how the programme is actually working
Evaluation: the design of an evaluation based on the data collected and reporting findings
Suggested changes: informing the participants of the findings in ways specifically designed for each type of audience
Clarke, R. J (2001) L951-06: 27
Analysis as Research Action Research
1. Historical2. Comparative3. Descriptive4. Correlation5. Experimental6. Evaluation7. Action8. Ethnogenic9. Feminist10. Cultural
similar to experimental research although carried out in the real world rather than in the context of a closed experimental system – it involves small scale interventions in the functioning of the real world and a close examination of the effects of such an intervention
Essentially an ‘on the spot’ procedure- designed to deal with a specific problem evident in a particular situation where no attempt is made to separate a particular feature of the problem from its context in order to study it in isolation
constant monitoring and evaluation are carried out and conclusions from the findings are applied immediately and further monitored
as a practical form of research, aimed at a specific problem and situation and with little or no control over independent variables, it cannot fulfil the scientific requirement for generalisability
therefore despite its exploratory nature- and therefore relatable to experimental research- it is actually the antithesis experimental research
Clarke, R. J (2001) L951-06: 28
Analysis as Research Ethnogenic Research
1. Historical2. Comparative3. Descriptive4. Correlation5. Experimental6. Evaluation7. Action8. Ethnogenic9. Feminist10. Cultural
Researchers are interested in how subjects of the research theorise about their own behaviour rather than imposing a theory from outside
Aims are: to represent a view of the world as it is structured by the
participants under observation by eliciting phenomenological data ( that is it concentrates on the detailed description of conscious experience- the science of phenomena as opposed to the science of being)
it takes place in undisturbed natural settings of the subjects
it attempts to represent the totality of the social, cultural and economic situation, regarding the context to be equally important as the action
Difficult form of research- culture is often hidden and rarely explicit, need to consider the language and behaviour of subjects and surrounding conditions in which they work
Risks: cultural background of the research can affect the outcome; naturalistic settings mean that it is impossible to repeat the situation to verify the research
Clarke, R. J (2001) L951-06: 29
Analysis as Research Feminist/Identity Politics Research
1. Historical2. Comparative3. Descriptive4. Correlation5. Experimental6. Evaluation7. Action8. Ethnogenic9. Feminist10. Cultural
No single sets of methodologies- rather a related set of practices which start from a position on research which says that gender and issues of identity politics must be considered as an enormously influencial category in social theory
that those researchers who ignore its influence have invalid knowledge as non-feminist paradigms usually ignore the partiality of the researcher’s ideas about the social world
Undertaken with a political commitment to the identification and transformation of gender relations and identity
Very important form of research because while this form of research is not uniquely political it exposes the fact that all methods of social research are political to the extent that they are gendered and rely on specific kinds of representation of identity
Clarke, R. J (2001) L951-06: 30
Analysis as Research Cultural Research…
1. Historical2. Comparative3. Descriptive4. Correlation5. Experimental6. Evaluation7. Action8. Ethnogenic9. Feminist10. Cultural
Many of the prevailing theoretical debates (eg. Postmodernism, post-structuralism) are concerned with language and cultural interpretation- these issues are central to sociological studies
‘Cultural texts’ expanded to include many manifestations of cultural exchange: Opera, TV, cocktail parties, fashion The main criteria for cultural texts is that one should be
able to ‘read’ some meanings into the phenomena
Need has therefore arisen for methodologies that allow analysis of cultural texts to be compared, replicated, disproved and generalised: Structural properties of language (Chomsky Sacks
Schelgoff) Language as action in its contextual environment
(Wittgenstein Austin and Searle) Sociolinguistics and the ‘ethnography of speaking’
(Hymes, Bernstein, Labov etc) Semiotic theories of Language (Halliday, Hjelmslev)
Clarke, R. J (2001) L951-06: 31
Analysis as Research …Cultural Researh
1. Historical2. Comparative3. Descriptive4. Correlation5. Experimental6. Evaluation7. Action8. Ethnogenic9. Feminist10. Cultural
Three approaches to the consistent interpretation of cultural texts are:
Content Analysis: rather positivistic attempt to identify subjective meaning in the cultural domain. Example is counting the number of times a particular word occurs in a text as an indication of its importance.
Semiotics: takes an opposite approach by attempting to gain a deep understanding of meanings by the interpretation of single elements of texts and “… tracing the meanings of things back through the systems and codes through which they have meaning and make meaning” (Slater 1995, 240)
Discourse Analysis: studies the ways that people communicate with each other through language within a social setting- several schools
Clarke, R. J (2001) L951-06: 32
Analysis as Research Class Exercise: Appropriateness to IS
1. Historical Qualitative2. Comparative Qualitative3. Descriptive Qualitative4. Correlation Quantitative5. Experimental Quantitative6. Evaluation Qualitative7. Action Qualitative8. Ethnogenic various- not quantitative9. Feminist/Identity Politics various- not quantitative10. Cultural various- not quantitative
Broadly interpretivist methodologies which include Postmodernism, Post structuralism, Critical Theory Discourse Analysis, Critical Linguistics, Semiotics