Item Development Presentation
-
Upload
deacon-holcomb -
Category
Documents
-
view
13 -
download
0
description
Transcript of Item Development Presentation
![Page 1: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/1.jpg)
Item Development Presentation
1
June 11, 2012
![Page 2: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/2.jpg)
Item Developer’s TasksTo develop high-quality, standards-based items
that will adhere to the Florida Department of Education Item Specification and will be used on three formative district test forms to evaluate students’ strengths and weaknesses on the Next Generation Sunshine State Standards (NGSSS) in Social Studies
2
![Page 3: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/3.jpg)
3
DOK I
DOK II
DOK III
![Page 4: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/4.jpg)
DOK Sample Question 1
4
What was the immediate cause of the outbreak of World War I (1914)?
A. Formation of secret alliances.B. Competition over Asian and African colonies.C. Accumulation of arms and weapons.D. Assassination of Archduke Ferdinand of Austria.
![Page 5: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/5.jpg)
5
Use the table to answer the question. 1860
North South
Industrial Agricultural
More cities Mainly rural
Many factories Few Factories
Slavery widely opposed Slavery widely supported
A. The South had more large cities than the North.B. Sectionalism was based on social and economic differences.C. The South was well prepared to win a war against the North.D. Agriculture was no longer important to the United States economy.
Which conclusion related to the Civil War can be drawn from the information in this chart?
DOK Sample Question 2
![Page 6: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/6.jpg)
6
DOK Sample Question 3
Which late 19th-century event is portrayed in this cartoon?
A.economic tariffs on European goodsB.the incident leading to war with SpainC.colonial expansion into Latin AmericaD.the capture of the Philippine Islands
![Page 7: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/7.jpg)
Cognitive Complexity Levels
7
Low Complexity Low-complexity items require students to recall, observe, question or represent basic facts. For a low complexity item, the student would be expected to demonstrate simple skills or abilities. A low-complexity item requires only basic understanding – often verbatim recall or simple understanding of a term or process.
Moderate Complexity Moderate-complexity items require two steps: identification and subsequent processing of that information. Students are expected to make inferences and may encounter items that include words such as classify, organize and compare. Depending on the objective a particular moderate-level item, students may also be required to explain, describe, or interpret.
High Complexity High-complexity items make heavy demands on student thinking. Students may be asked to explain, generalize, or make multiple connections. High complexity items require several steps involving abstract reasoning and planning.
Recall and Reproduction
Skills & Concepts
Strategic/ Extended Thinking
![Page 8: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/8.jpg)
8
![Page 9: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/9.jpg)
Terminology Item - the entire multiple choice question. Stem – the first, sentence-like portion of the
multiple-choice question. Alternatives – all possible multiple-choice
response options. Key response – correct answer. Distracters - the wrong answers. They are
called distracters because they should be written to be plausible and, ideally, reflect common misconceptions, thus distracting students with only superfluous knowledge of the tested material.
9
![Page 10: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/10.jpg)
ExampleWhat is the process of elimination in a multiple choice question? (stem)
A. Skipping the entire question (distracter)*B. Eliminating the wrong answers (key) C. Eliminating all extreme answers
(distracter) D. Just guessing (distracter)
10
![Page 11: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/11.jpg)
Example (poor)In World War II the Allied strategy, agreed upon
by the U.S. and Great Britain was toA. concentrate on defending Japan before turning to
Germany.B. fight only against Japan, leaving the Russians to
fight Germany alone.C. take a passive role and limit operations to
reacting to Axis moves.D.concentrate on defeating Germany first before
turning on Japan.11
![Page 12: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/12.jpg)
Example (poor)Use a direct question (not an incomplete sentence) in the stemIn World War II the Allied strategy, agreed upon
by the U.S. and Great Britain was toA. concentrate on defending Japan before turning to
Germany.B. fight only against Japan, leaving the Russians to
fight Germany alone.C. take a passive role and limit operations to
reacting to Axis moves.D.concentrate on defeating Germany first before
turning on Japan.12
![Page 13: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/13.jpg)
Example (better)What was the Allied strategy, agreed upon by
the U.S. and Great Britain, in World War II?A. Concentrate on defending Japan before turning to
GermanyB. Fight only against Japan, leaving the Russians to
fight Germany aloneC. Take a passive role and limit operations to
reacting to Axis movesD.Concentrate on defeating Germany first before
turning on Japan13
![Page 14: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/14.jpg)
Example (poor)Which of the following events abolished the
institution of slavery in the United States?
A.Ratification of the 13th amendment in 1865B.Creation of the Freedmen’s Bureau of 1865C.Compromise of 1850D.Emancipation Proclamation of 1863
14
![Page 15: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/15.jpg)
ExampleArrange numerical alternatives (such as dates) in ascending order.
Which of the following events abolished the institution
of slavery in the United States?
A.Ratification of the 13th amendment in 1865B.Creation of the Freedmen’s Bureau of 1865C.Compromise of 1850D.Emancipation Proclamation of 1863
15
![Page 16: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/16.jpg)
Example (better)
Which of the following events formally abolished the
institution of slavery in the United States?
A.Compromise of 1850B.Emancipation Proclamation of 1863C.Creation of the Freedmen’s Bureau of 1865D.Ratification of the 13th amendment in 1865
16
![Page 17: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/17.jpg)
Example (poor)
Which of the following groups of citizens of the United States were not allowed to cast their votes in elections for President of the United States until the 23rd Amendment was passed?
17
![Page 18: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/18.jpg)
ExampleDo not use negative words, such as “not” or “except” in a stem.
Which of the following groups of citizens of the United States were not allowed to cast their votes in elections for President of the United States until the 23rd Amendment was passed?
18
![Page 19: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/19.jpg)
Example (better)
Passage of the 23rd Amendment gave presidential election voting privilege to which group of citizens?
19
![Page 20: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/20.jpg)
Example (poor)
Which of the following is an example of a success of the
“right-to-life” movement ?
A.It created a constitutional amendment banning abortions.
B.Achieving restrictions on abortionsC.Getting the Stewart v. Freeman case to the
Supreme CourtD.All of these choices are correct.
20
![Page 21: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/21.jpg)
ExampleDo not use “all of the above” or “none of the above”
Which of the following is an example of a success of
the “right-to-life” movement ?
A.It created a constitutional amendment banning abortions.
B.Achieving restrictions on abortionsC.Getting the Stewart v. Freeman case to the
Supreme CourtD.All of these choices are correct.
21
![Page 22: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/22.jpg)
Example (better)
Which of the following is an example of a success of the “right-to-life” movement ?
A.Creating a constitutional amendment banning abortions
B.Achieving restrictions on abortions C.Getting the Stewart v. Freeman case to the
Supreme Court D.Reversing Roe v. Wade
22
![Page 23: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/23.jpg)
Writing Good ItemsPart I. Emphasis on the Stem
Write questions that examine important concepts; avoid questions addressing minute details.
Make the stem clear and unambiguous.Use simple grammar and sentence structure.Do not use vocabulary more advanced than
required.Include in the stem any word(s) that
otherwise would be repeated in each alternative.
23
![Page 24: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/24.jpg)
Example (poor)How many grievances against the king
were named in the Declaration of
Independence?
24
![Page 25: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/25.jpg)
Example How many grievances against the king were named in the Declaration of Independence?
Write questions that examine important concepts; avoid questions addressing minute details.
25
![Page 26: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/26.jpg)
Example (better)What major grievance against the king
wasnamed in the Declaration of
Independence?
26
![Page 27: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/27.jpg)
Example (poor)As the level of fertility approaches its
nadir, what is the most likely ramification for
the citizenry of a developing nation?
27
![Page 28: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/28.jpg)
Example As the level of fertility approaches its nadir, what is the most likely ramification for the citizenry of a developing nation?
Make the stem clear and unambiguous.
Do not use vocabulary more advanced than required.
28
![Page 29: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/29.jpg)
Example (better)
What would be the likely result of a decline in
fertility in a developing nation?
29
![Page 30: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/30.jpg)
Example (poor)I believe that it must be the policy of the
United States to support free peoples who are resisting attempted subjugation by armed minorities or outside pressures.
This statement was usedA.to support the Baruch Plan. B.to support the Monroe Doctrine. C.to support the Good Neighbor Policy. D.to support the Truman Doctrine.
30
![Page 31: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/31.jpg)
ExampleI believe that it must be the policy of the United
States to support free peoples who are resisting attempted subjugation by armed minorities or outside pressures.
This statement was usedA.to support the Baruch Plan. B.to support the Monroe Doctrine. C.to support the Good Neighbor Policy. D.to support the Truman Doctrine.
Include in the stem any word(s) that otherwise would be repeated in each alternative.
31
![Page 32: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/32.jpg)
Example (better)I believe that it must be the policy of the United
States to support free peoples who are resisting attempted subjugation by armed minorities or outside pressures.
This statement was used to support which of the following?A.The Baruch PlanB.The Monroe DoctrineC.The Good Neighbor PolicyD.The Truman Doctrine
32
![Page 33: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/33.jpg)
Writing Good ItemsPart II. Emphasis on Alternatives
Do not let any portion of the stem provide unintended clues.
Do not let the length of alternatives provide unintended clues.
Make all distracters plausible (use common errors).Make the alternatives mutually exclusive.Keep the grammar of each alternative consistent.Be careful to keep items independent, so that the
answer to one question does not provide a clue to solving another.
Make the position of the key response (correct answer) random.
33
![Page 34: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/34.jpg)
Example (poor)What was one of the most important domestic economic results of World War II?
A. Complete employment for minority AmericansB. The end of discrimination for African
AmericansC. Change in social status for womenD. The swift ending of the Great Depression
34
![Page 35: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/35.jpg)
ExampleWhat was one of the most important domestic economic results of World War II?
A. Complete employment for minority AmericansB. The end of discrimination for African
AmericansC. Change in social status for womenD. The swift ending of the Great Depression
Do not let any portion of the stem provide unintended clues.
35
![Page 36: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/36.jpg)
Example (better)What was one of the most important domestic results of World War II?
A. Complete employment for minority AmericansB. The end of discrimination for African
AmericansC. Change in social status for womenD. The swift ending of the Great Depression
36
![Page 37: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/37.jpg)
Example (poor)“Reaganomics” was based upon which of the following views?
A. The government must cut taxes to stimulate investment, which would, in turn, increase employment and tax
revenue.B. The government must commit to large expenditures.C. The government must institute wage and price controls.D. The government must increase taxes on corporations and individuals.
37
![Page 38: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/38.jpg)
Example“Reaganomics” was based upon which of the following views?
A. The government must cut taxes to stimulate investment, which would, in turn, increase employment and tax
revenue.B. The government must commit to large expenditures.C. The government must institute wage and price controls.D. The government must increase taxes on corporations and individuals.
Do not let the length of alternatives provide unintended clues.
38
![Page 39: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/39.jpg)
Example (better)“Reaganomics” was based upon which of the following views?
A. The government must cut taxes to stimulate investment
into the economy.B. The government must commit to large expenditures.C. The government must institute wage and price
controls.D. The government must increase taxes on
corporations and individuals.
39
![Page 40: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/40.jpg)
Example (poor)
The English based their claim to territorial rights in North America on the expeditions of which of their explorers?
A. Henry HudsonB. Ferdinand MagellanC. Sir Walter RaleighD. Amerigo Vespucci
40
![Page 41: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/41.jpg)
Example
The English based their claim to territorial rights in North America on the expeditions of which of their explorers?
A. Henry HudsonB. Ferdinand MagellanC. Sir Walter RaleighD. Amerigo Vespucci
Make all distracters plausible (use common errors).
41
![Page 42: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/42.jpg)
Example (better)
The English based their claim to territorial rights in North America on the expeditions of which of their explorers?
A. Henry HudsonB. Francis DrakeC. Sir Walter RaleighD. John Rolfe
42
![Page 43: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/43.jpg)
Example (poor)Which of the following was a circumstance of the election of 1789?
A. Southern Federalists supported Thomas Jefferson.
B. The Federalist Party did not unite behind Adams.
C. George Washington took an active role.D. The Federalist party divided over the support
of Adams.
43
![Page 44: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/44.jpg)
ExampleWhich of the following was a circumstance of the election of 1789?
A. Southern Federalists supported Thomas Jefferson.B. The Federalist Party did not unite behind Adams.C. George Washington took an active role.D. The Federalist party divided over the support of
Adams.
Make the alternatives mutually exclusive.
44
![Page 45: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/45.jpg)
Example (better)Which of the following was a circumstance of the election of 1789?
A. Southern Federalists supported Thomas Jefferson.
B. The Federalist Party united behind Adams.C. George Washington took an active role.D. The Federalist party divided over the support
of Adams.
45
![Page 46: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/46.jpg)
Example (poor)Why did President Kennedy decide to remove Diem from the presidency of South Vietnam?
A. Diem launched attacks on the country's Buddhists.
B. Massacring a large number of Viet CongC. Refusing to allow American soldiers to engage
in combatD. Shooting his own brother for treason
46
![Page 47: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/47.jpg)
ExampleWhy did President Kennedy decide to remove Diem from the presidency of South Vietnam?A. Diem launched attacks on the country's
Buddhists.B. Massacring a large number of Viet CongC. Refusing to allow American soldiers to engage
in combatD. Shooting his own brother for treasonKeep the grammar of each alternative consistent.
47
![Page 48: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/48.jpg)
Example (better)Why did President Kennedy decide to remove Diem from the presidency of South Vietnam?
A. Diem launched attacks on the country's Buddhists.
B. Diem massacred a large number of Viet Cong.C. Diem refused to allow American soldiers to
engage in combat.D. Diem had his own brother shot for treason.
48
![Page 49: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/49.jpg)
Example Which of the following events occurred as a direct result of the Townshend Acts?
A. The Committees of Correspondence were formed.
B. The First Continental Congress was convened.
C. The principle of "salutary neglect" ended.
D. The colonists resented mercantilist economic policy.
What was the purpose of the colonial Committees of Correspondence created as a result of the Townshend Acts?
A. Keep colonial intellectuals in contact with each other
B. Publicize grievances against England
C. Improve the writing skills of young gentlemen
D. Correspond with English radicals who supported the American causeBe careful to keep items independent, so that the answer
to one question does not provide a clue to solving another.
49
![Page 50: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/50.jpg)
ExampleWhich of the following events occurred as a direct result of the Townshend Acts?
A. The Committees of Correspondence were formed.
B. The First Continental Congress was convened.
C. The principle of "salutary neglect" ended.
D. The colonists resented mercantilist economic policy.
What was the purpose of the colonial Committees of Correspondence created in response to the Townshend Acts?
A. Keep colonial intellectuals in contact with each other
B. Publicize grievances against England
C. Improve the writing skills of young gentlemen
D. Correspond with English radicals who supported
the American cause
50
![Page 51: Item Development Presentation](https://reader035.fdocuments.in/reader035/viewer/2022062517/5681308a550346895d9664af/html5/thumbnails/51.jpg)
51
Practice ExerciseAs a group you will develop one multiple choice question on the following benchmark associated with your course.
Use the template to guide you in creating the question..