NEW FDNY RSOE PRACTICAL Exam...Development Process FDNY and C Squared Contracting company developed...
Transcript of NEW FDNY RSOE PRACTICAL Exam...Development Process FDNY and C Squared Contracting company developed...
![Page 1: NEW FDNY RSOE PRACTICAL Exam...Development Process FDNY and C Squared Contracting company developed this exam with 2 Subject Matter Experts holding Q-01 license with over 70 years](https://reader034.fdocuments.in/reader034/viewer/2022051310/5ffa3321bc78226424683f4c/html5/thumbnails/1.jpg)
NEW FDNY RSOE PRACTICAL Exam
7/21/2020
NYCBill de BlasioMayor
Daniel A. NigroCommissioner
FDNY
![Page 2: NEW FDNY RSOE PRACTICAL Exam...Development Process FDNY and C Squared Contracting company developed this exam with 2 Subject Matter Experts holding Q-01 license with over 70 years](https://reader034.fdocuments.in/reader034/viewer/2022051310/5ffa3321bc78226424683f4c/html5/thumbnails/2.jpg)
Attendees Sign In
FDNY staff C2 representatives School representatives
2
![Page 3: NEW FDNY RSOE PRACTICAL Exam...Development Process FDNY and C Squared Contracting company developed this exam with 2 Subject Matter Experts holding Q-01 license with over 70 years](https://reader034.fdocuments.in/reader034/viewer/2022051310/5ffa3321bc78226424683f4c/html5/thumbnails/3.jpg)
Introduction The simulator replacement project started in October
2017. Purpose:
to bring the simulator to the latest computer technology with a stable operating environment
to bring the testing mode to reflect the current operating refrigeration equipment.
3
![Page 4: NEW FDNY RSOE PRACTICAL Exam...Development Process FDNY and C Squared Contracting company developed this exam with 2 Subject Matter Experts holding Q-01 license with over 70 years](https://reader034.fdocuments.in/reader034/viewer/2022051310/5ffa3321bc78226424683f4c/html5/thumbnails/4.jpg)
Development Process
FDNY and C Squared Contracting company developed this exam with 2 Subject Matter Experts holding Q-01 license with over 70 years of combined industry experience in NYC .
Experiences learned from the old simulator were rolled into and improved upon in the new simulator.
4
![Page 5: NEW FDNY RSOE PRACTICAL Exam...Development Process FDNY and C Squared Contracting company developed this exam with 2 Subject Matter Experts holding Q-01 license with over 70 years](https://reader034.fdocuments.in/reader034/viewer/2022051310/5ffa3321bc78226424683f4c/html5/thumbnails/5.jpg)
Development Process
There have been many steps taken - including new test questions, 3-D model development, validation of questions, system upgrades, and other important steps.
One Alpha test. Two Beta tests:
Phase 1- invited Q-01/Q-99 holders to take the exam Phase 2- invited new examinees to take the exam
5
![Page 6: NEW FDNY RSOE PRACTICAL Exam...Development Process FDNY and C Squared Contracting company developed this exam with 2 Subject Matter Experts holding Q-01 license with over 70 years](https://reader034.fdocuments.in/reader034/viewer/2022051310/5ffa3321bc78226424683f4c/html5/thumbnails/6.jpg)
Preparation Materials
The FDNY will provide the following materials for free on the FDNY website: An instruction manual A tutorial video
6
![Page 7: NEW FDNY RSOE PRACTICAL Exam...Development Process FDNY and C Squared Contracting company developed this exam with 2 Subject Matter Experts holding Q-01 license with over 70 years](https://reader034.fdocuments.in/reader034/viewer/2022051310/5ffa3321bc78226424683f4c/html5/thumbnails/7.jpg)
New Exam Format Introduction
Two parts of the exam Part 1: 45 minutes walk-through and practice exam
(Mandatory) Part 2: 240 minutes actual exam with both
Centrifugal and Reciprocating systems
7
![Page 8: NEW FDNY RSOE PRACTICAL Exam...Development Process FDNY and C Squared Contracting company developed this exam with 2 Subject Matter Experts holding Q-01 license with over 70 years](https://reader034.fdocuments.in/reader034/viewer/2022051310/5ffa3321bc78226424683f4c/html5/thumbnails/8.jpg)
New Exam Format - Part 1 45 minutes walk-through and practice exam
explore both Centrifugal and Reciprocating systems; take the practice questions shown in the tutorial
video to practice how to select a question, find the answers, submit answers, and complete questions;
practice the use of navigation bar, tool box and reference materials.
The practice exam provides feedback so that examinees will know if they submitted the correct answers.
8
![Page 9: NEW FDNY RSOE PRACTICAL Exam...Development Process FDNY and C Squared Contracting company developed this exam with 2 Subject Matter Experts holding Q-01 license with over 70 years](https://reader034.fdocuments.in/reader034/viewer/2022051310/5ffa3321bc78226424683f4c/html5/thumbnails/9.jpg)
New Exam Format - Part 2 2 Systems- Centrifugal and
Reciprocating Choose either one to start. Must complete one system
first and then the other one. Cannot go back to the
previous completed system. Total time limit: 240
minutes (4 hours)
9
![Page 10: NEW FDNY RSOE PRACTICAL Exam...Development Process FDNY and C Squared Contracting company developed this exam with 2 Subject Matter Experts holding Q-01 license with over 70 years](https://reader034.fdocuments.in/reader034/viewer/2022051310/5ffa3321bc78226424683f4c/html5/thumbnails/10.jpg)
Categories in Each System
6 categories in each system. Operation Validation of Repairs/Maintenance Refrigerant Handling Troubleshooting Multi-Step Scenario
10
![Page 11: NEW FDNY RSOE PRACTICAL Exam...Development Process FDNY and C Squared Contracting company developed this exam with 2 Subject Matter Experts holding Q-01 license with over 70 years](https://reader034.fdocuments.in/reader034/viewer/2022051310/5ffa3321bc78226424683f4c/html5/thumbnails/11.jpg)
1. Operation
You need to know the locations and functionsof each component, examples: Component Identification; Component Function Reading Gauges Calculations of Temperature/Pressure Differences; Use of Pressure/Temperature Charts and
Conversions
11
![Page 12: NEW FDNY RSOE PRACTICAL Exam...Development Process FDNY and C Squared Contracting company developed this exam with 2 Subject Matter Experts holding Q-01 license with over 70 years](https://reader034.fdocuments.in/reader034/viewer/2022051310/5ffa3321bc78226424683f4c/html5/thumbnails/12.jpg)
2. Validation
Examples:Normal maintenance and repair problems;Validation of repairs; Start-up procedures
12
![Page 13: NEW FDNY RSOE PRACTICAL Exam...Development Process FDNY and C Squared Contracting company developed this exam with 2 Subject Matter Experts holding Q-01 license with over 70 years](https://reader034.fdocuments.in/reader034/viewer/2022051310/5ffa3321bc78226424683f4c/html5/thumbnails/13.jpg)
3. Refrigerant Handling Examples:
Refrigerant Recovery Refrigerant Charge
4. Troubleshooting Examples:
Troubleshooting and diagnosing problems with system operations
Interpret the readings and know which reference document is required for answering the questions. 13
![Page 14: NEW FDNY RSOE PRACTICAL Exam...Development Process FDNY and C Squared Contracting company developed this exam with 2 Subject Matter Experts holding Q-01 license with over 70 years](https://reader034.fdocuments.in/reader034/viewer/2022051310/5ffa3321bc78226424683f4c/html5/thumbnails/14.jpg)
5. Multi-Step Questions
These questions include multiple sub-questions, but do not rise to the level of complexity of a scenario.
They are a combination of comprehension-level and application-level learning and represent areas of content covered in all the categories above.
Only one multi-step question in each system. A multi-step question may have a maximum of 6
follow-up questions.
14
![Page 15: NEW FDNY RSOE PRACTICAL Exam...Development Process FDNY and C Squared Contracting company developed this exam with 2 Subject Matter Experts holding Q-01 license with over 70 years](https://reader034.fdocuments.in/reader034/viewer/2022051310/5ffa3321bc78226424683f4c/html5/thumbnails/15.jpg)
6. Scenarios These questions are at an application-level of learning
and will include portions of the question/scenario that connect to the other categories.
For example, the end-to-end recovery procedure for the reciprocating unit would go into this category, but a single question related to comprehending that process would be assigned to troubleshooting category.
Only one scenario question for each system. A scenario question may have a maximum of 16
follow-up questions.15
![Page 16: NEW FDNY RSOE PRACTICAL Exam...Development Process FDNY and C Squared Contracting company developed this exam with 2 Subject Matter Experts holding Q-01 license with over 70 years](https://reader034.fdocuments.in/reader034/viewer/2022051310/5ffa3321bc78226424683f4c/html5/thumbnails/16.jpg)
Beta Phase 1 10 Q-99/Q-01 certified examinees. Individual user interview after their trials. The goal:
to obtain user experience to validate the model layout and component.
After Phase 1: Improved the exam model Modified the tutorial video Developed the instruction manual Developed the proper score report
16
![Page 17: NEW FDNY RSOE PRACTICAL Exam...Development Process FDNY and C Squared Contracting company developed this exam with 2 Subject Matter Experts holding Q-01 license with over 70 years](https://reader034.fdocuments.in/reader034/viewer/2022051310/5ffa3321bc78226424683f4c/html5/thumbnails/17.jpg)
Beta Phase 2Score Distribution
0
1
2
3
4
5
lower than50%
50-59% 60-69% 70-79% more than80%
(total=13 examinees who do not have valid Q99/Q01 )
# ofexaminees
Beta Phase 2 Pass rate: 31%*Note: Old exam pass rate in the first 3 months: 21.7%
![Page 18: NEW FDNY RSOE PRACTICAL Exam...Development Process FDNY and C Squared Contracting company developed this exam with 2 Subject Matter Experts holding Q-01 license with over 70 years](https://reader034.fdocuments.in/reader034/viewer/2022051310/5ffa3321bc78226424683f4c/html5/thumbnails/18.jpg)
New Changes 3D model vs Real System Photos Old exam: real system photos New exam: 3D pictures (The examinees must be
familiar with the component legend.)
Entire System vs Part of the System Old exam: examinees only need to find parts in a very
limited area. New exam: examinees will see the entire system and
all the components. Examinees need to know where to find the exact component asked by the question
![Page 19: NEW FDNY RSOE PRACTICAL Exam...Development Process FDNY and C Squared Contracting company developed this exam with 2 Subject Matter Experts holding Q-01 license with over 70 years](https://reader034.fdocuments.in/reader034/viewer/2022051310/5ffa3321bc78226424683f4c/html5/thumbnails/19.jpg)
New changes
The reading of gauge/thermometer/control panel The reading or status is not shown in photos but shown on the status
bar.
![Page 20: NEW FDNY RSOE PRACTICAL Exam...Development Process FDNY and C Squared Contracting company developed this exam with 2 Subject Matter Experts holding Q-01 license with over 70 years](https://reader034.fdocuments.in/reader034/viewer/2022051310/5ffa3321bc78226424683f4c/html5/thumbnails/20.jpg)
New Changes
Navigation functions Examinees can hide the components Examinees can trace piping by highlighting the pipe
when rotating the system images
20
![Page 21: NEW FDNY RSOE PRACTICAL Exam...Development Process FDNY and C Squared Contracting company developed this exam with 2 Subject Matter Experts holding Q-01 license with over 70 years](https://reader034.fdocuments.in/reader034/viewer/2022051310/5ffa3321bc78226424683f4c/html5/thumbnails/21.jpg)
New Changes
Four terminals Currently we are set up to administer exams on 2
terminals, with plans to shortly expand to 4. This will significantly improve our ability to timely
schedule practical exams.
No mandatory failure question at all.
21
![Page 22: NEW FDNY RSOE PRACTICAL Exam...Development Process FDNY and C Squared Contracting company developed this exam with 2 Subject Matter Experts holding Q-01 license with over 70 years](https://reader034.fdocuments.in/reader034/viewer/2022051310/5ffa3321bc78226424683f4c/html5/thumbnails/22.jpg)
Feedback from the examinees
In the post-exam feedback, more than 90% of the examinees agree that the tutorial video is helpful for preparing for the new
exam walk-through session is helpful for being familiar
with the exam and system.
22
![Page 23: NEW FDNY RSOE PRACTICAL Exam...Development Process FDNY and C Squared Contracting company developed this exam with 2 Subject Matter Experts holding Q-01 license with over 70 years](https://reader034.fdocuments.in/reader034/viewer/2022051310/5ffa3321bc78226424683f4c/html5/thumbnails/23.jpg)
Quote from the examinee who got more than 90
What do you like most about this new exam?
“Better evaluation, not just memorizing a click sequence”
23
![Page 24: NEW FDNY RSOE PRACTICAL Exam...Development Process FDNY and C Squared Contracting company developed this exam with 2 Subject Matter Experts holding Q-01 license with over 70 years](https://reader034.fdocuments.in/reader034/viewer/2022051310/5ffa3321bc78226424683f4c/html5/thumbnails/24.jpg)
Lessons Learned You must watch the tutorial video several times. You must be familiar with the instruction
manual. You should use the walk-through session to
practice how to operate the exam and be familiar with the layout of the Centrifugal and Reciprocating systems.
24
![Page 25: NEW FDNY RSOE PRACTICAL Exam...Development Process FDNY and C Squared Contracting company developed this exam with 2 Subject Matter Experts holding Q-01 license with over 70 years](https://reader034.fdocuments.in/reader034/viewer/2022051310/5ffa3321bc78226424683f4c/html5/thumbnails/25.jpg)
Lessons Learned
It is a knowledge test not a memory test. You must have a knowledge of where each of
the components are located and what their functions are.
You must know how to identify inlet piping and outlet piping for chilled water vs condenser water or other systems.
You must know when to use the reference documents to answer the questions.
25
![Page 26: NEW FDNY RSOE PRACTICAL Exam...Development Process FDNY and C Squared Contracting company developed this exam with 2 Subject Matter Experts holding Q-01 license with over 70 years](https://reader034.fdocuments.in/reader034/viewer/2022051310/5ffa3321bc78226424683f4c/html5/thumbnails/26.jpg)
How can schools help? (Graduated students)
For the graduated students: email them the link of the instruction manual.Emphasize that the new exam is very
different from the old practical exam. DO NOT use the same preparation strategy for the new exam.
Emphasize that the instruction manual and tutorial video are critical.
26
![Page 27: NEW FDNY RSOE PRACTICAL Exam...Development Process FDNY and C Squared Contracting company developed this exam with 2 Subject Matter Experts holding Q-01 license with over 70 years](https://reader034.fdocuments.in/reader034/viewer/2022051310/5ffa3321bc78226424683f4c/html5/thumbnails/27.jpg)
How can schools help?(Current/new students)
Prepare students to be a Certified Refrigeration System Operating Engineers by training them: the general layout of the systems and where components
are located and their functions the common operation and maintenance tasks the use and interpretation of the common reference
documents, such as Safety Data Sheet (SDS), Pressure Temperature (PT) chart, Chiller Specification Sheet; Equipment schedules, and Reaction/Separation/Recycle (RSR) Operating Procedure Diagram.
27
![Page 28: NEW FDNY RSOE PRACTICAL Exam...Development Process FDNY and C Squared Contracting company developed this exam with 2 Subject Matter Experts holding Q-01 license with over 70 years](https://reader034.fdocuments.in/reader034/viewer/2022051310/5ffa3321bc78226424683f4c/html5/thumbnails/28.jpg)
New RSOE exam start date
Proposed start date: 09/08/2020. The FDNY will email/provide the scheduled
examinees with the new exam information before their exam. (The beta examinees received the material 4 days before their scheduled exam, and about 1/3 passed the exam.)
28
![Page 29: NEW FDNY RSOE PRACTICAL Exam...Development Process FDNY and C Squared Contracting company developed this exam with 2 Subject Matter Experts holding Q-01 license with over 70 years](https://reader034.fdocuments.in/reader034/viewer/2022051310/5ffa3321bc78226424683f4c/html5/thumbnails/29.jpg)
Exam Materials and Information
We will email the updated PowerPoint to all schools.
The PowerPoint, instruction manual, and tutorial video will be provided on the FDNY website.
29
![Page 30: NEW FDNY RSOE PRACTICAL Exam...Development Process FDNY and C Squared Contracting company developed this exam with 2 Subject Matter Experts holding Q-01 license with over 70 years](https://reader034.fdocuments.in/reader034/viewer/2022051310/5ffa3321bc78226424683f4c/html5/thumbnails/30.jpg)
Questions and Answersin the Seminar
Question: Can examinees watch the tutorial video at the FDNY, then take a 45min walk-through? Answer: No. Examinees must watch the tutorial on their own time and
device before they sit for the FDNY practical exam. The FDNY practical exam will only include the walk-through and the actual exam.
Question: Will examinees who are color blind have a negative experience with the color coding of components on this exam? Answer: No. The color coding of chiller system components used in the
exam is similar to a typical chiller plant. While color coding could help examinees identify components more quickly, knowledgeable examinees can identify and distinguish components by their shapes and locations in the system, without the benefit of color coding. Additionally, there are no questions where examinees must identify equipment of a certain color.
30
![Page 31: NEW FDNY RSOE PRACTICAL Exam...Development Process FDNY and C Squared Contracting company developed this exam with 2 Subject Matter Experts holding Q-01 license with over 70 years](https://reader034.fdocuments.in/reader034/viewer/2022051310/5ffa3321bc78226424683f4c/html5/thumbnails/31.jpg)
Questions and Answersin the Seminar
Question: The centrifugal chiller includes a portable recovery system. Will examinees be required to connect this system to the chiller? Answer: Effectively yes. Examinees will be required to know what
toolbox items are required, the locations where refrigerant hoses must be connected on the recovery system and the chiller, and what position recovery system and chiller valves must be in when hoses are connected and during refrigerant transfer operations. However, the model will not physically show the refrigerant hoses connected to the recovery system or the chiller.
Question: Why would examinees need to view the chiller from the “floor view?” Answer: Similar to a typical chiller system, there are components located
under the evaporator and condenser. The clearest look at these components would likely be from the “floor view.”
31
![Page 32: NEW FDNY RSOE PRACTICAL Exam...Development Process FDNY and C Squared Contracting company developed this exam with 2 Subject Matter Experts holding Q-01 license with over 70 years](https://reader034.fdocuments.in/reader034/viewer/2022051310/5ffa3321bc78226424683f4c/html5/thumbnails/32.jpg)
Questions and Answersin the Seminar
Question: When will the school receive the updated tutorial video and instruction manual? Answer: The updated material will be posted on the
FDNY website around mid August. The schools will also be notified via email.
Question: Anyone who is booked after 09/08/20 must take the new exam? Answer: Correct. Examinees will be provided with
the updated tutorial and instructional manual.
32
![Page 33: NEW FDNY RSOE PRACTICAL Exam...Development Process FDNY and C Squared Contracting company developed this exam with 2 Subject Matter Experts holding Q-01 license with over 70 years](https://reader034.fdocuments.in/reader034/viewer/2022051310/5ffa3321bc78226424683f4c/html5/thumbnails/33.jpg)
Any comment or suggestion?
You can email to provide any further comments or ask questions: [email protected] [email protected]
33