FEMA IS 130: Exercise Evaluation And Improvement Planning Answers

FEMA provides really valuable Tests and Exercises. There are many different exams under their different programs. Here we have studied and taught our students in order to train them. All answers are sourced and many different professionals have helped to find the best answers.

About FEMA IS 130: Exercise Evaluation and Improvement Planning

FEMA IS 130: Exercise Evaluation and Improvement Planning Answers has 60 questions. These Questions are given below. Learning is free and so is this page. We recommend studying well and practicing and check the answers in case you get stuck in a doubt.

1. Determine whether the statement(s) below is true or false.
The goal of data analysis is to evaluate the ability of exercised functions to perform target capabilities.

A. True

False

2. The description below presents guidelines for information collection. Determine whether these guidelines are more appropriate for discussion- or operations-based exercises.

Evaluators should pay particular attention to WHAT actions took place; WHO performed an action or made a decision; WHERE an action or decision took place; when an action or decision took place; WHY an action was performed or a decision was made; and HOW participants performed an action or made a decision.

A. Operations-based exercises.

Discussion-based exercises.

3. Determine whether the statement(s) below is true or false.

Whether standard or customized, objectives should be SMART—Simple, Measurable, Achievable, Realistic, and Territory-Specific (SMART).

A. True

False

4. Several responsibilities of the Lead Evaluator are listed below. Select the responsibility that is NOT correctly described.

Before the exercise, the Lead Evaluator’s responsibilities include:

Selecting the evaluation methodology.

B. Securing sufficient funding for the exercise.

Ensuring the selection of appropriate evaluation forms.

Selecting, training, and organizing the evaluators.

5. Determine whether the statement(s) below is true or false.

When complete, the draft After Action Report/Improvement Plan (AAR/IP) is presented in the After Action Conference. The After Action Conference allows evaluators to share key findings for feedback and validation.

A. True

False

6. The description below presents guidelines for information collection. Determine whether these guidelines are more appropriate for discussion- or operations-based exercises.

Evaluators should pay particular attention to issues identified by participants; how participants make decisions; participant roles and responsibilities; participant coordination and cooperation; and recommendations from the group.

Operations-based exercises.

B. Discussion-based exercises.

7. Determine whether the statement(s) below is true or false.

During evaluator training, the trainer should not distribute exercise documents such as the Evaluation Plan, jurisdictional plans, agendas, Exercise Evaluation Guides (EEGs), and assignments. When received before the exercise, these documents bias the observations of evaluators.

True

B. False

8. Determine whether the statement(s) below is true or false.

Evaluators typically convene a more formal meeting after the Evaluator Debriefing. The purpose of the second meeting is to craft scenarios for future exercises.

True

B. False

9. Determine whether the statement(s) below is true or false.

After the exercise, each evaluator should gather his or her observations into key issues and a chronological narrative of events. When organized, these observations form the evaluator’s preliminary analysis.

A. True

False

10. Determine whether the statement(s) below is true or false.

Jurisdictions should avoid using a standardized format for the After Action Report/Improvement Plan (AAR/IP) because the AAR/IP should reflect community-specific realities.

True

B. False

11. Determine whether the statement(s) below is true or false.

Once the final After Action Report/Improvement Plan (AAR/IP) is distributed, agencies and organizations use these documents to direct resources toward improvements.

A. True

False

12. Determine whether the statement(s) below is true or false.

After the After Action Conference, the Exercise Planning Team incorporates participant corrections and clarifications into the finalAfter Action Report/Improvement Plan (AAR/IP).

A. True

False

13. Determine whether the statement(s) below is true or false.

The player hotwash is an opportunity for players to describe their immediate impressions of

demonstrated capabilities and the exercise itself.

A. True

False

14. Select the phrase that does NOT accurately complete the sentence below.

The After Action Report/Improvement Plan (AAR/IP) format includes:

Exercise goals and objectives.

Exercise overview.

C. Preparedness limitations.

Analysis of capability.

15. Determine whether the statement(s) below is true or false.

both discussion-based and operations-based exercises, evaluators identify issues by comparing exercise objectives to actual performance. Through this comparison, evaluators identify which objectives were successfully demonstrated and which need improvement.

A. True

False

16. Select the item that is NOT a component of Exercise Evaluation Guides (EEGs).

Observation keys.

Capability description.

C. Initials of approving authority.

Analysis sheets.

17. Determine the type of observation described below.

This type of observation is the direct inspection and documentation of actions listed on evaluation forms. It is illustrated by the question, “Did fire suppression occur within the target timeframe identified in the objective?”

Inferential Reporting.

B. Descriptive Reporting.

Analytical Reporting.

Evaluative Reporting.

18. Select the phrase that does NOT accurately complete the sentence below.

When finalizing the After Action Report/Improvement Plan (AAR/IP), the Exercise Planning Team matches it to the needs of participating jurisdictions. It also ensures that AAR/IP is a useful tool to guide the following areas:

Sharing of lessons learned with homeland security community partners.

Strategy development.

C. Securing funding for the coming fiscal year.

Changes to plans, policies, and procedures.

19. Select the phrase that does NOT accurately complete the sentence below.

The Exercise Planning Team has six major responsibilities when preparing for the exercise. They include:

Recruiting, Assigning, and Training Evaluators.

Developing Evaluation Requirements.

C. Appointing multiple Lead Evaluators.

Finalizing an Evaluation Plan.

20. Select the item that is does NOT accurately complete the sentence below.

Evaluator training should occur at least one day prior to the exercise. It should:

Introduce evaluators to the players they will observe during exercise play.

Address all aspects of the exercise, including exercise goals and objectives.

C. Explain approaches to analyzing data.

Provide an overview of evaluator roles, responsibilities, and assignments.

21. Determine the evaluator effect described below.

This effect occurs when evaluators believe it is their job to find something wrong, regardless of the players’ performance.

Hypercritical Effect.

Errors of Central Tendency.

C. Evaluator Bias.

Contamination.

22. Four responsibilities of the Exercise Planning Team are listed below. Select the step that is NOT correctly described.

Selecting Exercise Evaluation Guides (EEGs). The Exercise Planning Team will select EEGs that correspond to key capabilities under evaluation, based on the exercise objectives.

Developing Evaluation Requirements. The Exercise Planning Team defines plans, documents, and personnel necessary to observe and analyze the exercise.

C. Identifying and Training Evaluators. The Lead Evaluator and Exercise Planning Team determine evaluator qualifications, obtain commitments from qualified individuals, and begin the evaluator training.

Selecting Evaluation Tools. The Lead Evaluator and Exercise Planning Team select supplementary exercise evaluation forms and submit them for approval by state and Federal response agencies.

23. Select the phrase that does NOT accurately complete the sentence below.

a minimum, an evaluator’s preliminary analysis should include:

Analysis of the assigned function or operation by capability, activity, and critical task.
B. A description of the assigned function or operation.
C. A documented record of significant evaluated actions (for example, an exercise event timeline)

D. A peer review detailing areas of improvement for other evaluators.

24. Determine whether the statement(s) below is true or false.

There are two main benefits of conducting exercises: individual and team training (i.e., the exercise enables personnel to gain experience) and system improvement (i.e., the exercise tests processes and procedures for managing emergencies).

A. True

False

25. Several responsibilities of the Lead Evaluator are listed below. Select the responsibility that is NOT correctly described.

After the exercise, the Lead Evaluator’s responsibilities include:

Coordinating the involvement of evaluators in post-exercise meetings.

Overseeing the analysis of data collected from evaluators.

C. Assigning responsibility for improvement actions to participating agencies.

Guiding the development of the Improvement Plan (IP).

26. The last four steps of HSEEP can be grouped into the category of improvement preparedness. From the list below, select the step that does NOT belong in this category.

A. Place Purchase Orders for Additional Equipment.

Conduct an After-Action Conference.

Track Implementation.

Identify Improvements to be Implemented.

27. Determine whether the statement(s) below is true or false.

After identifying issues and their root causes, evaluators develop recommendations for enhancing preparedness. Since these recommendations are legally binding, evaluators should suggest actions that require minimal resource commitments.

True

B. False

28. Determine the type of observation described below.

This type of observation requires the evaluator to arrive at a conclusion before recording information. It is illustrated by the question, “Is the fire suppression capability adequate?”

A. Inferential Reporting.

Descriptive Reporting.

Analytical Reporting.

Evaluative Reporting.

29. Determine whether the statement(s) below is true or false.

Once the final After Action Report/Improvement Plan (AAR/IP) is distributed, the jurisdiction can downsize its preparedness activities. This is because the exercise fulfills the jurisdiction’s legal responsibility to prepare for catastrophic events.

True

B. False

30. Select the phrase that BEST completes the sentence below.

Long after the exercise is over, the jurisdiction’s program managers will track and analyze the implementation of exercise recommendations. By doing so, the jurisdiction engages in a:

Continual Improvement Plan (CIP).

Preparedness Improvement Cycle (PIC).

Corrective Improvements Process (CIP).

D. Corrective Action Program (CAP).

31. Determine whether the statement(s) below is true or false.

Evaluations are only effective if evaluators perform systematic observation and generate unbiased records. An unbiased record is an account that reflects the consensus of multiple evaluators.

A. True

False

32. Determine the level of performance described below.

analysis of this level of performance assists executives in developing operating plans and budgets, communicating with political officials, setting long-range training and planning goals, and developing inter-agency and inter-jurisdictional agreements.

Activity-Level Performance.

Task-Level Performance.

Item-Level Performance.

D. Capability-Level Performance.

33. Determine whether the statement(s) below is true or false.

Player hotwashes should be held approximately one week after the exercise is complete, so that players have time to review and reflect on exercise events.

True

B. False

34. Select the phrase that best completes the sentence below.

Since September 11, 2001, Federal, State, and local governments have made major investments to improve preparedness. The best way to determine the impact of these investments is to:

A. Conduct and evaluate preparedness exercises.

Hire independent auditors on an annual basis.

Evaluate the community’s response to real-life incidents.

Read homeland security periodicals and newsletters.

35. Determine whether the statement(s) below is true or false.

Time constraints should not impact the selection of evaluators, because exercise evaluation requires a minimal time commitment. The role of evaluators is limited to observation of exercise play, which typically lasts one to two days.

True

B. False

36. Determine whether the statement(s) below is true or false.

During data analysis, evaluators assess the response capability of the local community. They then compare the local community with communities of comparable size across the nation.

True

B. False

37. Determine whether the statement(s) below is true or false.

After discussion-based exercises, evaluators reconstruct a timeline of events that occurred during the exercise. The purpose of this timeline is to assess whether actions occurred within target timeframes; identify discrepancies between what happened and what should have happened; and clarify why players made decisions.

A. True

False

38. Determine whether the statement(s) below is true or false.

During post-exercise analysis, evaluators compare actual events with performance measures.

A. True

False

39. The first four steps of HSEEP can be grouped into the category of evaluation planning, observation, and analysis. From the list below, select the step that does NOT belong in this category.

Observe the Exercise and Collect Data.

Plan and Organize the Evaluation.

C. Distribute Data for Public Comment.

Analyze Data.

40. Determine whether the statement(s) below is true or false.

After the exercise is complete, evaluators identify discrepancies between what happened and what was supposed to happen. They use root-cause analysis to identify the source of these discrepancies.

True

B. False

41. Select the phrase that does NOT accurately complete the sentence below.

Evaluators should:

Be familiar with the jurisdiction’s plans, policies, procedures, and agreements.

Be experts in the activities they evaluate.

Be familiar with the evaluation system.

D. Possess an advanced degree in a relevant functional area (e.g., fire or emergency medicine).

42. Determine whether the statement(s) below is true or false.

Exercise Evaluation Guides (EEGs) are designed to assess a community’s preparedness in target capabilities. The capabilities on the EEGs correspond to those listed on the Target Capabilities List (TCL).

A. True

False

43. Select the phrase that does NOT accurately complete the sentence below.

addition to the hotwash, evaluators meet separately shortly after the exercise. This meeting is the Controller/Evaluator Debriefing. It allows evaluators to:

A. Summarize findings for distribution to key officials.

Review results of the hotwash and participant feedback forms.

Refine evaluation documents.

compare notes with other evaluators.

44. Select the phrase that does NOT accurately complete the sentence below.

For every improvement recommendation, attendees must complete multiple categories on the Improvement Plan (IP) matrix. These categories include:

A. Recommendations.

Tasks.

Authorizing statute.

Improvement actions.

45. Determine the level of performance described below.

analyzing this level of performance, evaluators gain valuable insight into broad “themes” of successes or challenges in performing related tasks.

A. Activity-Level Performance.

Task-Level Performance.

Item-Level Performance.

Capability-Level Performance.

46. Select the phrase that does NOT accurately complete the sentence below.

The After Action Report/Improvement Plan (AAR/IP) serves multiple purposes. Specifically, it:

A. Outlines the emergency response funding for the coming year.

Records what occurred during the exercise.

Suggests recommendations for improved preparedness.

Provides feedback on the achievement of critical tasks.

47. Select the phrase that BEST completes the sentence below.

One common tool for root-cause analysis is:

A. The “why staircase.”

The root-result analysis.

The action-outcome framework.

The “core question” method.

48. Select the phrase that does NOT accurately complete the sentence below.

Recommendations for improvement should:

A. Be broad enough to support multiple interpretations.

Identify areas to sustain or improve.

Identify references for implementation.

Address both short- and long-term solutions.

49. Determine whether the statement(s) below is true or false.

The output of exercise evaluation is information used to improve performance. For this reason, exercise evaluation is part of an ongoing process of improvements to preparedness.

A. True

False

50. Determine whether the statement(s) below is true or false.

the Improvement Plan (IP) matrix, each action item should be assigned to the organization that is best qualified to execute it. It is important that organizations that are assigned action items have the authority to carry them out.

A. True

False

51. Determine whether the statement(s) below is true or false.

The After Action Conference should be lecture-based; the time for community participation and discussion is during the design and delivery of the exercise.

True

B. False

52. Select the phrase that does NOT accurately complete the sentence below.

Data sources for the DRAFT After Action Report/Improvement Plan (AAR/IP) include:

Data from the Controller/Evaluator Debriefing.

B. Data from the After Action Conference.

The plans and procedures of participant organizations.

Data from and Participant Feedback Forms.

53. Determine whether the statement(s) below is true or false.

Evaluation is a discrete step in the exercise process. For this reason, the evaluation strategy can be determined even after the exercise is complete.

True

B. False

54. Determine whether the statement(s) below is true or false.

The analysis of capability section of the After Action Report/Improvement Plan (AAR/IP) provides an assessment of capabilities that were evaluated during the exercise. The analysis should include a detailed analysis of the jurisdiction’s ability to perform critical tasks associated with these capabilities.

A. True

False

55. Select the phrase that BEST completes the sentence below.

HSEEP offers tools and resources to support exercise planners throughout its eight-step process. These tools include:

The Plan for Enhanced Preparedness (PEP) Template.

B. The After Action Report/Improvement Plan (AAR/IP) Template.

The After-Conference Debriefing Report (ADR) Template.

Exercise Assessment Handbook (EAH).

56. Determine whether the statement(s) below is/are true or false.

Corrective actions must include attainable benchmarks that will allow the jurisdiction to measure progress towards their implementation. These benchmarks should be defined against concrete deadlines so the jurisdiction can track gradual progress toward implementation.

A. True

False

57. Select the phrase that does NOT accurately complete the sentence below.

Each analysis of capability should include:

The capability’s title and number from the Target Capabilities List (TCL).

The appropriate capability.

C. Performance measures that correspond to the capability.

Percentage of achieved tasks (indexed to national average).

58. Select the phrase that does not accurately complete the sentence below.

Objectives should be descriptions of the performance expected of players. They should also:

A. Enhance accountability by naming the person responsible for the action.

Be straightforward and easy to read.

Focus on specific operations, not wide-ranging or multi-part missions.

Be achievable within reasonable resource commitments.

59. Determine whether the statement(s) below is true or false.

Jurisdictions are expected to hire dedicated staff members to act as Corrective Action Program Points-of-Contact (POC). These POCs represent a significant expenditure, but they return the investment in terms of preparedness improvements.

True

B. False

60. Select the phrase that does NOT accurately complete the sentence below.

The four steps of data analysis include:

Identifying issues.

Reviewing the exercise for sound methodology.

C. Developing recommendations for improvement.

Determining root causes.