Page 26 - TNR-V01N1

on objectives. If you suspect that some topics might be Instant feedback is a quick and easy way for the
sensitive or have internal political implications, build a participants to provide data. Compiling the information
mechanism to allow for anonymity. Regardless of the tools should be simple. Limit survey questions to either/or
deployed, exercise project teams need to track and report responses. The design team must ensure that tracking
on participation and follow-up when needed. and monitoring of instant feedback is captured on an
ongoing or continuous basis. By deploying a tech-based
Instant Feedback Tools polling method, the results are instantly tallied and stored.
Instant feedback involves getting live or real-time answers Provision of instant reaction is often visible to the entire
during the exercise. Both high and low technology methods team, allowing for quick validation from the group.
of live polling can be used. The simplest is the vote or show
of hands. High tech solutions can involve clicker-based Unfortunately, excessive surveys can disrupt exercise flow
polling systems or cellphone applications. They can be free and detract from realism. Live results could be skewed
or paid. For more dynamic teams, feedback questions can positively or negatively by crowd-think or other social
be posted at the top of whiteboards or flipcharts around behavior. High tech solutions are subject to malfunction
the room. Players are encouraged to post feedback on the and privacy risks.
wall during exercise play. For this method to be successful,
the facilitation team must remind the players of this tool All exercises should include a verbal debrief at the end of
when appropriate. action, encouraging feedback from all participants. The
most senior individual in the room should be the last to
When feedback is provided while the exercise is underway, provide input, as their opinion may taint the response of
all participants can ensure that objectives are being met. others. Make certain that scribes capture all information
The facilitator is able leverage the contingency injects provided in the debrief and/or record it. It will be valuable
if the flipchart associated with one of the objectives is for the report, although this initial ‘gut reaction’ can be
empty or if players are hesitant during a show of hands. If more difficult for report writers to sort by objective. Verbal
only delayed feedback methods are employed, facilitators feedback can be provided by individuals or by preidentified
may not be able to recognize when players have failed to teams. Teams will require additional time to discuss and
achieve one or more of the objectives until long after the then share with the room.
exercise has ended.
Some feedback gathering methods are undertaken during
the exercise but not collected until after play has ended.
These include:

• Feedback forms distributed and gathered during the
exercise or before players leave the room,
• Concealed surveys,
• Scribe notes,
• Observer feedback packages, and
• Instances of ‘encouraged vandalism.’

Encouraged vandalism is when players are asked to
scribble on, scratch out and otherwise make changes to
plans or reference documents provided to the teams at the
exercise. In addition to providing relevant and actionable
recommendations, this reminds planners and players
that plans and tools are living documents, not sacred text.
‘Vandalized’ documentation is gathered after the exercise
and used to support the appropriate objective(s).

Survey Question Example

Did the information provided during the transfer of
command provide all key information required to
recover time critical services?

26
True North RESILIENCE magazine - Fall 2022