|
Measuring and Assessing Maneuver Squad Leader Adaptability
Navy SBIR 2016.1 - Topic N161-060 ONR - Ms. Lore-Anne Ponirakis - [email protected] Opens: January 11, 2016 - Closes: February 17, 2016 N161-060 TITLE: Measuring and Assessing Maneuver Squad Leader Adaptability TECHNOLOGY AREA(S): Human Systems ACQUISITION PROGRAM: FNC: Accelerating Development of Small Unit Decision Makers; PoR: MCTIMS OBJECTIVE: To develop an automated measure of adaptability, including the three enabling cognitive constructs of cognitive flexibility, change detection, and anomaly detection, to support U.S. Marine Corps efforts to quantify the small unit decision-making (SUDM) ability of maneuver squad leaders. DESCRIPTION: The U.S. Marine Corps implemented the SUDM initiative in 2008 to enhance the training and education provided to maneuver small unit leaders who must operate in a decentralized manner and make challenging decisions in complex, ill-structured environments. To support this initiative, the Office of Naval Research (ONR) has sought to enable the development of decision training and assessment tools by pursuing research to model SUDM. Research to date has examined SUDM as a multidimensional construct consisting of several hypothesized enabling competencies and Cognitive And Relational Skills (CARS) [2,3]. In all, five competencies and ten CARS have been identified and associated with nine Key Performance Areas (KPA) required of maneuver squad leaders. An initial SUDM Assessment Battery has targeted the assessment of each of these competencies and CARS. To date, the SUDM Assessment Battery addresses 11 of the hypothesized enabling constructs including attentional control, sensemaking, perspective taking, analytical reasoning, self-regulation, and others. The four constructs yet to be adequately measured are adaptability, cognitive flexibility, change detection, and anomaly detection. Adaptability is defined as a competency; cognitive flexibility, change detection, and anomaly detection are supporting CARS that underlie adaptability. Off-the-shelf measures of these four unaddressed constructs have proven inadequate as battery instruments for a number of reasons including inadequate construct validity as it relates to the infantry small unit domain, unacceptable criterion validity, inability to administer without a researcher or on a large scale, and prohibitive licensing costs. The capability sought is an automated, performance-based measure(s) of adaptability and the three CARS for integration into the SUDM Assessment Battery - cognitive flexibility, change detection, and anomaly detection. The performance-based measure(s) must reflect the operational definitions of the constructs as defined by the Maneuver Squad Leader Mastery Model [4], require no more than 30 minutes to complete, and support large-scale administration to infantry E3s-E5s and LTs at The Basic School or Infantry Officer Course (IOC) without the need for a human observer. Ideally, the measure will consist of a performance task assessing the individual�s skill level in support of adapting within a context relevant to squad level infantry operations. Validation of the instrument must demonstrate its ability to predict decision-making performance, discriminate levels of experience or another acceptable criterion measure, and catalog outcome scores according to the five stages of squad leader development as described in the Maneuver Squad Leader Mastery Model. The administration, scoring, and reporting functions of the measure must be automated and transitioned to the Marine Corps Training Information Management System (MCTIMS) for implementation by the USMC. PHASE I: Develop a concept and initial prototypes / mockups of techniques and technologies that are able to measure the adaptability competency and supporting CARS of cognitive flexibility, change detection, and anomaly detection as they relate to infantry squad leader decision making. Required Phase I deliverables will include a final report, Phase II plans, proposed assessment instrument(s) / metrics, and prototypes / mockups. The final report will include evidence-based rationale for the measurement and scoring concept, conceptual integration of the proposed measure with the Mastery Model, and Phase II plans. Phase II plans should include key components, technological milestones, and integration with the SUDM Assessment Battery. Mockups and/or prototypes are also required at the end of Phase I base to demonstrate a proof of concept. Phase I Option, if awarded, should include the processing and submission of all required human subjects use protocols, if required. Due to long review times involved, human subject research is strongly discouraged during Phase I base, but may be appropriate for the option. PHASE II: Required Phase II deliverables will include the construction, demonstration, validation, and application of the adaptability measure proposed as a result of the Phase I effort. Usability and other required testing will be performed on the instrument to insure the effectiveness of the technology for the user audience. All appropriate data collection and psychometric analyses will be performed to insure sufficiency of the instrument and its relationship to the SUDM Assessment Battery, and to establish scoring parameters for the target audience. A final report will document the development and testing of the instrument. PHASE III DUAL USE APPLICATIONS: If Phase II is successful, the contractor will be expected to provide support in transitioning the technology for Marine Corps use as part of the automated SUDM Assessment Battery within the Squad Leader Development Program (SLDP). The contractor will support the Marine Corps with certifying and qualifying the technology for Marine Corps use. Other commercial sectors (e.g., sports), federal agencies (e.g., DHS), or state/local agencies (e.g., police) may be interested in the use of the adaptability measure and could serve as another avenue for transition of the technology. REFERENCES: 1. Headquarters Marine Corps, Plans Policies & Operations. (2015). Squad Leader Development Program (SLDP). Quantico, VA. http://www.hqmc.marines.mil/ppo/UnitHome/SLDP.aspx 2. Ross, K.G., Phillips, J.K., Rivera, I.D., Rosopa, P.J. (2014). Small unit decision making (SUDM) assessment battery final report: Option III. Submitted by Cognitive Performance Group. Orlando, FL. http://www.dtic.mil/get-tr-doc/pdf?AD=ADA614120 3. Headquarters Marine Corps, Training and Education Command. (2011). USMC Small Unit Decision Making Workshop Final Report. Quantico, VA. http://wtri.com/wp-content/uploads/2015/06/SUDMWorkshopReportfinal1.pdf 4. Ross, K.G., Phillips, J.K., Rivera, I.D., Brown, T.F., Smith, K.M., & Hale, K.S. (2012). Final Report for Marine Corps Maneuver Squad Leader Mastery Model. Submitted by Design Interactive, Inc. Oviedo, FL.http://www.dtic.mil/get-tr-doc/pdf?AD=ADA573535 KEYWORDS: Small Unit Decision Making, Decision Making, Adaptability, Cognitive Flexibility, Change Detection, Anomaly Detection TPOC-1: Peter Squire Email: [email protected] TPOC-2: Natalie Steinhauser Email: [email protected] Questions may also be submitted through DoD SBIR/STTR SITIS website.
|