POLICY, STANDARDS, MANAGEMENT, AND ACQUISITION

Assessing Training Transformation: Moving from Concept to Reality.. 75

The Joint National Training Capability Mitigation Management Program... 76

CREATING THE JOINT TRAINING GLOBAL ENVIRONMENT.. 76

Performance-Based Financial and Budget Models for Navy Training Ranges.. 77

Achieving Standardized Live-Virtual Constructive Test and Training Interactions via TENA   77

JOINT URBAN OPERATIONS TRAINING TO ACHIEVE FULL SPECTRUM DOMINANCE. 78

COCOMO and SCORM: Cost Estimation Model for Web-Based Training.. 78

Norwegian Defense ADL regulations, Good directions or just plain distractions.. 79

Assessment Integrity: The Dark Side of Distributed Learning.. 79

Taking the Mystery out of Information Assurance for the 21st Century Training Community   80

A DMON Cross Domain Solution (CDS) for Recurring Team Training.. 80

Accreditation Policy and Practice for Immersive Warfighter Simulators.. 81

The Theater Air Ground System Synthetic Battlespace. 81

Inserting Science and Technology Into the Systems Acquisition Process.. 82

ADVANCING SIMULATION REUSABILITY – REPORT ON NATO MSG-042 FINDINGS.. 82

Joint Automated Modeling and Simulation Standards Vetting Tool And Repository   83

 

Assessing Training Transformation: Moving from Concept to Reality

2006 Paper No. 2636

 

Annie Patenaude and Fred Hartman

Office of the Secretary of Defense (USD(P&R))

Washington, DC

 

With the completion in 2005 of the first Block Assessment of Training Transformation (T2), we can point to a successful beginning on the road to transforming joint training - and the larger goal of functioning as a key enabler for force transformation in DoD. The paper will present the assessment process and results, which are not only valuable for the impact on management of joint training but describe a methodology for devising policy metrics.  

 

The Joint Assessment and Enabling Capability (JAEC) in OSD assembled a team of operations research analysts and training experts that developed four areas of assessment: (1) evaluation of program accomplishments against goals in the T2 Implementation Plan; (2) review of key initiatives that the T2 components have undertaken; (3) feedback from stakeholders; and (4) evaluation against independent assessment metrics identified by the study team.  

 

The Block Assessment process and results illuminated the path for future assessments by defining program and management recommendations. The paper will describe our process for metric development, data gathering, and analysis. The final section will describe how we implemented one of the recommendations from the assessment: a persistent assessment framework to synchronize assessment activities at T2-related organizations, including identifying the metrics and training events being assessed.

 

This paper is available on the 2006 I/ITSEC CD ROM.

Order it from I/ITSEC'S Website.

 

 

 

The Joint National Training Capability Mitigation Management Program

2006 Paper No. 2846

 

Lt Col Jeffrey Flory,  Mr. David Carter

US Joint Forces Command

Suffolk, VA

 

Mr. John Kearley

Dynamics Research Corporation

Virginia Beach, VA

 

The Joint National Training Capability (JNTC) mitigation program is designed to improve joint training by providing a process that contributes to the full accreditation of training programs and certification of training sites and systems.  Training programs of the Combatant Commands and Services are nominated to be accredited to conduct training on Joint Tasks, thereby providing a more realistic and consistent joint environment.  In a similar manner, sites are nominated for certification to insure that the associated sites and systems support/supply the joint context required for program accreditation.  The JNTC mitigation program is designed to correct issues and shortfalls identified in the accreditation and certification processes.  The mitigation management process directs JNTC investments to correct these issues and shortfalls by providing reviews and prioritization of issues.  Mitigation of these issues in a timely, efficient, and effective manner is critical to success of the overall effort to increase the delivery of Joint training to forces more frequently and at as many venues as feasible.  The mitigation program tracks an issue or shortfall from its inception through the development and analysis of solutions and budget application, to the fielding of the solution and the post-fielding assessment.  The JNTC budget is designed to provide funding for resolving gaps and seams, thus the mitigation management program is designed to provide oversight and assist in reaching solutions.  This paper provides an overview of accreditation and certification procedures, and provides details on the management of mitigation issues that arise during accreditation and certification reviews.

 

This paper is available on the 2006 I/ITSEC CD ROM.

Order it from I/ITSEC'S Website.

 

 

 

CREATING THE JOINT TRAINING GLOBAL ENVIRONMENT

2006 Paper No. 2738

 

Robert J Hinger

Booz Allen Hamilton

Norfolk, VA

 

Col Daniel Henkel,  

USAF USJFCOM / JWFC

Suffolk, VA

 

The President, Congress, and Secretary of Defense have told the military it must transform to maintain the United States' superiority in the world. Key to this transformation is the training of our forces to conduct joint operations in the future. This paper explains the steps to best accomplish this important goal. Through an understanding of the military training transformations that have occurred throughout history, against the backdrop of today's current realities and force structure, and the knowledge of an informed vision of the future we can develop predictive solutions to the military training problems of tomorrow that will enable not only training transformation but the transformation of the entire military. The paper catalogues the training transformations and adaptations over the past 200 years to help develop the context of what is possible in the future. Then it looks at the current training challenges that are unique to the training community. The paper then relies on the DoD's analytical and subjective directives for the future to develop a solution. A Joint Training Global Environment is the essence of the solution and is key to a future joint training concept which suggests policies, standards, and capabilities that will be required. The solution is broken down into capabilities that allow DoD together with industry to transform training. The global environment will consist of a live-virtual-constructive capability that allows not only training of forces from disparate locations, but of forces from the services, reserves, multinationals, and interagency.  The paper then uses these capabilities in an illustrative example of how the joint training global environment will allow tomorrow's commanders to excel at any mission, in any environment, whenever required. ...

This paper is available on the 2006 I/ITSEC CD ROM.

Order it from I/ITSEC'S Website.

 

 

 

Performance-Based Financial and Budget Models for Navy Training Ranges

2006 Paper No. 2468

 

Michael E. McDevitt & Brian W. Kudrna

CACI International Inc (CACI)

San Diego, CA

 

Michael P. O’Donnell

Naval Air Systems Command (NAVAIR)

Patuxent River, MD

 

The purpose of this paper is to provide a high level summary of the performance-based budget models being developed for Naval Air Systems Command (NAVAIR) Ranges. An initial proof-of concept (POC) was built for the Electronic Combat “Echo” Range at the Naval Air Warfare Center – Weapons Division, China Lake, CA. Since the successful POC, models are being developed for all NAVAIR Training and Test and Evaluation (T&E) ranges. The models use system dynamics – continuous time, continuous flow – simulation software. The commercial off-the-shelf (COTS) software used was Vensim®, which is Navy Marine Corps Intranet (NMCI) certified. This paper details how the Echo Range model works. 

 

The move away from Level-of-Effort (LOE) based budgets for NAVAIR range activities was predicated on the Chief of Naval Operations (CNO) mandate for performance-based models. Additionally, the effort supports cost-wise-readiness approaches to providing training and T&E support services. The budget model is based on the level of services provided at a facility and allows for robust what-if analysis. In the short term, the models can be used to respond to budget reduction drills. In the long term, the models can be used to assess operations and policy changes and their effects on future year budgets.  

 

The model is based on both internal and external customer demand for Training and T&E support services. …

 

This paper is available on the 2006 I/ITSEC CD ROM.

Order it from I/ITSEC'S Website.

 

 

Achieving Standardized Live-Virtual Constructive Test and Training Interactions via TENA

2006 Paper No. 2900

 

Joseph Testa and Kris Wilson

DRS Training & Control Systems, Inc

Fort Walton Beach, FL

 

Mike Aldinger

Northrop Grumman

Orlando, FL

 

Christopher Caruana

FAAC Incorporated

Ann Arbor, MI

 

Various implementations of Live, Virtual, and Constructive (L-V-C) interactions have been demonstrated across numerous test and training ranges over the past few years.  However, the virtual world remains largely disconnected from everyday live test and training activities.  The Test and Training Enabling Architecture (TENA) standard being adopted by the soon to be fielded P5 Combat Training System and the next generation Enhanced Range Application Program presents a host of possibilities for standardized live virtual interactions.  The Air Forces Combat Air Force (CAF) Distributed Mission Operations (DMO) Office, responsible for a distributed, interoperable, high fidelity, global training solution for virtual-constructive Mission Training Systems, is currently implementing a TENA interface as part of their DIS-HLA Portal solution.  This TENA Portal has the potential to link the P5 CTS, EnRAP and DMT systems via a standard TENA interface.  

 

This paper identifies, reviews, and analyzes the current DMO L-V-C effort and near term opportunities to …

 

This paper is available on the 2006 I/ITSEC CD ROM.

Order it from I/ITSEC'S Website.

 

 

JOINT URBAN OPERATIONS TRAINING TO ACHIEVE FULL SPECTRUM DOMINANCE

2006 Paper No. 2933

 

LTC Michael L. Whetstone USA

United States Joint Forces Command, Joint Warfighting Center

Suffolk, VA

 

Full Spectrum Dominance, the key term in Joint Vision 2020, is the ultimate goal of our military forces, now and in the future. The ability to operate unilaterally or in combination with multinational and interagency partners, to defeat any adversary and control any situation across the full range of military operations is the principle. The complexity of Joint Urban Operations (JUO) is the ideal training medium to achieve Full Spectrum Dominance. JUO Training focusing on Expeditionary Forces in a Joint Interagency Intergovernmental and Multinational (JIIM) context and enhanced by the Live, Virtual, and Constructive (LVC) capabilities of the Joint National Training Capability (JNTC) provides the most realistic full spectrum operations training scenarios. The Joint Task Force Headquarters (JTFHQs) and Interoperable Forces must train and plan for the full operational spectrum.  Forming the JTF, planning for and training to conduct Forced Entry, Major Combat Operations, Humanitarian Assistance, Peace Operations, and Homeland Defense/Homeland Security (HLD/HLS) provide the commander with initial mission selection. Joint Forces must also be prepared to execute Stability, Security, Transition, and Reconstruction (SSTR) operations. These operations are highlighted by Interagency/Multinational considerations, governance, and the “Three Block War”. The transformation of the joint force to reach full spectrum dominance rests upon our ability to train in and manipulate the most complex environment, infrastructure, populace and information. Joint Urban Operations Training provides the scenarios and complexity to attain Full Spectrum Dominance.  The briefing provides a view of JUO and Full Spectrum Dominance and how the combination of the two creates a Joint Force that Achieves Warfighting Excellence.

 

This paper is available on the 2006 I/ITSEC CD ROM.

Order it from I/ITSEC'S Website.

 

 

 

COCOMO and SCORM: Cost Estimation Model for Web-Based Training

2006 Paper No. 2474

 

Mike Garnsey and Lacey Edwards

Sparta, Inc.

Orlando, Florida

 

Kelly Ward

General Dynamics

Orlando, Florida

 

Dean Marvin

Joint ADL Co-Lab

Orlando, Florida

 

The Sharable Content Object Reference Model (SCORM) provides a framework that enables standardized delivery and reuse of content for web-based training courses.  In March 2002, the Office of the Secretary of Defense issued the Training Transformation Strategic Plan, which emphasized the need for Advanced Distributed Learning (ADL) and implementation standards like SCORM.  In the next five years the US government will convert hundreds of classroom, correspondence, and computer-based courses to SCORM-conformant courseware.  Members of the training community currently use rules of thumb to estimate the cost of creating courseware, but each company prices courseware differently.  The courseware development community needs an objectively validated algorithm that can be used to estimate project costs independent of specific company processes. 

 

The Constructive SCORM Cost Model (COSCOMO) algorithm applies the concepts behind the Constructive Cost Model (COCOMO) software cost estimation algorithm to SCORM-conformant courseware development projects. This unique new algorithm addresses cost factors such as the size of the project, experience of the team, …

This paper is available on the 2006 I/ITSEC CD ROM.

Order it from I/ITSEC'S Website.

 

 

Norwegian Defense ADL regulations, Good directions or just plain distractions

2006 Paper No. 2607

 

LtCdr. Geir Isaksen, and Major Arne Broberg

NoDADL Section

Oslo, Norway

 

The paper introduces the Norwegian defence (NoD) Advanced distributed learning (ADL) Regulations published early in 2006. After many years of “lawlessness” regarding development and implementation of training, simulation and e-learning defined as ADL, NoD ADL Centre (NoDADLC) was given a task to determine and develop regulations that would release benefits such as reusability, durability, interoperability, affordability and accessibility of all national defence ADL courses. 

 

The time was long overdue to determine national standards and regulations on how to develop and implement ADL within the Norwegian Defence. Up to early 2005 NoD implemented ADL courses that only played on one system, had none or very low reusability, had no lifetime plan, are were not searchable and retrievable. The ADL regulations addresses specific issues such as the use of training need analysis (TNA), technical standards (SCORM, LMS), pedagogical standards and an implementation method. All of these standards and regulations are determined so that all NoD courses for instance can be published directly on the national defence LMS.

 

Based on the evaluation during the spring 2006 the paper discusses how the regulations are received among the target group in the Norwegian armed forces and the practical use of the regulations. The questions is does the directive give good and long demanded regulations and guidance or does it just create disturbance which is to no benefit for the Norwegian Defence and their ADL developers and users?

 

This paper is available on the 2006 I/ITSEC CD ROM.

Order it from I/ITSEC'S Website.

 

 

 

Assessment Integrity: The Dark Side of Distributed Learning

2006 Paper No. 2744

 

Kirk W. McCullough & Marsha M. Jurewicz

Computer Sciences Corporation

Hampton, Virginia

 

The initial development of Distributed Learning took the approach of trying to put first books, and then classrooms onto the Web. During the first decade of Web-based instruction, we have learned that some classroom benefits did not repurpose well, and because of that, some classroom problems were magnified on the Web. 

 

This article puts forth a baseline describing dimensions of on-line testing integrity. It will describe some reasons cheating continues to rise, some methods by which assessment integrity can be violated, and their countermeasures and relative costs. Ensuring the integrity of on-line testing differs from the normal problem of ensuring data integrity. The line where collaboration becomes unethical needs to be clearly understood. This paper is a foundation for determining acceptable levels of risk for integrity measures that should be applied in specific learning instances.

 

This paper is available on the 2006 I/ITSEC CD ROM.

Order it from I/ITSEC'S Website.

 

 

Taking the Mystery out of Information Assurance for the 21st Century Training Community

2006 Paper No. 2611

 

William Kaczor

MTS Technologies

 Orlando, FL

 

Craig Thornley

PEO STRI

Orlando, FL

 

Buddy Guynn

NAVAIR, Orlando

Orlando, FL

 

Information Assurance (IA) is one of the most overlooked yet critical aspects of any Information Technology (IT) system. Although IA applies to every IT system, we will focus on its application to simulators and any IT powered training device connecting to a DoD network. IA is the overarching process consisting of Computer/Network/Data/Information Security. If IA is built into every training and education system, and maintained throughout its life cycle, it is guaranteed to lower compromising threats to DoD assets. 

 

This paper will take the mystery out of IA, system security engineering, and the security Certification and Accreditation (C&A) process from both government and industry perspectives. It will provide proven solutions to achieve C&A on any system under differing conditions and time frames, and document the process of IA using proven systems security engineering processes, the DoD Information Technology Security Certification and Accreditation Process (DITSCAP), and the documentation strategy of using the System Security…

 

This paper is available on the 2006 I/ITSEC CD ROM.

Order it from I/ITSEC'S Website.

 

 

A DMON Cross Domain Solution (CDS) for Recurring Team Training

2006 Paper No. 2775

 

Bonnie Danner, CISSP and Bruce McGregor

Northrop Grumman

Orlando, Florida

 

Tony Valle, Ph.D.

Sparta

Orlando, Florida

 

Robust multi-level security (MLS) and compartmented security cross domain solutions (CDS) are necessary to achieve the Distributed Mission Operations (DMO) vision to have warfighters train as they fight.  This paper describes achievements and challenges for a Distributed Mission Operations Network (DMON) cross domain production capability to be implemented in December 2006.  This paper addresses the key technical and policy challenges for a guard-based CDS implementation.  There are significant steps required for a new simulation guard application to achieve Protection Level 3 security certification and accreditation (C&A) in accordance with Joint Air Force, Army Navy (JAFAN) 6/3 security guidance.  This paper describes the processes performed, the technical and policy achievement applying lessons learned for guard implementation and the associated certification and accreditation activities. 

 

This paper is available on the 2006 I/ITSEC CD ROM.

Order it from I/ITSEC'S Website.

 

 

 

Accreditation Policy and Practice for Immersive Warfighter Simulators

2006 Paper No. 2999

 

Robert M. Chapman

Headquarters Air Combat Command

Langley AFB, VA

 

Immersive simulators are needed for substantive joint warfighter training, yet the policies and practices which can help ascertain the accuracy and credibility of these complex systems are not well developed. This paper uses an ongoing effort by Air Combat Command to modify its simulator accreditation process for fighter, bomber, and C2ISR simulators as an example of the challenges in developing appropriate validation and accreditation policies for warfighter training. The paper will review current verification, validation, and accreditation (VV&A) policies and practices in the academic, Department of Defense, and Federal Aviation Agency domains as well as the Air Force simulation certification program. While necessary, these policies and practices are not sufficient for judging the credibility of flight simulators when the purpose of the simulator training is expanded to mission-level knowledge and skills. By focusing on the purpose of DMO simulators are expressed in the concepts of immersiveness, instructional integration, and interoperability, we can collect more evidence for accreditation decisions. The paper concludes with recommendations on areas of further research and policy refinements.

 

This paper is available on the 2006 I/ITSEC CD ROM.

Order it from I/ITSEC'S Website.

 

 

 

The Theater Air Ground System Synthetic Battlespace

2006 Paper No. 2552

 

Ricky R. Ales

HQ ACC A3YC (General Dynamics Contr Sup)

Langley AFB, VA

 

Steven G. Buhrow

HQ USAF A3OY (General Dynamics Contr Sup)

Arlington VA

 

The Theater Air Ground System (TAGS) elements have no persistent common synthetic battlespace in which to train.  Because the TAGS includes the operational and tactical levels of war, it requires vertical and horizontal systems integration within components and between components.  This has long been a training challenge due to limitations on exercises, ranges, and airspace allowing the live participation of air and ground forces.  Planning, coordinating, tasking, controlling, and assessing can be the hardest aspects of Joint operations, yet we do not have the continuation training tools to enable us to do this regularly and affordably.  Relying solely on large-scale Joint training events is too expensive, infrequent, and can lead to readiness shortfalls and operational risk.  

 

This paper will define an initiative that will leverage systems integration of ongoing Joint Live, Virtual and Constructive simulation for TAGS training to include each Service’s distributed command and control (C2) training network and the Joint National Training Capability (JNTC).  It will focus on multi-Service efforts in developing a Joint Theater Air Ground Simulation System (JTAGSS) to link horizontal and vertical simulation elements of the C2 kill chain.  This includes Joint Terminal Attack Controllers (JTACS), Joint Fires Observers (JFOs), Air Support Operations Centers (ASOC), Fire Support Cells (FSC) and eventually to Joint Air Operations Centers (JAOC) for persistent Joint and component training. 

 

This paper is available on the 2006 I/ITSEC CD ROM.

Order it from I/ITSEC'S Website.

 

 

 

Inserting Science and Technology Into the Systems Acquisition Process

2006 Paper No. 2937

 

CDR Dylan Schmorrow

Office of Naval Research

Arlington, VA

 

LCDR Joseph Cohn

Office, Deputy Chief of Naval Operations

Washington DC

Amy Bolton

Strategic Analysis Inc.

Arlington, VA

 

One of the most pressing challenges facing managers of basic science, applied research and advanced technology is inserting the knowledge, components and products produced in Science and Technology (S&T) programs into acquisition programs of record. Over the past decade, the US Navy and Marine Corps have had several documented successes in merging basic S&T products into the DoD acquisition process. In this paper, the Office of Naval Research’s Virtual Technologies and Environments (VIRTE) program is presented as a successful case study for how scientific exploration and advanced technology development can be integrated with the systems acquisition process to provide today’s Warfighter with validated, effective training tools. Over six years, the VIRTE program focused on using a modified form of the Instructional System Design (ISD) process combined with management oversight techniques such as Virtual Product Teams and Intermediate Feasibility Experiments, to develop Virtual Environment based solutions to target a range of US Navy and Marine Corps training gaps. The process was adapted from elements of the DoDI 5000.2 Acquisition Management Framework, particularly those that deal with User Needs and Technology Opportunities at the Pre-Systems Acquisition stage….

 

This paper is available on the 2006 I/ITSEC CD ROM.

Order it from I/ITSEC'S Website.

 

 

ADVANCING SIMULATION REUSABILITY – REPORT ON NATO MSG-042 FINDINGS

2006 Paper No. 2685

 

LCdr. Angel San Jose  (ESP-NAV)

NATO-RTA-MSCO

NEULLY-SUR-SEINE, France

Lt. Sabas Gonzalez-Godoy

CGE -JCISAT -Subdireccion CIS

Madrid, Spain

Mr. Robert Elliott

National Defence Headquarters, CFEC/SECO

Ottawa, Ontario, Canada

LCol. Xavier Lecinq

DGA/DET/SAIS

Issy les Moulineaux, France

Mr. Stefan Franzen

Guidance and Co-Ordination Office for M&S BWB

Koblenz, Germany

Wim Huiskamp

TNO Defence, Security and Safety

The Hague, The Netherlands

Mr. Bernardo Martínez Reif

ISDEFE System Engineer

MADRID, SPAIN

Mr. David Edmondson

DSTL

Farnborough, UK

 

 

Ms. Wanda D. Wharton

Headquarters, Department of the Army

Washington DC, USA

Ms. Lana McGlynn

McGlynn Consulting Group

Arlington VA, USA

 

 

In many cases, the training and decision support needs of military users are urgent; operations cannot wait and missions have to be accomplished. Simulators, wargames scenarios and experiments should be ready 'yesterday'. New kinds of operations, environments, tactics, equipment and force configurations challenge our simulation capacities. To mitigate the cost impact and meet the time sensitive requirements, the M&S community has to be 'ready in advance'. This objective may be brought nearer by reusing resources that have been previously developed, possibly by external organizations, and reconfiguring and assembling these resources according to the current needs. Today, more than ever, warfighting excellence is related to the level of reusability of M&S resources. …

 

This paper is available on the 2006 I/ITSEC CD ROM.

Order it from I/ITSEC'S Website.

 

 

 

 

Joint Automated Modeling and Simulation Standards Vetting Tool And Repository

2006 Paper No. 2481

 

William Oates and Don Johnson

Air Force Agency for Modeling and Simulation

Orlando, FL

 

Donna A. Groden

Northrop Grumman Corporation

Orlando, FL

 

The Air Force (AF) was the only service without a functioning standards program for its Modeling and Simulation (M&S) initiative.  This produced an ineffective M&S program which suffered from its inability to effectively integrate live, virtual and constructive simulations within the AF training centers and externally with inter-service, Joint and industrial M&S agencies.  To address this operational and technical problem, the Air Force Agency for Modeling & Simulation (AFAMS) envisioned and worked with its sister-Services, the Defense Modeling and Simulation Office (DMSO), and the Joint National Training Capability (JNTC) to implement an integrated, collaborative M&S standards program that dove tailed with all Services, Department of Defense (DoD) and Joint M&S standards activities.  AFAMS’ design included a cross-cutting common M&S organization structure, an implementation plan, a common vetting process and a web-based collaborative vetting and repository tool.  Their program was selected as the common, integrated DoD/Joint M&S standards program.  When fully employed, all DoD M&S organizations will use the AF M&S standards program for nominating, evaluating and advocating common and effective M&S standards for community use.  The effect will be immediate and significant as the traditional three to five year M&S standards vetting process will be reduced to months resulting in a significant cost savings.  Furthermore, the DoD-wide, common integrated approach for vetting M&S standards will significantly enhance information sharing to improve validated standards use, reuse and composability.

 

This paper is available on the 2006 I/ITSEC CD ROM.

Order it from I/ITSEC'S Website.