Distributed learning (DL) is a key element of the Army's training strategy, and the Army has ambitious goals for expanding the future use of DL and for changing how it is developed and delivered. Program-level evaluation of DL can play an essential role in accomplishing those goals and in identifying strategic directions for the overall program. This report describes a series of studies designed to develop and test new tools and metrics to assess training and to document the impact of Army DL courses at the program level. More specifically, the studies examined soldiers' experiences in DL and knowledge retention of DL material in training that had both DL and resident phases. The project also assessed the capabilities of Army information systems to support efficient data collection for DL evaluation. Results provide information about the current state of Army DL and point to the need for changes in policies and procedures to improve its effectiveness. These studies also demonstrate the feasibility of evaluating DL within the Army and suggest that a more comprehensive program of assessment, better supported by the Army's information systems, could provide major benefits to The Army DL Program.

"Arroyo Center." "Prepared for the United States Army"--T.p.

Machine generated contents note: ch. One Introduction -- Objectives of This Research -- A Framework for Training Evaluation and Effectiveness -- Organization of This Report -- ch. Two Surveys of Students' Experiences in DL -- Survey Methods -- Results -- Future Administration of Surveys -- ch. Three Knowledge Retention of DL Material in the Phased Approach to Training -- Challenges in Examining the Relationship Between Learning and Soldier Readiness -- Assessment of Knowledge Retention from DL -- Method -- Findings -- Conclusions and Recommendations for Improvement in DL Policies and Procedures -- ch. Four Feasibility of Using Army Information Systems to Collect Training Evaluation Data -- Method -- Findings -- Conclusions and Recommendations to Address Technical and Nontechnical Barriers -- ch. Five Conclusion -- Key Findings -- The Suggested Way Ahead for Army Evaluation of DL -- Final Thoughts -- APPENDIX -- A.Nongraduate Survey -- B.Training Circumstances for Nongraduates -- C.Graduate Survey -- D.Graduate Survey Participant Characteristics -- E.DL Training Circumstances for Graduates -- F.Revised Nongraduate Survey -- G.Revised Graduate Survey -- H.Scoring Procedures for Student Surveys -- I.Questions for Semi-Structured Interviews with SMEs About Army Information Systems -- J.Service-Oriented Architecture.