Experimentation is the lynch pin in the DoD's strategy for transformation. Without a properly focused, well-balanced, rigorously designed, and expertly conducted program of experimentation, the DoD will not be able to take full advantage of the opportunities that Information Age concepts and technologies offer. Therefore, experimentation needs to become a new DoD core competency and assume its rightful place alongside of our already world-class training and exercise capabilities. This Code of Best Practice (COBP) was developed to accelerate the process of our becoming more aware of the issues involved in planning, designing, and conducting experiments and using experiment results, and to provide support to individuals and organizations engaged in a variety of experimentation activities in support of DoD transformation. This "Code of Best Practice" is intended to increase awareness and understanding of the different types of experimentation activities that the DoD needs to employ in order to inform the transformation, articulate a useful set of organizing principles for the design and conduct of experiments and experimentation campaigns, provide both producers of experiments and consumers of experimentation results with "best practice" and lessons learned, provide future experimenters with a firm foundation upon which to build, and to promote a degree of scientific rigor and professionalism in the DoD experimentation process.

Introduction -- Transformation and experimentation -- Overview of experimentation -- The logic of experimentation campaigns -- Anatomy of an experiment -- Experiment formulation -- Measures and metrics -- Scenarios -- Data analysis and collection plans -- Conduct of the experiment -- Products -- Model-based experiments -- Adventures in experimentation: common problems and potential disasters -- Appendix A: Measuring performance and effectiveness in the cognitive domain -- Appendix B: Measurement hierarchy -- Appendix C: Overview of models and simulations -- Appendix D: Survey.