All material on this web site is copyrighted by Honourcode, Inc. 1999-2018.

Principles of Test & Evaluation

Test and evaluation provide the means to ensure that a product perfoms in the intended way and with the intended results. Testing starts very early in a product system development, however, because test planning is dependent on good requirements. This course is an overview of test and evaluation from product concept through operations, including:

  • Creating good test requirements
  • Test planning for complete coverage
  • Test conduct during integration and verification
  • Data collection, analysis, and reporting

This course provides an overview of test and evaluation (T&E) principles and methods for complex systems, including T&E tasks from beginning to end of a project. Topics include test requirements, test planning, verification and validation methods, development testing, integration testing, test conduct, record-keeping, analysis, test reporting, test data management. Course work includes a case study in several parts, practicing the techniques learned.

Drawing from decades of accumulated knowledge in system development, this course provides you with highly effective tools to use in your work. The material is augmented by examples from real-life experience, including participative examples from the attendees.

Register here to receive more information on our courses.

Attend this course if you are:

  • A key member of a system or product development team
  • Interested in the test and evaluation methods
  • Concerned about how to prove the product
  • Looking for practical methods to use

The course is aimed at

  • Test Engineers
  • Design Engineers (any engineering discipline)
  • Project Engineers; Technical Team Leaders
  • System Support Leaders
  • Technical and Management Staff
  • Project Managers

This course can be scheduled at your facility. Contact us at

Course Topics

What is Test & Evaluation? – Basic definitions and concepts for the course. Test and evaluation overview; application to complex systems, relationship to other engineering and management disciplines. Roles of test and evaluation throughout product development, test phases (requirements, planning, conduct, analysis & reporting), correlation with program phases.

Test and Evaluation Model – An underlying process model that ties together all the concepts and methods. Verification and validation principles, verification methods (Inspection, Analysis, Demonstration, Test,), Verification vs. Test, Verification vs. Validation, Test and evaluation processes in each model step.

Test Requirements – Requirements as the primary method for measurement and control of systems development. Where requirements come from; how to evaluate requirements for testability; how to derive test requirements from higher level requirements. Quantifying an operational need; analyzing missions and environments; defining performance, interface, and constraint requirements; evaluation of requirements for testability; deriving test requirements; the importance of a requirements verification matrix (RVM); Qualification vs. Acceptance requirements; design proof vs. first article vs. production requirements.

Test Planning – Evaluating the system concept to plan verification and validation by test. Trade-offs involved in test decisions; maturity at different phases; level of detail. System analysis for test planning; analyzing and evaluating alternatives; test resource planning; establishing a test baseline; developing a test schedule; change management; Test and Evaluation Master Plan (TEMP); tisk management as a test planning tool.

Integration Testing – How to successfully manage the intricate aspects of system integration testing; level of integration planning; managing complex system integration; work-arounds. Development test concepts; integration test planning (parallel/serial test sequencing, scheduling); preferred order of events; component testing; conducting integration tests for complex systems; work-arounds for anomalies and failures.

Test Conduct – How to perform testing; differences in testing for design proof, first article qualification, recurring production acceptance; rules for test conduct. Testing for different purposes, verification vs. validation; test procedures and test records; prerequisites management; readiness certification, test constraints, test article configuration; troubleshooting and anomaly handling; measures of success and indicators of difficulty; test tools.

Data Collection, Analysis, and Reporting – Statistical methods; test data collection and analysis; report formats and records

Continuing Education: This course qualifies for 1.4 CEUs or 14 PDUs

Qualified Instructors for this course

Dr. Eric Honour, CSEP, INCOSE Fellow, and former INCOSE President, has been in international leadership of the engineering of systems for over 20 years, part of a 40+ year career of complex systems development and operation. His energetic and informative presentation style actively involves class participants. He was the founding Chair of the INCOSE Technical Board in 1994, and served as Director of the Systems Engineering Center of Excellence (SECOE). He was selected in 2000 for Who’s Who in Science and Technology and in 2004 as an INCOSE Founder. He is on the editorial board for Systems Engineering. He has been a successful entrepreneur, systems engineer, engineering manager, and program manager at Harris Information Systems, E-Systems Melpar, and Singer Link, preceded by nine years as a US Naval Officer flying P-3 aircraft. He has led or contributed to the development of 17 major systems.. Dr. Honour has a BSSE (Systems Engineering) from the US Naval Academy, MSEE from the Naval Postgraduate School, and PhD from the University of South Australia based on his ground-breaking work to quantify the value of systems engineering. Dr. Scott Workinger has led innovative technology development efforts in complex, risk-laden environments for 30 years in the fields of manufacturing (automotive, glass, optical fiber), engineering and construction (nuclear, pulp & paper), and information technology (expert systems, operations analysis, CAD, collaboration technology). He currently teaches courses on program management and engineering and consults on strategic management and technology issues. Scott has a B.S in Engineering Physics from Lehigh University, an M.S. in Systems Engineering from the University of Arizona, and a Ph.D. in Civil and Environment Engineering from Stanford University.
Mr. Glen Francisco (CSEP, PMP) has over 17 years of experience developing new technologies, service, products, and applications for both private and government uses. He has a personable, engaging teaching style that keeps a class alive with information. He has worked as an engineer, Lead Systems Engineer, Project Engineer and Program Manager for a number of military & commercial companies to include Boeing (McDonnell Aircraft Company), Lockheed Martin (Martin Marietta), Texas Instruments, Raytheon, ELCAN Optical and DRS Technologies. His product systems have supported security surveillance, paramilitary (fire, police & EMS), automotive and industrial markets using passive thermal imaging technologies and other wavelength illuminated electo-optical imaging laser radar technologies. He was selected in the 2006 Marquis Publication of Who’s Who in America. Glen has presented over a dozen papers at security & defense symposium. He holds multiple patents in active terminal guidance missile trajectory control and low cost plastic thermal management. He is a firefighter, emergency medic, firefighting instructor, and private pilot. He developed & introduced Thermal Imaging Cameras into the firefighting market in 2001, technology saving hundreds of lives and millions of dollars in property. John Pratchios has over 40 years experience as a systems engineer designing, implementing and supporting complex hardware/software systems development. His work has included design and implementation of military command, communications, surveillance, and information systems, and also systems for weather imagery, publications control, and locomotive/train control. He is an engaging instructor with a warm, informal, knowledgeable presentation style. He has presented courses to military, Department of Energy, contractor, and college organizations. He is an expert in classical systems engineering including requirements management, system design, production liaison, hardware/software integration, program management, risk mitigation, and technical leadership. He is a specialist in architectural development of both centralized and distributed systems including DODAF and other types of analysis and model development for entire system performance/throughput estimation and validation. His experience includes Object Oriented software analysis & design using UML, Booch, Ellis RTOOSA, and other OOA/OOD methodologies. Working at Harris Corporation, E-Systems, and for the Navy, John has led or contributed to the development of over a dozen major systems including the Multi-Threat Emitter System (MUTES), the Transformational Satellite Management Operations System (TMOS), locomotive radio remote control systems, and the highest capacity and throughput system ever fielded by Harris Publishing Systems. John has a BSEE from the US Naval Academy, MSEE from the Naval Postgraduate School, and further post-graduate work.

Page last modified 10 Nov 16