Lessons Learned in Utilizing the SETR Process in the Procurement of TPSs on the CASS Family of Testers

Programmatic improvements can be achieved through the incorporation of “lessons learned” from preceding projects in the acquisition of Consolidated Automated Support System (CASS) Family of Testers (FoT) Operational Test Program Sets (OTPS). The application of the Systems Engineering Technical Review (SETR) process to CASS FoT OTPSs presents unique challenges. Adhering to policy and minimizing impact to total lifecycle costs (TLC) have differing goals. However, lessons can be extracted from previous CASS OTPS procurements implementing SETR while minimizing the competing effects of the two. The SETR process is NAVAIR's procedure to perform system engineering reviews for Naval Aviation products. This process has been implemented on CASS FoT OTPS procurements for a multitude of reasons including: increased risk management, ensuring product confidence, and program/project uniformity. SETR provides an assessment of the emerging design against the overall objective of promoting a well-managed development effort leading to a system that meets programmatic requirements while still providing the system performance required to support mission needs. It also offers insight into project progress while providing a layer of independent review at programmatic milestones. This paper will discuss the experience of implementing SETR on CASS FoT OTPS procurements. It will summarize some lessons learned with key areas of focus to include: obstacles, useful elements, and specific examples of implementation from recent CASS OTPS programs. The focus will be on a few key elements of SETR that are especially important for CASS OTPSs: stakeholder participation, checklist tailoring, requirements tracking, and risk management. These topics will be covered from the point of view of government acquisition, but there will be valuable insights for TPS developers. The intent is to allow future CASS FoT OTPS development projects to effectively implement SETR while minimizing the cost and schedule impacts of policy, thereby reducing TLC, and increasing speed to the fleet.