Automation in Pentagon Test and Evaluation: Insights from Amy Henninger’s Senate Hearing

Emphasizing Automation Without Sacrificing Live Testing

During her recent testimony before the Senate Armed Services Committee, Amy Henninger, nominated as the Pentagon’s Director of Operational Test and Evaluation, outlined her vision for integrating advanced technologies into the military’s testing protocols. Central to her strategy is the belief that “automation everywhere” can enhance efficiency, but she firmly advocates for maintaining live testing where necessary.

“I will advocate for speed and automation wherever feasible, ensuring caution when required and maintaining clarity at all times,” stated Henninger.

Leveraging Digital Tools for Enhanced Testing

Henninger underscored the growing relevance of software in testing and evaluation (T&E), highlighting that contemporary systems are predominantly software-driven. She asserted that a mere 5-10% of these systems rely solely on hardware.

• Migration Towards Software-Driven Solutions:
  • The T&E framework now emphasizes software-centric operations.
  • Traditional methods are increasingly inadequate, necessitating a shift towards more automated processes that utilize digital modeling to expedite evaluations.

Key Takeaways:

• Enhanced automation is not just about speed; it’s about reengineering processes to address contemporary challenges.
• Utilizing software for testing will allow the Department of Defense (DoD) to better manage and assess complex systems.

The Role of Live Testing in Modern Warfare

Despite advocating for automation, Henninger acknowledges that live testing remains indispensable.

“It makes sense to model or simulate what we understand thoroughly, while live-testing elements that are less certain,” she remarked, emphasizing that a complete replacement of live testing is not on the horizon.

Combined Joint All-Domain Command and Control (CJADC2)

Henninger discussed the complexities surrounding the Pentagon’s CJADC2 initiative, designed to unify military service networks into an integrated command structure.

• Integration Challenges:
  • Various services and organizations are developing CJADC2 capabilities simultaneously, complicating the testing framework.
  • Essential components, such as the Joint Fires Network, necessitate a multifaceted approach combining both live testing and simulations.

This hybrid approach not only allows for thorough evaluations but also aligns with the evolving nature of military operations today.

Addressing the Integration of Artificial Intelligence

As the DoD increasingly incorporates artificial intelligence, the operational testing office must adapt its methodologies accordingly.

• Performance Monitoring:
  • It’s crucial to devise strategies for the ongoing assessment of AI models, which includes regular recalibrations and eventual model retirement.
  • Henninger highlighted the need for a comprehensive sustainment strategy that ensures the long-term efficacy of AI systems.

Safeguarding Against Adversarial Attacks

Henninger stressed the importance of anticipating adversarial tactics that could exploit AI vulnerabilities. This necessitates a shift away from traditional cybersecurity measures toward more dynamic strategies that consider potential counter-AI threats.

“We must remain vigilant about adversarial scenarios where our systems may be misled by brittle AI algorithms,” she noted.

The Road to a Clean Audit by 2028

During the hearing, Michael Powers, appointed as the defense comptroller, faced inquiries regarding the goal of achieving a clean audit by 2028, as mandated by the National Defense Authorization Act.

• Actionable Strategies:
  • Powers indicated the necessity for robust leadership engagement to establish milestones and accountability within the audit process.
  • His approach includes eliminating outdated systems and leveraging emerging technologies—like AI and machine learning—to streamline audit procedures.

Milestones and Accountability:

• Powers aims to provide a comprehensive overview of milestones shortly after his confirmation, highlighting the current disjointed state of the Pentagon’s financial management systems.
• Effective audits depend on coherent information management across various departments, which currently operate on incompatible systems.

Conclusion: A Collaborative Approach for Future Readiness

As Henninger and Powers prepare for their prospective roles within the Pentagon, their dual focus on integrating advanced technologies with rigorous testing protocols could significantly reshape the DoD’s operational landscape.

Both nominees underscore the importance of collaboration across departments to address these pressing challenges, ensuring that the U.S. military remains adaptive and resilient in an increasingly complex global environment. Their shared emphasis on accountability, modernization, and vigilance against new threats will be pivotal in guiding the Pentagon’s future strategy.