Test Engineer 2 or 3
The Level 2 Test Engineer (TE) shall possess the following capabilities:
Conduct research into and apply knowledge of Government test and evaluation concepts and related engineering, acquisition, and operations activities as needed to support the T&E activities
Plan and Execute Performance Analysis
Review planned acquisition approaches to support T&E schedule alignment with decision maker needs for T&E support
Analyze performance risk areas to focus T&E planning
Specify, validate, and adapt Modeling and Simulation for T&E use
Apply Statistical Analysis of variations in performance behavior to characterize confidence in performance estimates
Select, develop, and use analysis tools
Execute the evaluation plan on data collected by Testing Tasks
Plan and Execute Performance Data Collection
Plan program and event level testing for collection of data required for analysis and to sync T&E events with supported decision points
Establish and employ Data and Configuration Management capabilities
Support Data Authentication group functions; and comply with program Discrepancy Reporting criteria and processes
Assess operation and system performance requirements for testability and criticality to fram and prioritize T&E objectives and enable evaluation planning
Coordinate with program Systems Engineering (SE) and review T&E-related SE information to leverage functional analysis, system descriptions, parameter selection and dependencies, Modeling and Simulation, and initial performance risk assessments to inform evaluation planning
Assess operational environments and priorities for evaluation attention and scenario selection, and to coordinate user participation in T&E
Plan program and event level risk-tailored performance estimation and analysis of system and operational Effectiveness and Suitability metrics & conditions; levels of T&E include inspection, demonstration, paper analysis, survey, simulation, and physical test
Design surveys for evaluation of Subject Matter Expert (SME) input and user assessments of performance
Participate in the T&E Working-level Integrated Product Team (WIPT) and/or Integrated Test Team for coordination of evaluation plans
Produce Evaluation Plans (metric framework, scenarios/threads, timelines, requirements/T&E cross-walk), Analysis Plans, Data Requirements, Risk Assessments, Evaluation Reports, Status reports; provide input to Government T&E products (e.g., Technology Readiness Assessments, Test & Evaluation Strategy, Test & Evaluation Master Plan, T&E Plans & Procedures and Test Readiness Reports)
Design data sampling schemes to optimize the information/resource balance and to control testing uncertainties
Select, coordinate, and calibrate Instrumentation, collection and data management tools, targets, and facilities
Ensure test readiness including training of test event participants re-conduct of the event; equipment readiness, and security, legal, and privacy compliance arrangements
Participate in T&E WIPT and/or integrated Test Team for coordination of data collection plans
Execute Testing and Data Collection per plan
Produce associated Test Plans, Procedures, and reports/Briefings, Data management Plan
Work directly with the Government sponsor to coordinate task implementation
Maintain knowledge of current and evolving agency, national, and international standards applicable to the system development of interest
Qualifications: Five (5) years’ experience as a TE in programs and contracts of similar scope, type and complexity is required. Bachelor’s degree in Math, Science, Engineering, Statistics, Engineering Management, or related discipline form an accredited college or university is required. Four (4) years of additional TE experience may be substituted for a bachelor’s degree.
The Level 3 Test Engineer (TE) shall possess the following capabilities:
All the capabilities listed for a Level 2 Test Engineer (see above)
Provide overall leadership of the T&E task and serve as primary liaison to the government for supporting contract coordination and task execution
Communicate issues and solutions to the broader government and contract management structure as requested by Leadership
Ensure the appropriate level of independence of the team from the solution provider to support government management of objectivity risk
Manage T&E resources and tasks; ensure quality assurance of test processes and products
Coordinate and integrate Evaluation and Testing tasks and products
Participate in T&E WIPT and/or Integrated Test Team as needed to ensure proper coordination of T&E activities
Drive innovation and responsiveness to program changes and evolving T&E status to help manage program risk; develop alternative courses of action, work-arounds, and fall-back positions with a recommendation course of action for each risk, monitor and re-evaluate risks at appropriate milestones.
Qualifications: Eight (8) years’ experience as a TE in programs and contracts of similar scope, type and complexity is required. Bachelor’s degree in Math, Science, Engineering, Statistics, Engineering Management, or related discipline form an accredited college or university is required. Four (4) years of additional TE experience may be substituted for a bachelor’s degree.
Task Description
The Test Engineer shall be responsible for creating, documenting and implementing test procedures for operational assessment test activities to be delivered to the end user in a DevOps approach with a dedicated focus on quality.
Task Required Skills
Experience using the Linux CLI
Experience developing scripts using Bash / Python
Within the last 5 years, demonstrated hands-on experience with creating documentation, monitoring, and troubleshooting testing outcomes
Experience with analyzing functional requirements to develop operational assessment test procedures
Extensive knowledge of engineering and industry standard best practice testing concepts and methodologies
In-depth knowledge of the Software Development Life Cycle
Task Desired Skills
Experience with containerization technologies such as Docker
Experience with container orchestration technologies such as Kubernetes
Experience with Git Version Control System
Experience with the Atlassian Tool Suite including Jira, Confluence, and Bamboo
Experience creating and implementing automated tests as part of a CI/CD pipeline