Data Platform Engineer – San Antonio


The Data Platform Engineer will support the 35 Intelligence Squadron development of network-related data analytics utilizing the Apache Spark framework on large datasets (over 1TB). The Data Platform Engineer will test, revise, and refine solutions in support of Big Data Platform (BDP). You will perform development, testing, and integration of solutions for deployment onto customer systems. You will interact with customer to clarify requirements, train end users, and document all processes and procedures. You will conduct code reviews, develop pseudocode, produce user manuals, and conduct training.


Three years of development experience in Apache Accumulo, Apache Spark framework, Apache Maven, and GitLab. Five years of development experience with hands on knowledge of Python, Scala, JAVA, and Linux Shell Scripting. DevOps experience using tools such as Puppet, SIMP, Nagios, Grafana, Docker, and Kubernetes. Candidate must be capable of working in a fast-paced, large-team environment.
Must have IAT Level II, or higher, certification.


The selected candidate will design, build, enhance and maintain the advanced analytic applications and platforms. Enhance existing software by deriving algorithms, adding new capabilities, increasing performance, and improving usability. Translates customer requirements into software design documents. Develop unit and functional tests to satisfy Quality Assurance Test. Innovate and present Course of Action (COA) options in response to Software Change Requests. The Data Platform Engineer will build BDP cluster, research and apply new BDP features, manage BDP accounts, troubleshoot and resolve BDP errors.


Possess and maintain required skills to include, but not limited to:
*CompTIA Linux+
*Experienced Bash, Scala, Python, Java
*Experienced with Docker and Kubernetes
*Experienced in Apache Accumulo, Kafka, Spark
*Experienced in virtual machine management (Nutanix or VMware)
*Experienced Big Data Platform
*Familiarity with Confluence and JIRA
*Understanding of STIG Compliance


BS in Software Engineering, Computer Science.


Must have an active Top-Secret clearance with SCI eligibility.


San Antonio, TX