Data Engineer

New Yesterday

Overview CTG is seeking to fill a Data Engineer opening for our client in San Antonio, TX.
Location: San Antonio, TX Duration: Permanent Placement
Duties: Work with big data systems and complex structured and unstructured data sets.
Support government data acquisition, analysis, and sharing efforts.
Design and maintain software infrastructure for big data scaled ingestion, including integrating new data sources, modifying existing sources, implementing testing, establishing monitoring, and troubleshooting.
Lead the department in achieving strategic goals, ensuring data integrity, and fostering a collaborative, innovative work environment.
Skills: Proficiency in Java (unit and integration testing) and Python; familiarity with SQL schemas and statements.
Expertise in ETL creation and processing, code debugging, and data modeling design/troubleshooting from ingest to visualization.
Strong experience with Apache NiFi (administration and building/troubleshooting data flows), AWS S3 (bucket administration), and data flow solutions such as Kafka and AWS SQS.
Familiarity with JSON, XML, SQL, compressed file formats, and YAML configuration files.
Proficiency with Maven, GitLab, VSCode, IntelliJ/PyCharm, and Linux OS (BASH).
Ability to decompose technical problems and troubleshoot both system and dataflow issues.
Strong documentation and training skills in technical domains.
Desired: experience with Apache Airflow, Mage AI, Kubernetes, Docker, and Amazon SQS/SNS administration.
Experience: Current active TS/SCI eligible Security Clearance.
Minimum 9 years of experience in software development/engineering, data engineering, database engineering, or related fields (additional 4 years of relevant experience may substitute for a BS degree).
Experience with unit and integration testing, data extraction, custom translation development, data prep and labeling, and multiple log formats (JSON, XML, etc.).
Familiarity with Agile environments and cyber/network security operations preferred.
Experience conducting data model reviews, developing custom logic for data modification, and administering databases and ODBC drivers.
Education: Bachelor’s degree in Computer Science, Engineering, or related field preferred; equivalent experience accepted per qualifications above.
Must be DoD IAT II certified or higher.
Excellent verbal and written English communication skills and the ability to interact professionally with a diverse group are required.
CTG does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services for this role.
To Apply: To be considered, please apply directly to this requisition using the link provided. For additional information, please contact Nicole Shaw at Nicole.Shaw@ctg.com . Kindly forward this to any other interested parties. Thank you!
The expected base salary for this position ranges from $150,000 to $196,000. Salary offers are based on a wide range of factors including relevant skills, training, experience, education, market factors, and where applicable, licensure or certifications obtained. In addition to salary, a competitive benefit package is also offered.
Location:
San Antonio
Category:
Technology

We found some similar jobs based on your search