Senior ETL Data Engineer

New Yesterday

Key Responsibilities: • Build and maintain robust, scalable, and efficient ETL applications covering both batch and streaming flavors • Collaborate with cross-functional teams, including product owners, architects, scrum masters and other stakeholders, to define project requirements, timelines, and deliverables. • Ensure the development adheres to best practices in coding standards, code reviews, and continuous integration/continuous deployment (CI/CD). • Implement and maintain security best practices across all cloud-based solutions to ensure data integrity and compliance with industry standards. • Stay updated with the latest trends and technologies in ETL and Python development, and drive the adoption of new tools and techniques that enhance productivity and efficiency.
Required Skills and Qualifications: • Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field. • 8+ years of experience in software development with a focus on ETL/ELT patterns and Python based development, with at least 2 years in a senior/lead developer role. • Extensive hands-on experience with SQL Server, SSIS, SQL Agents etc., • Advanced proficiency in Messaging platforms like Kafka • Strong understanding and experience in both batch and streaming ETLs pipelines • Strong knowledge of CI/CD pipelines and tools such as Jenkins, GitHub, UCD, Harness or similar. • Proficient in Git and branching strategies. • Excellent communication and collaboration skills, with the ability to articulate technical concepts to non-technical stakeholders. • Strong understanding of data systems architecture and data pipelines • Knowledge and Experience in Unix shell scripting
Preferred Skills: • Exposure to software development methodologies such as Agile or Scrum. • Experience and knowledge on orchestration tools such as Autosys, etc., • Understanding and experience on Liquibase-based deployment a plus • Understanding of GCP data solution components a plus • Exposure/Experience on Financial Services domain a plus
Location:
Charlotte