Position:- Data Engineer Location:- Washington, DC (onsite) Duration Long Term Contract

Job Description:- Position Overview: We are seeking a highly skilled and motivated Data Engineer to lead the design, development, and maintenance of robust data pipelines using YAML in Azure DevOps. This role demands deep expertise in cloud-native architectures, infrastructure automation, and scalable data platforms, with a strong emphasis on integrating AI tools and machine learning workloads into production-grade pipelines.

Key Responsibilities: Build and Maintain YAML-Based CI/CD Pipelines: Design and implement automated workflows using YAML in Azure DevOps to support continuous integration and deployment of data services. Architect Azure Data Infrastructure: Develop scalable, secure, and resilient data infrastructure leveraging Azure services including Data Factory, Synapse, and Azure Storage. Integrate AI Foundry and ML Workloads: Collaborate with data scientists and AI engineers to embed machine learning models and AI tools into data pipelines for real-time and batch processing. Data Pipeline Ownership: Take end-to-end responsibility for pipeline performance, reliability, and scalability, ensuring optimal throughput and minimal latency. Infrastructure-as-Code (IaC): Utilize Bicep and other IaC tools to automate infrastructure provisioning and configuration across environments. Cross-Functional Collaboration: Work closely with DevOps, Data Science, and Platform Engineering teams to align data engineering efforts with business and technical goals.

Required Skills & Qualifications: Proven experience in building CI/CD pipelines using YAML in Azure DevOps. Strong proficiency in Python for data processing and automation. Hands-on experience with Bicep for infrastructure deployment. Deep understanding of Azure cloud services and data architecture. Experience integrating AI/ML tools into data workflows. Familiarity with Agile methodologies and DevOps practices. Excellent problem-solving and communication skills.

Preferred Qualifications: Azure certifications (e.g., Azure Data Engineer Associate, Azure Solutions Architect). Experience with AI Foundry or similar platforms. Knowledge of containerization and orchestration (Docker, Kubernetes).