Sr. Data Engineer

Location: White Plains, NY

Work Setup: Hybrid (7.5 hour work day with 0.5 hour unpaid lunch)

LOCAL CANDIDATES ONLY

Company Overview

Our client is modernizing its Enterprise Resource Planning (ERP) system, transitioning from a decade-old SAP ECC 6.0 to a new integrated platform that will enhance efficiency across all business functions. As our Sr. Data Engineer , you will play a crucial role in designing and implementing the data infrastructure that powers this transformation.

Sr. Data Engineer Responsibilities

The Sr. Data Engineer will be responsible for:

Cloud Data Engineering & Integration

Design and implement data pipelines across AWS, Azure, and Google Cloud platforms

Develop SAP BTP integrations with cloud and on-premise systems

Ensure seamless data movement and storage between cloud platforms

ETL & Data Pipeline Development

Develop and optimize ETL workflows using Pentaho and Microsoft ADF/equivalent tools

Design scalable data transformation, movement, and ingestion processes

Monitor and troubleshoot ETL jobs to ensure high availability and performance

API Development & Data Integration

Develop RESTful APIs for data exchange between SAP and other platforms

Implement API-based data extractions and real-time event-driven architectures

Work with various authentication methods (OAuth, JWT, API keys)

Data Analysis & SQL Development

Write optimized SQL queries, stored procedures, and scripts for data analysis

Perform data profiling, validation, and reconciliation

Support data transformation logic and business rules for ERP reporting

Data Governance & Quality

Work with Ataccama and Collibra to enforce data quality and governance policies

Implement data lineage, metadata management, and compliance tracking

Ensure adherence to enterprise data security standards

Sr. Data Engineer Qualifications

Required Skills

7+ years of experience in Data Engineering, ETL, and SQL development

Hands-on experience with SAP BTP Integration Suite for SAP and non-SAP integrations

Strong expertise in Pentaho (PDI), Microsoft ADF, and API development

Proficiency in SQL (stored procedures, query optimization, performance tuning)

Experience with Azure DevOps, GitHub, and CI/CD for data pipelines

Understanding of data governance tools (Ataccama, Collibra) and data quality management

Experience with AWS, Azure, and Google Cloud for data integration

Strong problem-solving skills and ability to work independently

Preferred Qualifications

Experience with SAP S/4HANA and cloud-based ERP implementations

Familiarity with Python, PySpark for data processing and automation

Knowledge of event-driven architectures

Experience with CI/CD for data pipelines

Education & Certifications

Bachelor's or Master's degree in Computer Science, Data Engineering, or related field

Desirable certifications:

Azure Data Engineer Associate

SAP Certified Associate - Integration Developer

As a Sr. Data Engineer , you'll be at the forefront of our ERP transformation, implementing cutting-edge data solutions that drive organizational efficiency.

We look forward to reviewing your application!

#tech