Data Engineer

New Today

Hi There,
Candidates should take the time to read all the elements of this job advert carefully Please make your application promptly.
Job Title: Data Engineer/ Power BI Consultant Location: Houston, TX (Need local Candidate) Work Mode: Contract / Hybrid
Job Summary: We are seeking a skilled and motivated Data Engineer with expertise in Python, PySpark, Data Lakes, Synapse Analytics, Azure Data Factory, and Medallion Architecture. The ideal candidate will play a key role in designing, building, and optimizing scalable data pipelines and data platforms in the Azure cloud ecosystem, and delivering insights via Power BI dashboards and reports.
Key Responsibilities: Design, develop, and manage scalable data pipelines using Python and PySpark . Implement and maintain data lake architectures (Delta Lake / Lakehouse) based on Medallion Architecture (Bronze, Silver, Gold layers). Utilize Azure Synapse Analytics to perform big data processing, data integration, and advanced analytics. Build and orchestrate ETL/ELT workflows using Azure Data Factory . Integrate data from various sources (structured, semi-structured, unstructured) into a centralized Data Warehouse . Ensure high data quality and implement robust data validation and monitoring frameworks. Work closely with BI developers and analysts to design effective Power BI dashboards and reports. Optimize performance of large-scale data solutions for real-time and batch processing workloads. Maintain and enforce data security, compliance, and governance across the platform.
Required Skills and Experience: Strong programming skills in Python with experience in data engineering tasks. Hands-on experience with PySpark for distributed data processing on big data platforms. Proficiency in Azure Synapse Analytics , including dedicated and serverless SQL pools. Solid understanding of Azure Data Lake Storage Gen2 and data lake design principles . Experience in building ETL/ELT pipelines with Azure Data Factory (ADF) . Deep knowledge of Medallion Architecture (Bronze, Silver, Gold layers) and Delta Lake format. Strong SQL skills for querying and transforming data in Data Warehouses . Experience designing, building, and publishing Power BI reports and dashboards. Familiarity with data governance, metadata management, and data lineage. Excellent communication, documentation, and collaboration skills.
Location:
Boston, MA
Category:
Healthcare And Medical

We found some similar jobs based on your search