Role Value Proposition:
We are seeking a highly skilled Senior Data Engineer to join our Marketing Data Engineering team, focusing on Azure cloud services, Databricks, and marketing technology integrations (e.g., Adobe, Salesforce). This role will focus on data platform architecture, administration, and automation, ensuring scalable, secure, and cost-efficient data solutions aligned with our Cloud Adoption Framework (CAF) governance. Key responsibilities include supporting data engineering team, marketing analytics, Power BI dashboards, and advanced personalization, while leveraging DevOps practices, CI/CD pipelines.
Key Responsibilities:
Azure Platform Architecture & Administration:
Design and manage a secure, scalable Azure-based data platform to support marketing and customer analytics.
Administer and optimize Azure services including Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Synapse Analytics, and Key Vault.
Implement robust monitoring, alerting, and cost optimization for the Azure data environment.
Ensure platform availability, data pipeline reliability, and high performance for downstream consumption.
Establish and manage Azure Data Lake Storage (ADLS) structures, security models, and performance optimization strategies.
Monitor platform health, performance, and cost usage; implement automation to improve efficiency and reliability
Data Engineering & ETL/ELT Pipelines:
Architect and implement ETL/ELT pipelines using Databricks (PySpark, SQL, Delta Lake) and Azure Data Factory.
Optimize data ingestion, transformation, and storage for big data workloads and real-time streaming.
Work with stakeholders to design data models, schemas, and APIs supporting analytics and operational needs.
Ensure data quality, lineage, and governance through integration with tools such as Purview or equivalent.
Build robust data transformations and aggregations to support marketing dashboards and customer 360 views.
Optimize Python jobs, SQL queries, and data flows for performance and scalability.
Integration with Marketing Platforms:
Integrate marketing data from platforms such as Salesforce, Adobe Experience Platform, Adobe Analytics, Facebook Ads, HubSpot, and CRM systems.
Work with MarTech and Marketing Ops teams to ensure clean, timely data feeds for campaigns.
Build APIs, REST connectors, or use tools such as Azure Logic Apps, Azure Functions, and API Management.
Power BI Support and Semantic Layer Design:
Provide data models and optimized datasets to support Power BI dashboards for marketing.
Collaborate with BI developers on semantic models using Synapse SQL Serverless or Power BI Datasets.
Ensure data freshness and efficient refresh cycles for marketing reports.
Data Governance, Security & Compliance:
Implement data access controls, encryption, and auditing using Azure RBAC, Purview, and Private Endpoints.
Ensure compliance with GDPR, CCPA, and internal policies.
Define and manage metadata, data dictionaries, and quality processes.
Agile Project Delivery & Stakeholder Engagement:
Work in Agile teams providing estimates and delivery timelines for marketing use cases.
Collaborate with marketing analytics, Martech, and Marketing data platform teams to prioritize backlog items.
Translate marketing needs into platform capabilities and deliverables.
DevOps & Infrastructure as Code (IaC):
Establish DevOps practices for CI/CD pipeline development, deployment, and testing for data workflows using Azure DevOps or GitHub Actions.
Manage source control, release management, and environment configuration for data engineering components (ADF, Databricks, Synapse).
Automate deployment of data pipelines and related resources with rollback strategies and deployment validations.
Set up monitoring and alerting for CI/CD pipelines and infrastructure health using tools like Azure Monitor, Log Analytics, or Application Insights.
Essential Business Experience and Technical Skills:
Required:
Bachelor’s or master’s degree in computer science, Engineering, Information Systems, or a related field experience.
7+ years of experience in data engineering, architecture, or platform administration with at least 3+ years in Azure-based environments.
Deep expertise in Azure Data Factory, Azure Databricks, Azure SQL Database, and/or Synapse Analytics.
Strong SQL and Python skills; familiarity with Git, CI/CD (Azure DevOps or GitHub Actions).
Understanding of customer data models, identity resolution, and campaign data lifecycles.
Experience with CI/CD pipelines and DevOps best practices for data engineering and infrastructure deployments.
Experience supporting enterprise Power BI solutions using Azure. Experience integrating marketing or any other platforms via APIs and RESTful services.
Proficiency with Terraform for managing Azure infrastructure via code.
Preferred:
Azure Solutions Architect or Azure Data Engineer Associate certifications.
Experience with Marketing technologies (Adobe, Salesforce, Marketo, 6 sense, etc) and CDPs like Adobe CDP or Tealium
Infrastructure as Code (IaC) using Terraform, YAML
Streaming data architecture using Event Hubs, Kafka, or Stream Analytics.
At MetLife, we’re leading the global transformation of an industry we’ve long defined. United in purpose, diverse in perspective, we’re dedicated to making a difference in the lives of our customers.
Equal Employment Opportunity/Disability/Veterans
If you need an accommodation due to a disability, please email us at accommodations@metlife.com. This information will be held in confidence and used only to determine an appropriate accommodation for the application process.
MetLife maintains a drug-free workplace.