Data Engineer 3
New Yesterday
Valorem Reply is an award-winning digital transformation firm focused on delivering data-driven enterprise, IT modernization, customer experience, product transformation and digital workplace. Through the expertise of their people and power of Microsoft technologies, they provide hyper-scale and agile delivery of unique digital business services, strategic business models and design-led user experiences. Their innovative strategies and solutions securely and rapidly transform the way their clients do business.
As a Data Engineer 3, you will develop, enhance, and sustain innovative data engineering solutions to improve the customer's data experience.In this role, youwill also review designs and participate in meaningful collaboration sessions on how to help customers leverage their data assets to solve complex problems and inform their business decisions. This role requires a deep understanding of data, effective communication skills, and the ability to work independently while collaborating across teams
Responsibilities
Implement new data engineering features in a highly collaborative work environment alongside product managers and fellow engineers across multiple disciplines
Help drive the design and implementation of ETL workflows across multiple disparate systems and data sources and help provide clarity across the customer's data
Collaborate closely with business partners and internal customers
Own end-to-end operations of resilient and observable ETL workflows
Share technical solutions and product ideas through team planning, design review, and technical discussions
Design, build and operate large-scale distributed data processing systems, data lakes, lake shore apps
Take the initiative on projects and help improve processes, documentation and the overall design by adopting data engineering best practices
Designing and working with large swaths of disparate vendor data sets, document stores, and tabular data
Minimum Requirements US citizen or green card holder per client requirements
5 years of experience with common data engineering languages like Python (primary language), SQL, and PySpark, applying functional design principles and common software design patterns
5 years of proven experience in building and deploying complex ETL pipelines on-prem, hybrid, and cloud environments and experience with orchestrating pipelines on Airflow
5 years of experience building within AWS in a production environment (ex. MWAA, Glue/EMR (Spark), S3, ECS/EKS, IAM, Lambda, etc.)
5 years of experience with core statistical principles, industry-standard data modeling, data security and classification methodologies
5 years of experience in Agile software development, test-driven development, unit testing, code reviews and design documentation
2 years of experience in Databricks and /or Dreamio Lakehouse platform experience
2 years of experience with DevOps and CI/CD pipelines including working with Terraform or any IaC platform
Preferred Qualifications Experience in Financial Industry
Experience with other modern programming languages like Java, C++, and C#
Ability to own all stages of the development process: design, testing, implementation, operational support
Experience documenting complex data processing workflows and operational guides
About Reply
Reply specializes in the design and implementation of solutions based on new communication channels and digital media. Reply is a network of highly specialized companies supporting global industrial groups operating in the telecom and media, industry and services, banking, insurance and public administration sectors in the definition and development of business models enabled for the new paradigms of AI, cloud computing, digital media and the Internet of Things. Reply services include Consulting, System Integration and Digital Services.
The base compensation range for this full-time position is between $120,000 - $150,000 plus benefits. Compensation decisions are supported through market data, where regional variances may exist based on cost of labor. We also take into consideration prior experience, relevant skills, education and/or training, certifications and, as applicable, other required qualifications. If you have questions regarding compensation, the talent acquisition team can provide relevant details during the interview process.
Reply is an equal opportunity employer. We are committed to provide equal opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. If you need assistance and reasonable accommodation due to a disability during the application or the recruiting process, email us at jobusa@reply.com. Visit our website at www.reply.com to learn more about our open roles.
- Location:
- Los Angeles, CA, United States
- Job Type:
- FullTime
- Category:
- Computer And Mathematical Occupations