Job Summary:
Our client is seeking a Cloud Data Engineer to join their team! This position is located in Temple Terrace, Florida.
Duties:
Lead in design, development and testing of data ingestion pipelines
Perform end to end validation of ETL process for various datasets that are being ingested into the big data platform
Perform data migration and conversion validation activities on different applications and platforms
Provide the technical leadership on data profiling/analysis, discovery, analysis, suitability and coverage of data, and identify the various data types, formats, and data quality issues which exist within a given data source
Contribute to development of transformation logic, interfaces and reports as needed to meet project requirements
Participate in discussion for technical architecture, data modeling and ETL standards, collaborate with Product Managers, Architects and Senior Developers to establish the physical application framework
Lead in design and develop validation framework and integrated automated test suites to validate end to end data pipeline flow, data transformation rules, and data integrity
Develop tools to measure the data quality and visualize the anomaly pattern in source and processed data
Assist Manager in project planning, validation strategy development
Provide support in User acceptance testing and production validation activities
Provide technical recommendations for identifying data validation tools, recommend new technologies to improve the validation process
Evaluate existing methodologies and processes and recommend improvements
Work with the stakeholders, Product Management, Data and Design, Architecture teams and executives to call out issues, guide and contribute to the resolution’s discussions
Desired Skills/Experience:
15+ Years of Data Domain knowledge With Data Architecture Background
10+ years of Software development and testing experience
Experience with developing and testing ETL, real-time data-processing and Analytics Application Systems
Strong knowledge in Spark SQL, Scala code development in big data Hadoop environment and/or BI/DW development experiences
Experience with development and automated framework in a CI/CD environment
Experience with cloud environments - GCP is a plus
A solid understanding of common software development practices and tools
Strong analytical skills with a methodical approach to problem solving applied to the Big Data domain
Good organizational skills and strong written and verbal communication skills
Benefits:
Medical, Dental, & Vision Insurance Plans
Employee-Owned Profit Sharing (ESOP)
401K offered
The approximate pay range for this position is between $56.00 and $80.00 . Please note that the pay range provided is a good faith estimate. Final compensation may vary based on factors including but not limited to background, knowledge, skills, and location. We comply with local wage minimums.