Senior Data Engineer

New Today

:
Requirement: Migrating the existing process by rewriting the JAVA SPARK process to SCALA SPRAK process. Responsible for creating airflow DAGS to migrate the jobs from existing legacy applications to Cloud (GCP). Responsible for design and developing the process to bring the data from different sources to GCP Parquet/Hudi format. Strong experience with data migration projects/ETL's, large scale DB's. Work with junior development team and be able to guide then on project architecture. Monitor Work loads, optimize resource usage, and recommend improvements for cost efficiency and performance optimization. Lead cloud migration initiatives, including rehosting, refactoring, and re-platforming legacy applications. Provide technical guidance and troubleshooting for cloud related issues. Required Skills: Proven experience as a GCP Architect or similar role in cloud computing. ⁠Strong expertise in GCP services, networking, security, and best practices. ⁠Knowledge of security, compliance, and identity management in the cloud. ⁠Familiarity with cloud cost management and optimization strategies. ⁠Strong problem-solving skills and ability to work in a fast-paced environment. ⁠Excellent communication and collaboration skills. ⁠Experience with data migration projects. Must Have Skills: GCP, Scala, SPARK, GCP, BigQuery, HUDI, Airflow and Oracle.
Location:
Bentonville

We found some similar jobs based on your search