Sr. DevOps Engineer, 36099572
New Today
Sr. DevOps Engineer, 36099572 What you get to do in this role: Responsible for maintaining and supporting a dedicated data environment within BigData infrastructure
Capacity planning and data pruning, database administration
Performance tuning for various tables and queries
Responsible for access control, secrets management, and enforcing compliance with data governance policies
Support various CFI data management and data ingestion projects
Continuously monitor and optimize system performance and reliability. Diagnose and resolve issues in multi-source data ingestion pipelines, ETL processes, and data storage solutions.
Develop CI/CD pipelines to automate code testing, integration, and deployment processes to ensure rapid delivery of new features.
Collaborate with data engineering and development teams to integrate changes seamlessly into the deployment pipeline.
In order to qualify for and be successful in this role, you should have: Over 7+ Years of experience in DevOps/SRE function, with at least 3 years emphasizing bigdata platforms, data engineering, and cloud infrastructure services.
Experienced with designing, building, and maintaining scalable and robust cloud infrastructure using Kubernetes and Docker for containerization and orchestration.
Knowledge of MLOps platforms and practices
Hands-on experience with data processing tools like Apache Spark, dbt, Kafka, and Airflow.
Strong knowledge of Hadoop components, including Spark Streaming, HDFS, HBase, YARN, Hive, Impala, Atlas, and Kudu.
Familiarity with Snowflake and Clickhouse. Trino, starburst, and data lakehouse technologies
Experience in securing the Hadoop stack using Sentry, Ranger, LDAP, and Kerberos KDC.
Skilled in leveraging Software Configuration Management (SCM) and build tools like Git, GitLab, Nexus, Maven, Grunt, Jenkins, Docker, and Ansible for ongoing CI/CD operations.
Good knowledge of CentOS 7.x and Linux system administration
Strong experience with scripting languages for automation, such as Python, Bash, Go, Groovy, and YAML, for Big Data cluster deployment and monitoring automation.
Ability to learn quickly in a fast-paced, dynamic team environment.
Strong communication skills and the ability to work collaboratively
Software development background with/ experience in OOP languages such as Java, JavaScript, Node.js, a plus.
B.S. or Master's Degree in Computer Science, related field, or commensurate work experience
Over 7+ Years of experience in DevOps/SRE function, with at least 3 years emphasizing bigdata platforms, data engineering, and cloud infrastructure services.
Managers Note: Based on the job description, what are the must have non-negotiable items that a candidate must have to be successful in this role? Humble -They lack excessive ego or concerns about status and are willing to admit mistakes and learn from others. For example, they are willing to do lower-profile tasks for the good of the group
Hungry - Take ownership, go above and beyond, and seek improvement. For example, volunteer for tasks without being asked. Seek out additional responsibilities or offer help during downtime.
People-smart - strong interpersonal awareness and good judgment around others. Knows how to communicate effectively and is attuned to group dynamics. For example, reading the room and adjusting behavior accordingly, navigating intense conversations with tact and professionalism, and actively listening and responding empathetically.
Intellectual Honesty: Be honest about strengths, weakness, and how you close your learning gaps. Our interview loops include a guided coding and technical assessment (hackerrank) covering System architecture, Python, SQL, capabilities, and DevOps best practices.
What backgrounds/skills can we be more flexible with that can be learned on the job? Software development background with/ experience in OOP languages such as Java, JavaScript, Node.js, a plus.
Familiarity with Snowflake and ClickHouse. Trino, Starburst, and data Lakehouse technologies
Knowledge of MLOps platforms and practices
Does this position require to site onsite or travel? Not required, but willing if necessary and feasible
Does this person have to work in a specific time zone? (e.g. - If a person on the East Coast can work PST, is that ok?) Local time zone (Eastern)
Does this position have the opportunity to extend beyond the initial contract or convert to FTE? Yes
Is there a specific laptop that needs to be used for this role (i.e. - Mac or Windows)? User preference, however, our team is all Mac users.
Pay Rate Range: $ /hr.
- Location:
- Walnut Creek