Sr. Staff Data Engineer - Matterport, SF Bay Area

New Today

Responsibilities Design, develop, and maintain scalable data pipelines and ETL processes using Airflow, Snowflake, S3, Databricks, and other AWS services
Implement and optimize Snowpark jobs, data transformations, and data processing workflows in Snowpipe
Building and deploying code using Snowpark Python by processing incremental data, orchestrating with Snowflake tasks, and deploying via a CI/CD pipeline
Understand various data domains and be able to translate them through data transformations to suit various business needs
Oversee automated data infrastructure: Collaborate with software engineering and product teams to streamline data tracking in our products.
Ability to integrate data from different sources via cross-domain data stitching into existing data models
Develop and maintain secure data warehouses: Implement data models, data quality checks, and governance practices to ensure reliable and accurate data.
Hands-on data coding, optimization, and query performance
Liaise with key company teams (DBA, DevOps, SecOps…) for data accessibility and analysis
Mentor and manage engineers and analysts in the normal execution of their responsibilities
Successfully implement software development projects to specification and within scheduled timelines and budget parameters
Leverage AWS DevOps and CI/CD best practices to automate the deployment and management of data pipelines and infrastructure
Basic Qualifications Bachelor’s degree or equivalent experience in Computer Science, Computer Engineering, Mathematics, or an adjacent field required from an accredited, not-for-profit university or college
A track record of commitment to prior employers
Working knowledge of data models within an Enterprise Warehouse
Advanced SQL, Excel, and Python skills
5+ years of data engineering experience
Familiarity with machine learning concepts, tools, and libraries (e.g., TensorFlow, PyTorch, Scikit-learn, MLflow)
Collaborate with cross-functional teams: Work closely with business analysts, data scientists, and DevOps engineers to ensure successful data platform implementations.
Knowledge of business intelligence software (i.e., Looker, Power BI, Tableau) and web analytics tools (i.e., Google Analytics, Google Tag Manager, BigQuery)
Ability to retrieve, synthesize, and present critical data in structures that is immediately useful to answering specific ad-hoc questions.
Preferred Qualifications Experience with Postgres/RDBMS
Working knowledge of Data Visualization tools like Looker
Experience working with and managing large consumer datasets to derive insights
What's In It For You? When you join CoStar Group, you’ll experience a collaborative and innovative culture working alongside the best and brightest to empower our people and customers to succeed.
We offer you generous compensation and performance-based incentives. CoStar Group also invests in your professional and academic growth with internal training, tuition reimbursement, and an inter-office exchange program. Our benefits package includes (but is not limited to): Comprehensive healthcare coverage: Medical / Vision / Dental / Prescription Drug
Life, legal, and supplementary insurance
Virtual and in person mental health counseling services for individuals and family
Commuter and parking benefits
401(K) retirement plan with matching contributions
Employee stock purchase plan
Paid time off
Tuition reimbursement
On-site fitness center and/or reimbursed fitness center membership costs (location dependent)
Access to CoStar Group’s Diversity, Equity, & Inclusion Employee Resource Groups
Complimentary in office gourmet coffee, tea, hot chocolate, fresh fruit, and other healthy snacks
Pay Transparency This position offers salary that ranges from $176,000 to $253,000 a year, determined by relevant skills and experience, in addition to commission opportunities and a generous benefits plan Sponsorship Statement US:
Apply
Location:
San Francisco

We found some similar jobs based on your search