Data Engineer

New Yesterday

Location: Houston, TX (Hybrid) Department: Engineering About Paladin Drones: Paladin is revolutionizing public safety with autonomous drone technology. Our mission? To be on the frontline of emergencies within 90 seconds. When someone dials 911, our drones take flight, providing first responders with a real-time overhead view of the situation, amplifying their situational awareness and hastening response times. Leveraging LTE for unlimited range and control, our drones currently answer the call of duty over 1000 times weekly across multiple cities and states. Our vision is ambitious: within the next decade, our technology will be an essential tool for first responders in every city worldwide. As a tight-knit, passionate, and forward-thinking team, we are committed to pushing the boundaries of UAV tech and making a monumental difference in a rapidly advancing domain.
Position Overview: As a Data Engineer at Paladin Drones, you'll play a crucial role in designing, building, and optimizing robust data pipelines that power our drone platform and analytics systems. You will leverage AWS Glue, PostgreSQL, and advanced cloud technologies to turn complex data from drone logs, telemetry, and other IoT sources into actionable insights.
Responsibilities: Data Pipeline Development: Design, build, and maintain scalable ETL pipelines using AWS Glue, PostgreSQL, and AWS S3 for structured and semi-structured data, especially drone telemetry logs. Data Integration: Extract, integrate, and transform data from various sources, including drone logs, APIs, and third-party systems. Advanced Data Modeling: Develop and maintain comprehensive data models, schema designs, and geospatial databases using PostgreSQL and PostGIS. ETL Optimization: Continuously optimize Glue ETL processes, classifiers, and Grok patterns for performance and reliability. Data Quality Management: Implement automated checks and monitoring to ensure data accuracy, consistency, and integrity across all systems. Collaboration and Support: Partner closely with data science, DevOps, and product teams to align data solutions with business needs and innovation. Performance Tuning: Optimize databases, queries, and Glue jobs to handle large-scale, high-frequency IoT datasets. Documentation: Maintain detailed documentation for pipelines, processes, data dictionaries, and architecture diagrams. Security and Compliance: Implement best practices to ensure data security and privacy compliance (SOC2, GDPR, NIST standards).
Qualifications: Required: 1-3 years of experience in data engineering, with a strong focus on ETL development. Proven hands-on experience with AWS Glue for ETL and data workflows. Expertise in PostgreSQL, including database design, optimization, query performance tuning, and familiarity with PostGIS. Strong Python scripting skills for data processing, automation, and Glue scripts. Experience with AWS ecosystem (S3, Lambda, CloudWatch, IAM). Familiarity with Infrastructure as Code (IaC) practices, especially Terraform. Version control and CI/CD experience (GitHub).
Preferred: Experience with real-time IoT data processing, telemetry logs, and geospatial datasets. Familiarity with Google Cloud Platform (GCP) or other cloud providers. Data visualization experience (Tableau, Power BI, QuickSight).
What We Offer: Competitive salary and equity packages Health, dental, and vision insurance Unlimited PTO and paid holidays Opportunity to grow with a mission-driven, innovative company A collaborative and fast-paced work environment
Join Paladin Drones and contribute to the future of autonomous emergency response technology. Apply today to be part of an innovative team making a real-world impact! Paladin Drones is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. Powered by JazzHR ehTY5mCiO7
Apply
Location:
Houston
Salary:
$80,000 - $110,000 per year
Category:
Technology

We found some similar jobs based on your search