Perplexity is an AI-powered answer engine founded in December 2022 and growing rapidly as one of the world’s leading AI platforms. Perplexity has raised over $1B in venture investment from some of the world’s most visionary and successful leaders, including Elad Gil, Daniel Gross, Jeff Bezos, Accel, IVP, NEA, NVIDIA, Samsung, and many more. Our objective is to build accurate, trustworthy AI that powers decision-making for people and assistive AI wherever decisions are being made. Throughout human history, change and innovation have always been driven by curious people. Today, curious people use Perplexity to answer more than 780 million queries every month–a number that’s growing rapidly for one simple reason: everyone can be curious.Perplexity is seeking an experienced Software Engineer focusing on building the next-gen AI Data Platform to help revolutionize the way people search and interact online. In this role, you'll help build Perplexity’s end-to-end AI data stack and flywheel which powers all AI products, ML use cases and language models.Perplexity is rapidly scaling both in number of use cases and number of users. Perplexity’s data stack powers scalable, personalized and fast answers for millions of people worldwide.Tech Stack: Spark | AWS Data Stack (S3, RDS, DynamoDB, Docker, EKS, Kinesis) | Pytorch | Docker | Databricks | SnowflakeResponsibilitiesCollaborating closely with AI Product, Applied ML, Post-Training and Data Science teams to design, build, and maintain scalable data pipelines and data lakesDeveloping, deploying, and monitoring entire data lifecycle for ingestion, transformation, streaming and storage at high scaleImplementing tools and abstractions on top of data infrastructure for a variety of analytics, recommendations, AI product and post-training use casesWorking closely with product and AI teams to develop reusable data resources and design patternsQualificationsExtensive programming and data engineering skills, with proficiency in open source & distributed data processing (AWS, Spark, Flink, Iceberg)Familiarity with cloud-based data services (e.g., AWS, RDS, DynamoDB), containerized infrastructure (e.g., EKS, Docker), and data streaming (Flink, Spark streaming, CDCStrong quantitative and engineering skills with experience in estimating performance at high scaleExperience supporting various ML/AI engineering teams to build scalable platforms to accelerate R&D for frontier models and AI productsSelf-motivated with a strong sense of ownership of systems and designs5+ years of industry experience in distributed systems or AI infrastructureThe cash compensation range for this role is $200,000 - $280,000.Final offer amounts are determined by multiple factors, including, experience and expertise, and may vary from the amounts listed above.Equity: In addition to the base salary, equitymay be partof the total compensation package.Benefits: Comprehensive health, dental, and vision insurance for you and your dependents. Includes a 401(k) plan.Apply for this job*indicates a required fieldFirst Name *Last Name *Email *Phone *Resume/CV *Enter manuallyAccepted file types: pdf, doc, docx, txt, rtfEnter manuallyAccepted file types: pdf, doc, docx, txt, rtfWebsiteLinkedIn ProfileWill you now or in the future require visa sponsorship for employment? * Select...Perplexity has an office-centric work model with 4 days per week in the office from the following locations: San Francisco, Palo Alto, or New York. Are you willing to come in 4 days per week? * Select...If you are not based in any of these locations, are you open to relocation to either San Francisco, Palo Alto, or New York? * Select...What are you looking for in your next role? *Why do you think you will be a fit for Perplexity? *How do you use AI in your daily life and engineering work? *Describe a project you worked on recently about large scale data system or ML infra system that you were the most proud of? Tell us why.In order to build the best data platform to support the consumer-facing AI platform like Perplexity, what you think is the most important thing to get it right? #J-18808-Ljbffr