Principal Data Engineer At Verint, we believe customer engagement is the core of every global brand. Our mission is to help organizations elevate Customer Experience (CX) and increase workforce productivity by delivering CX Automation. We hire innovators with the passion, creativity, and drive to answer constantly shifting market challenges and deliver impactful results for our customers. Our commitment to attracting and retaining a talented, diverse, and engaged team creates a collaborative environment that openly celebrates all cultures and affords personal and professional growth opportunities. The Principal Data Engineer will be a part of the Big Data team and responsible for developing batch or event-driven data pipelines in the cloud (AWS) while improving the reliability, security, resilience, and performance of the Big Data pipeline. The Principal Engineer will bring knowledge of software development using Java and Spark technologies and contribute to daily operations including CI/CD. Principal Duties and Essential Responsibilities: Design and develop overall data architecture to ensure the effective storage, retrieval, and analysis of large-scale data sets Build and maintain scalable data pipelines for ingesting, processing, and transforming data from various sources into our data warehouse or data lake. Ensure data quality and data consistency throughout the pipeline Optimize data storage, retrieval, and processing performance through indexing, partitioning, and caching techniques Evaluate and select appropriate technologies, tools, and platforms for data processing Improve availability and reliability of data streaming pipeline Evaluate the scalability of data architecture to accommodate future growth and changing business needs Develop build and deployment automation for microservices using CI/CD Minimum Requirements: Bachelor's degree in Computer Science, Engineering or related field 8+ years developing backend services with Java/ Scala/Python Strong modern data store knowledge including traditional data warehouse and data lake Experience on solution design with microservices dealing large scale datasets Experience in automating operational tasks through development and coding Hands-on experience using Maven, Jenkins, Git, JUnit 5+ years working experience using cloud services in AWS or other cloud provider Excellent communication skill Preferred Requirements: Knowledge of Spark (Java, Scala) Knowledge of Databrick Hands-on experience with Docker and Kubernetes Experience working in cloud environments: AWS and/or Azure Familiarity with performance monitoring using Datadog Understanding of asynchronous Java programming Verint Systems Inc. is an equal opportunity employer and is committed to maintaining a workplace free from discrimination, retaliation, and sexual and any other form of harassment. Verint has a zero-tolerance policy against any form of discrimination, retaliation, or harassment including sexual harassment or any other form of harassment based on race, color, religion, sex, age, national origin, genetic information, disability, veteran status, and any other classification or characteristic protected by applicable federal, state or local laws. Verint operates in accordance with all anti-discrimination laws and affords equal opportunities to employees and applicants without regard to any characteristic or protected class in our hiring, promotion and termination practices.