Data Engineer

New Today

ESSENTIAL DUTIES AND RESPONSIBILITIES
Following is a summary of the essential functions for this job. Other duties may be performed, both major and minor, which are not mentioned below. Specific activities may change from time to time. 1. Builds, manages, and implements the data and/or Big Data pipeline capabilities including data modeling, process design and overall data pipeline architecture and all phases of the ETL (extract, transform, and load) processes. 2. Drives efforts related to partially to completely automate repeatable data preparation and integration tasks. Partner with technology teams to understand data capture, testing needs, and to build and test end-to-end solutions. 3. Analyzes information to determine business needs from requests and implement effective technical solutions by providing problem analysis and resolution in a timely manner and explain and interpret complex, difficult, or sensitive information. 4. Takes a new perspective on existing solutions to solve problems of moderate to high complexity and exercise judgment based on the analysis (e.g. modeling, testing, etc.) of multiple sources of information. 5. Lead small data engineering projects with manageable risks and resource requirements; plays significant roles in larger, more complex initiatives.
QUALIFICATIONS Required Qualifications: The requirements listed below are representative of the knowledge, skill and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. 1. Bachelor's degree and five years of experience in systems engineering or administration or equivalent education and related training or experience • 5+ years of experience in a data engineering role with expertise in Azure data services, strong understanding of ETL principles and data modeling • Collaborate with data architects, business analysts to understand data requirements to ingest, store and produce enhanced datasets for analytics. • Design and implement high performing and secure data integration solutions using Azure Data factory to meet data ingestion and business needs. • Develop scalable and reusable frameworks for ingestion of structured and unstructured data. • Solid experience building data processing solutions leveraging Azure Data factory, Azure Databricks, Azure Datalake storage, Azure Spark, Azure Stream Analytics and Kusto • Ensure data security and privacy standards are implemented using role-based security, encryption, tokenization, and obfuscation. • Set up alerts, monitor and troubleshoot data pipelines to identify and resolve issues in timely manner. Implement data quality checks and validation processes to ensure accuracy and completeness of data. • Optimize data integration processes for performance and cost effectiveness. 2. In-depth knowledge of SQL, relational databases, ETL/ELT architecture and concepts, data integration concepts and big data concepts 3. Previous experience in planning and managing IT projects Location: This position is hybrid based in our Alpharetta office. OTHER JOB REQUIREMENTS / WORKING CONDITIONS SittingConstantly (More than 50% of the time)Visual / Audio / SpeakingAble to access and interpret client information received from the computer and able to hear and speak with individuals in person and on the phone.Manual Dexterity / KeyboardingAble to work standard office equipment, including PC keyboard and mouse, copy/fax machines, and printers.AvailabilityAble to work all hours scheduled, including overtime as directed by manager/supervisor and required by business need.TravelMinimal and up to 10%
General Description of Available Benefits for Eligible Employees of TIH: All regular teammates (not temporary or contingent workers) working 20 hours or more per week are eligible for benefits, though eligibility for specific benefits may be determined by the division of TIH Insurance Holdings, LP (TIH) offering the position. TIH offers medical, dental, vision, life insurance, disability, accidental death and dismemberment and tax-preferred savings accounts, along with other voluntary benefits. All regularly scheduled teammates (not temporary or contingent workers), regardless of the number of scheduled hours, can contribute to a 401(k) savings plan and you become eligible for Company matching contributions after one year of service and attainment of age 21. Teammates also receive no less than 10 days of vacation (prorated based on date of hire and by full-time or part-time status) during their first year of employment, along with 10 sick days (also prorated), and paid holidays.
Apply
Location:
Alpharetta
Job Type:
PartTime

We found some similar jobs based on your search