Data Engineer

2 Days Old

Data Engineer
Interactive Brokers Group, Inc. (Nasdaq: IBKR) is a global financial servicespany headquartered in Greenwich, CT, USA, with offices in over 15 countries. We have been at the forefront of financial innovation for over four decades, known for our cutting-edge technology and clientmitment.
IBKR affiliates provide global electronic brokerage services around the clock on stocks, options, futures, currencies, bonds, and funds to clients in over 200 countries and territories. We serve individual investors and institutions, including financial advisors, hedge funds and introducing brokers. Our advanced technology,petitive pricing, and global market help our clients to make the most of their investments.
Barron's has recognized Interactive Brokers as the #1 online broker for six consecutive years. Join our dynamic, multi-national team and be a part of apany that simplifies and enhances financial opportunities using state-of-the-art technology.
This is a hybrid role (3 days in the office/2 days remote).
Job Summary:
Develop ourprehensive data processing pipeline transforming on-premises Kafka streams into both actionable business insights and regulatorypliance reports through AWS cloud services (S3, Glue, Athena, EMR). Design robust ETL processes and build automated, scalable data solutions aligned with our zero-maintenance vision, delivering high-quality outputs for both business decision-making and regulatory requirements.
About your team:
We are the Realtime Order Analytics and Reporting team, a dynamic group focused on transforming financial transaction data into valuable business intelligence and regulatory reporting. Our team: Works with cutting-edge technologies, including AWS cloud services and realtime data processing Operates in a collaborative environment where innovation and ideas are encouraged Maintains a balance between technical excellence and business impact Values automation and efficiency in all our solutions Fosters continuous learning and professional development Plays a critical role in supporting business decision-making and ensuring regulatorypliance Embraces agile methodologies to deliver high-quality solutions efficiently
We're looking for someone who shares our passion for data engineering and wants to make a significant impact by turningplex financial data into actionable insights.
What will be your responsibilities within IBKR: Designing, developing, and maintaining ETL workflows using AWS services Processing data from Kafka streams and S3 storage to generate insights Implementing data transformation logic using Python, PySpark, and PyAthena Creating and optimizing data models for both analytical and regulatory reporting needs Building automated data quality checks and monitoring systems Developing and maintaining documentation for data pipelines and processes Troubleshooting and resolving data pipeline issues Contributing to architectural decisions for data infrastructure Ensuring data solutions meet performance, security, andpliance requirements Continuously improving our data systems for scalability and reduced maintenance
Which skills are required: Bachelor's or master's degree inputer Science or a related field 3+ years of professional software engineering experience in Python, PySpark and PyAthena 3+ years of professional experience in Python as a primary language (non-scripting) Extensive experience in Pandas or NumPy Experience with ETL processes and data warehousing concepts Familiarity with cloud technologies, particularly AWS (S3, Glue, Athena, EMR) Experience using ELK Stack (Elasticsearch, Logstash, Kibana) Thorough understanding of databases and SQL 1+ years of professional experience with Linux operating systems An analytical mind and business acumen Strongmunication skills
Good to have: Experience with financial markets or the brokerage industry Experience with business intelligence tools, especially Tableau Experience with version control systems (, Git, BitBucket) Experience with CI/CD Practices and Tools
To be successful in this position, you will have the following: Self-motivated and able to handle tasks with minimal supervision. Superb analytical and problem-solving skills. Excellent collaboration andmunication (Verbal and written) skills. Outstanding organizational and time management skills.
Retirement plan 401(k) withpetitivepany match Excellent health and wellness benefits, including medical, dental, and vision benefits, and apany-paid medical healthcare premium. Wellness screenings and assessments, health coaches and counseling services through an Employee Assistance Program (EAP) Paid time off and a generous parental leave policy Dailypany lunch allowance provided, and a fully stocked kitchen with healthy options for breakfast and snacks Corporate events, including team outings, dinners, volunteer activities andpany sports teams Education reimbursement and learning opportunities Modern offices with multi-monitor setups Job ID 8007251002
Apply
Location:
Greenwich

We found some similar jobs based on your search