Eyal Gal
Senior Big Data Engineer
Summary
Experienced Big Data Engineer with 10+ years of expertise in designing and managing data pipelines, integrating BI systems, and enhancing ETL operations. Proficient in Spark, Airflow, Iceberg, Kubernetes, Azure, and other advanced technologies. Proven ability to deliver effective solutions in fast-paced environments. Recognized for dedication to personal growth and ongoing education, driven by a deep enthusiasm for technology and data advancement.
Overview
10
10
years of professional experience
Work History
Senior Big Data Engineer
GM
06.2024 - Current
- Architected and developed a scalable Spark-based pipelines to process in-vehicle recording data, including ingestion, cataloging, and normalization of MF4 signal files.
- Designed a modular ETL framework in Spark capable of handling hundreds of files per session, producing unified DataFrames for downstream analytics.
- Built a metadata-driven monitoring and maintenance system for Apache Iceberg tables, automating optimizations such as file compaction, orphan file removal, and snapshot cleanup.
- Developed a RESTful web service with a user-friendly UI for managing record deletion requests, including approval workflows and audit logging.
Big Data Engineer
Playtika
10.2019 - 04.2024
- Led the proof of concept (PoC) initiatives for Airflow, Iceberg and other innovative tools, driving continuous improvement in the company's technological ecosystem.
- Pioneered the development and optimization of Spark Batch Infrastructure for the BI department.
- Created Spark data pipelines to generate daily managerial reports.
- Built and maintained data validation pipelines within 'Great Expectations' framework.
BI & Webapp Developer
Daka90
07.2017 - 09.2019
- Developed and established the BI-QlikView infrastructure for different departments in the company.
- Developed data management system using Django.
- Developed python ETL processes using Pandas.
BI Developer
Branovate
01.2015 - 06.2017
- Developed Python and Selenium Automation processes to collect sales data.
- Developed Data Validation processes to guarantee data reliability.
Education
Accounting Certificate Studies -
Bar-Ilan University
01.2011 - 2013.01
Bachelor's Degree - Economics And Management
Rishon Lezion College of Management
01.2006 - 2009.01
Skills
- Python
- Kafka
- Vertica
- Docker
- Airflow
Kubernetes
Iceberg
Azure
Army Service
Intelligence Force, IDF, 01/01/03, 12/31/06
Timeline
Senior Big Data Engineer
GM
06.2024 - Current
Big Data Engineer
Playtika
10.2019 - 04.2024
BI & Webapp Developer
Daka90
07.2017 - 09.2019
BI Developer
Branovate
01.2015 - 06.2017
Accounting Certificate Studies -
Bar-Ilan University
01.2011 - 2013.01
Bachelor's Degree - Economics And Management
Rishon Lezion College of Management
01.2006 - 2009.01
Similar Profiles
Cody BakerCody Baker
Launch Core Team at GMLaunch Core Team at GM
Harvey T. Wheeler Jr.Harvey T. Wheeler Jr.
Product Specialist at GMProduct Specialist at GM
Ira S. BowdenIra S. Bowden
District Sales Manager at GMDistrict Sales Manager at GM
AMAN RAJAMAN RAJ
Senior Big Data Engineer at MetLifeSenior Big Data Engineer at MetLife
Bharadwaj NalluriBharadwaj Nalluri
Senior Big Data Engineer at Wells FargoSenior Big Data Engineer at Wells Fargo