Alon Wolff
Be'er Ya'aqov
Summary
Data Engineer specializing in large-scale batch data flows, real-time streaming, and Delta Lake.
Formerly at ZipRecruiter, I am now seeking new opportunities following the closure of the Israeli office.
I have designed, maintained, and optimized high-performance automated data pipelines with PySpark, ensuring runtime efficiency, cost-effectiveness, and data quality.
Experienced in API development (REST, gRPC) and system monitoring, with hands-on expertise in Kubernetes, Docker, SQL and NoSQL databases (DynamoDB, Redis), message queues (Kafka, SQS), and Git.
I have Strong analytical skills and business-oriented mindset, with excellent communication skills and a proven ability to collaborate across teams to deliver high-quality data solutions
Overview
3
3
years of professional experience
Work History
Data Engineer
ZipRecruiter
02.2023 - 09.2025
- Built, optimized, and maintained large-scale PySpark data pipelines on Kubernetes, orchestrated with Airflow, processing billions of records daily. Integrated diverse data sources with thorough testing and validation, ensuring scalability and high data quality.
- Contributed to a real-time data streaming pipeline with Kafka, managing topic transitions and implementing a gRPC client for reliable service communication, with Prometheus monitoring to ensure low-latency, high-throughput delivery to Google APIs.
- Developed and maintained production API in Go, serving data from DynamoDB tables, adding new endpoints, enhancing existing functionality, and implementing PagerDuty monitoring to ensure reliable data delivery.
- As a Data Guild member, developed a monitoring application to track Delta tables metadata across the company with automated alerts, and contributed to organization-wide S3 cost optimization initiatives.
- Reduced infrastructure costs and improved system reliability by replacing expensive external service calls with direct data lake access, implementing scalable optimizations for growing data volumes.
Education
Master of Science - Industrial Engineering
Ben-Gurion University of The Negev
Beer Sheva 09-2022
Bachelor of Science - Industrial Engineering
Ben-Gurion University of The Negev
Beer Sheva 09-2021
Skills
- Programming Languages: Python, SQL, Go
- Batch Processing: Apache Spark , Delta Lake
- Real-Time Streaming: Apache Kafka
- Databases: SQL (mySQL, SQL server) , NoSQL (DynamoDB, Redis)
- Workflow Orchestration: Apache Airflow
- Cloud & Infrastructure: AWS (S3, Athena), Kubernetes, Docker, Terraform
- Tools & Frameworks: Git, REST APIs, gRPC
Timeline
Data Engineer
ZipRecruiter
02.2023 - 09.2025
Master of Science - Industrial Engineering
Ben-Gurion University of The Negev
Bachelor of Science - Industrial Engineering
Ben-Gurion University of The Negev