Alon Wolff
Be'er Ya'aqov
Summary
Data Engineer specializing in large-scale batch data flows, real-time streaming, and Delta Lake.
Formerly at ZipRecruiter, I am now seeking new opportunities following the closure of the Israeli office.
I have designed, maintained, and optimized high-performance automated data pipelines with PySpark, ensuring runtime efficiency, cost-effectiveness, and data quality.
Experienced in API development (REST, gRPC) and system monitoring, with hands-on expertise in Kubernetes, Docker, SQL and NoSQL databases (DynamoDB, Redis), message queues (Kafka, SQS), and Git.
I have Strong analytical skills and business-oriented mindset, with excellent communication skills and a proven ability to collaborate across teams to deliver high-quality data solutions
Overview
3
3
years of professional experience
Work History
Data Engineer
ZipRecruiter
02.2023 - 09.2025
- Built, optimized, and maintained large-scale PySpark data pipelines on Kubernetes, orchestrated with Airflow, processing billions of records daily. Integrated diverse data sources with thorough testing and validation, ensuring scalability and high data quality.
- Contributed to a real-time data streaming pipeline with Kafka, managing topic transitions and implementing a gRPC client for reliable service communication, with Prometheus monitoring to ensure low-latency, high-throughput delivery to Google APIs.
- Developed and maintained production API in Go, serving data from DynamoDB tables, adding new endpoints, enhancing existing functionality, and implementing PagerDuty monitoring to ensure reliable data delivery.
- As a Data Guild member, developed a monitoring application to track Delta tables metadata across the company with automated alerts, and contributed to organization-wide S3 cost optimization initiatives.
- Reduced infrastructure costs and improved system reliability by replacing expensive external service calls with direct data lake access, implementing scalable optimizations for growing data volumes.
Education
Master of Science - Industrial Engineering
Ben-Gurion University of The Negev
Beer Sheva 09-2022
Bachelor of Science - Industrial Engineering
Ben-Gurion University of The Negev
Beer Sheva 09-2021
Skills
- Programming Languages: Python, SQL, Go
- Batch Processing: Apache Spark , Delta Lake
- Real-Time Streaming: Apache Kafka
- Databases: SQL (mySQL, SQL server) , NoSQL (DynamoDB, Redis)
- Workflow Orchestration: Apache Airflow
- Cloud & Infrastructure: AWS (S3, Athena), Kubernetes, Docker, Terraform
- Tools & Frameworks: Git, REST APIs, gRPC
Timeline
Data Engineer
ZipRecruiter
02.2023 - 09.2025
Master of Science - Industrial Engineering
Ben-Gurion University of The Negev
Bachelor of Science - Industrial Engineering
Ben-Gurion University of The Negev
Similar Profiles
Brian TabackBrian Taback
Agency Relationship Advisor at ZipRecruiterAgency Relationship Advisor at ZipRecruiter
Kalie BakerKalie Baker
Reactivation Specialist at ZipRecruiterReactivation Specialist at ZipRecruiter
Ofir ChityatOfir Chityat
Engineering Manager at ZiprecruiterEngineering Manager at Ziprecruiter
Danny BernshteinDanny Bernshtein
Full-Stack Developer at MoveoFull-Stack Developer at Moveo
Danny BernshteinDanny Bernshtein
Full-Stack Developer at MoveoFull-Stack Developer at Moveo