Summary
Overview
Work History
Education
Skills
Timeline
Generic

Alon Wolff

Be'er Ya'aqov

Summary

Data Engineer specializing in large-scale batch data flows, real-time streaming, and Delta Lake.


Formerly at ZipRecruiter, I am now seeking new opportunities following the closure of the Israeli office.


I have designed, maintained, and optimized high-performance automated data pipelines with PySpark, ensuring runtime efficiency, cost-effectiveness, and data quality.



Experienced in API development (REST, gRPC) and system monitoring, with hands-on expertise in Kubernetes, Docker, SQL and NoSQL databases (DynamoDB, Redis), message queues (Kafka, SQS), and Git.


I have Strong analytical skills and business-oriented mindset, with excellent communication skills and a proven ability to collaborate across teams to deliver high-quality data solutions

Overview

3
3
years of professional experience

Work History

Data Engineer

ZipRecruiter
02.2023 - 09.2025


  • Built, optimized, and maintained large-scale PySpark data pipelines on Kubernetes, orchestrated with Airflow, processing billions of records daily. Integrated diverse data sources with thorough testing and validation, ensuring scalability and high data quality.
  • Contributed to a real-time data streaming pipeline with Kafka, managing topic transitions and implementing a gRPC client for reliable service communication, with Prometheus monitoring to ensure low-latency, high-throughput delivery to Google APIs.
  • Developed and maintained production API in Go, serving data from DynamoDB tables, adding new endpoints, enhancing existing functionality, and implementing PagerDuty monitoring to ensure reliable data delivery.
  • As a Data Guild member, developed a monitoring application to track Delta tables metadata across the company with automated alerts, and contributed to organization-wide S3 cost optimization initiatives.
  • Reduced infrastructure costs and improved system reliability by replacing expensive external service calls with direct data lake access, implementing scalable optimizations for growing data volumes.

Education

Master of Science - Industrial Engineering

Ben-Gurion University of The Negev
Beer Sheva
09-2022

Bachelor of Science - Industrial Engineering

Ben-Gurion University of The Negev
Beer Sheva
09-2021

Skills

  • Programming Languages: Python, SQL, Go
  • Batch Processing: Apache Spark , Delta Lake
  • Real-Time Streaming: Apache Kafka
  • Databases: SQL (mySQL, SQL server) , NoSQL (DynamoDB, Redis)
  • Workflow Orchestration: Apache Airflow
  • Cloud & Infrastructure: AWS (S3, Athena), Kubernetes, Docker, Terraform
  • Tools & Frameworks: Git, REST APIs, gRPC

Timeline

Data Engineer

ZipRecruiter
02.2023 - 09.2025

Master of Science - Industrial Engineering

Ben-Gurion University of The Negev

Bachelor of Science - Industrial Engineering

Ben-Gurion University of The Negev
Alon Wolff