Summary
Overview
Work History
Education
Skills
Volunteering
Military Service
Languages
Timeline
Generic

Niv Badli

Tel Aviv

Summary

Senior Data Engineer specializing in cloud infrastructure and ML operations, with proven success leading enterprise-scale AWS migrations and implementing modern data solutions. Known for exceptional problem-solving abilities and team mentorship. Currently driving engineering initiatives at William Hill while sharing expertise as a Big Data lecturer.

Overview

11
11
years of professional experience

Work History

Senior Data Engineer

888 Holdings (William Hill)
03.2023 - Current
  • Lead the development and optimization of enterprise-scale data infrastructure using Snowflake, dbt, and Apache Airflow (MWAA).
  • Architect mission-critical ETL/ELT processes using Python, SQL, and Bash.
  • Implement Infrastructure as Code with Terragrunt and AWS Lambda for scalable data processing solutions.
  • Led enterprise-wide migration from on-premises SQL Server to AWS cloud infrastructure, implementing Snowflake data warehouse, and dbt for transformations.
  • Architected and automated CI/CD pipelines for cloud infrastructure deployment

Big Data Engineer Lecture

Naya College
08.2023 - Current
  • Designed and taught detailed coursework for Apache Spark, Kafka, ELK Stack, Linux, Docker, Git.
  • Guided over 100 students in hands-on big data projects.
  • Designed interactive workshops incorporating real-world scenarios.

AI & ML Engineer

Maccabi Health Care Services
10.2021 - 03.2023
  • Collected and parsed data from various sources using Kafka and Nifi
  • Performed data curation using Pandas, SQL, Hive, and Impala
  • Created workflows for Data Lake, ML models and data operations using Spark, Python and Airflow
  • Developed and implemented active monitors and dashboards of controls and programs for precision and efficacy ETLs and ML processes using ELK

Automation Engineer

Maccabi Health Care Services
08.2019 - 10.2021
  • Validated system KPIs and trend analysis using Power BI and SQL for critical scenarios prediction
  • Performed cross-system data analysis to identify and resolve root causes
  • Initiated and led POCs for service quality improvement through data-driven solutions

Senior Monitoring and Automation Developer

Maccabi Health Care Services
09.2018 - 08.2019
  • Led enterprise monitoring solutions development and operations
  • Developed complex automation solutions using Python, PowerShell, Batch, Bash, and Groovy
  • Maintained SLA reporting and system availability improvements

Monitoring Services Developer Team Leader

Mamram IDF
01.2016 - 09.2018
  • Managed and mentored team providing monitoring solutions for IDF - operational and combat support systems
  • Analyzed system architecture and fault points for purpose of designing complex monitoring solutions

Monitoring Services Developer

Mamram IDF
01.2014 - 01.2016
  • Monitoring Team Operation, design and development of monitoring solutions, familiarity with IT world, server operations, monitoring agent operations under Windows, Linux, and Unix environments

Education

BSc - Information Technology

The Academic College of Tel Aviv-Yafo
Tel Aviv, Israel
11.2024

Big Data Engineer

Naya College
10-2022

Skills

  • Data Engineering: Snowflake, Apache Airflow (MWAA), DBT, Apache Spark, Pandas, Apache Kafka, ELK Stack
  • Programming: Python, SQL, Bash, PowerShell
  • DevOps & Tools: GitLab CI/CD, Azure DevOps, Infrastructure as Code
  • Cloud & Infrastructure: AWS (Lambda, S3), Terragrunt, Docker, Linux/Windows Servers
  • Databases: SQL Server, OLAP, OLTP
  • Project Management: Agile Methodologies, Cross-functional Team Leadership
  • Data Visualization: Power BI, Business Intelligence Solutions

Volunteering

Data Architect & Engineer 

Elem - New Story Project

Military Service

Senior Data Architect & Engineer

 Mamram Unit (IDF) Reserve Service

Languages

Hebrew (Native)

English (Full Professional)

Timeline

Big Data Engineer Lecture

Naya College
08.2023 - Current

Senior Data Engineer

888 Holdings (William Hill)
03.2023 - Current

AI & ML Engineer

Maccabi Health Care Services
10.2021 - 03.2023

Automation Engineer

Maccabi Health Care Services
08.2019 - 10.2021

Senior Monitoring and Automation Developer

Maccabi Health Care Services
09.2018 - 08.2019

Monitoring Services Developer Team Leader

Mamram IDF
01.2016 - 09.2018

Monitoring Services Developer

Mamram IDF
01.2014 - 01.2016

BSc - Information Technology

The Academic College of Tel Aviv-Yafo

Big Data Engineer

Naya College
Niv Badli