Senior Python backend developer and data engineer specializing in data management. Over 15 years of experience in Big Data, database design, administration, and maintenance. Experience in designing and implementing information systems and data pipelines.
I was part of a team that created a cost-optimization product for Kubernetes.
At this job conducted a thorough POC for overcoming data consistency issues in dashboards on TimescaleDB, Apache Druid and Snowflake, including a way to perform stress tests on those databases. This POC provided crucial information about the required problem solution.
Created a dynamic rule based system to pinpoint expensive Snowflake queries. This allowed us to potentially reduce expenses on Snowflake by over $100 per day.
3d Signals is a leading solution supplier in the Industry 4.0 field. The company provides a solution that includes IoT devices and algorithms that analyze data flowing in real-time.
SAM designed a unique solution for Telco's and ISP's to protect their home users from Cyberattacks by controlling the growing IoT devices in users' homes. SAM's technology shifts the scope of home security to a network-centric approach, providing a unified software-based solution, allowing users to have the enterprise-grade protection they need. In addition to cybersecurity abilities, SAM helps Telcos and cable operators enrich their value proposition for their customers by providing network visibility, management abilities, and parental controls.
As a consultant, I am involved in establishing new projects as well as consulting on existing projects. I wrote Spark code for Spark and Spark Streaming projects, mostly using Scala and occasionally using Python.
Projects in which I participated include on-premise-based projects and cloud-based projects (AWS, OpenStack, Azure). I used Ansible to automatically establish new Hadoop clusters and connect them to object stores.
I joined Amdocs NBU to promote a product migration from SQL Server to Oracle. The process included re-designing of existing processes and designing new processes.
I was a part of the successful implementation of the product on several client sites, including sizing and initial design until the final delivery and ongoing development and support. Implementation was done on very tight schedules and with high effort.
I lead a team of DBAs that were responsible for the company's largest implementation dealing with both applicative and infrastructure aspects. As part of this project I designed, developed, and implemented a solution that extracted mass data from the database using Oracle Data Integrator and Python.
I was on a temporary project as part of the production team, which is responsible for the entire production system databases, including backup and recovery, upgrades and general care of database problems. In addition, I also wrote papers about database development environments and database version control tools.
Responsible for a project loading and processing millions of records per day.
* Worked closely with customers
* Promoted the project on the way to being fully production
* Established a RAC cluster based on Oracle 11gR2 on Solaris
* Mastered Oracle Data Integrator (ODI)
Responsible for the company's databases which are located on remote farms.
* Successful database upgrades from 8i to 10g.
* Performance improvements in the application and the database.
* Applying development methods under Oracle database environment.
* Migrating the backup methods to RMAN
* Migrating the Oracle operation system's environment from Windows to Linux
In this position, I worked for a major IDF unit and I was responsible for one of the major data warehouse databases and on an in-house ETL application. I was also responsible for replacing that application with Informatica.
• Performance improvement of about 25% and replacing some manual procedures with automatic ones.
• I combined my knowledge from the Mainframe environment and acquired new skills to improve current ETL processes
Designed and implemented information systems for VocalTec's internal use as well as for customers.
• Implemented 3rd-party tools such as "Lavie TimeTech" that improved the company's control over the employees' attendance.
• Developed an internal CRM system in Lotus Notes and implemented it among VocalTec employees worldwide.
• Developed an E-Commerce solution based on Oracle Web Server and PowerBuilder on Windows and Solaris.
I was the head of a team of 4 people responsible for a large site of ADABAS databases. Later on, I
joined a newly established Oracle DBA team. In that position, I was responsible for several new projects including Oracle installations, design, and query optimizations.
• Administration and management of a large number of ADABAS databases.
• Design and implementation of new Oracle databases for several new projects including application tuning and SQL standardization
Backend design
Redis for Python Developers
Redis for Python Developers
Redis Streams
RU101: Introduction to Redis Data Structures
AWS Business Professional
AWS Technical Professional