Vaibhav Singh
Aurora,IL
Summary
Sr Principal Data Engineer/Manager With Expertise in Data Quality | 2X AWS Certified | ETL Architect (Ab Initio) | Data Analytics
- Passionate about Data Quality strategies and implementation, Driving DQ strategy and collaborate with stakeholders to implement solutions for Discover Financial Services.
- Proficient in designing and implementing event-driven data quality infrastructure, leveraging both open-source and AWS services.
- Data engineer with a proven track record of collaborating with diverse clients across various domains and environments over the past 14 years.
- Holds certifications as an AWS Certified Solution Architect Associate and Developers Associate, with a comprehensive understanding of numerous AWS services and their applications.
- Demonstrates adeptness in developing data pipelines to support data analytics solutions, encompassing data collection (Kafka/Kinesis, SQS, DMS), storage (S3/EMRFS, DynamoDB, RDS, Redshift), processing (EMR, Hadoop, Glue), analysis (Athena), and visualization (QuickSight, Kibana, Tableau).
- Proficient in DevOps practices with expertise in deploying applications on Openshift platforms.
- Expert in architecting, designing, and coding comprehensive Ab Initio ETL applications, including E>IT template and appconf development, as well as maintaining data warehouses and metadata management systems.
- Proficient is platform implementation and maintenance using openshift containerization, Helm, Jenkins and DevOps best practices.
- Detail-oriented, organized, and meticulous employee. Works at fast pace to meet tight deadlines. Enthusiastic team player ready to contribute to company success.
Overview
14
14
years of professional experience
1
1
Certification
Work History
Senior Principal Software Engineer
Discover Financial Services
12.2020 - Current
- Directing implementation of data quality strategy at Discover Financial Services while overseeing team of 8 resources.
- Managing and maintaining data quality platforms, driving significant enhancements, and fostering adoption across data teams by facilitating their onboarding to platforms.
- Led development of critical features from ideation to launch, ensuring alignment with business objectives and stakeholder requirements.
Technology Specialist
Cognizant (Client: Discover Financial Services)
10.2019 - 11.2020
- Implemented event-based pipeline utilizing Kafka, Python, Ab Initio DQE, HashiCorp Vault, Elasticsearch, and Kibana to conduct data quality assessments on S3 datasets. Orchestrated code deployment in Openshift from GIT repositories using Jenkins pipelines, with code execution on Openshift clusters and EC2 instances. Employed Python modules for credential provisioning, Kafka consumers for data ingestion, and HashiCorp Vault for secure credential management. Established robust CI/CD pipeline for DevOps practices and developed APIs using Python, complemented by insightful Kibana Dashboards for monitoring and analysis.
Technology Specialist
Cognizant (Client: Walgreens)
08.2018 - 10.2019
- Developed versatile Ab Initio DML parser tailored for claim load files, with ongoing enhancements for regular BAU operations and blueprints for seed data implementation.
Lead Data Engineer
Cognizant (Client: Express Scripts)
02.2014 - 07.2018
- Developed a Regression Test Automation (RTM) tool leveraging Ab Initio graphs and E>IT. Crafted E>IT templates and appconfs from the ground up, while designing generic graphs using PDL for metadata retrieval and transformation generation.
- Implemented ABL Benefit Builder for loading benefits information into database, facilitating Automated Benefit Load and group load processing. Additionally, designed WellPoint Reporting in color-coded Excel format using Ab Initio.
Sr. Associate Engineer
Accenture Services Pvt. Ltd. (Client: Travelers)
10.2012 - 01.2014
- Building graphs and plans from the scratch, Looping plans and resource pooling
- Policy Delete Reload Tool – Premium Data warehouse (Ab Initio)
- Intraday Processing – Premium Data warehouse(Ab Initio)
- ETL Alerts - Global (Unix)
- Query Banding – Global (Ab Initio, Teradata)
- Loss Data warehouse enhancements
Associate Data Engineer
Accenture Services Pvt. Ltd. (Client: Travelers)
07.2010 - 10.2012
- Trained in Informatica
- Building graphs and plans from the scratch, Looping plans and resource pooling
Education
Bachelor of Engineering Technology -
Laxmi Devi Institute of Engineering And Technology
08.2009
Skills
- Ul
- Data Quality Strategy and Implementation
- SQL
- Python
- Git hub
- Openshift, Kubernetes and Docker
- Ab Initio
- Anomalo Data Quality
- Jenkins
- Data Modeling
- Teradata
- UNIX
- Autosys, Maestro
- Data Warehouse / Mart / Cubes
- ETL
- API Development
- Hadoop
- Hashicorp Vault
Certification
- AWS Solution Architect Associate
- AWS Certified Developers Associate 2020
- Openshift for beginners - Udemy
- Introduction to Python development – Linux Academy
- Apache Kafka Series - Udemy
- TEO-121 (Teradata Certified Professional) - Teradata
Timeline
Senior Principal Software Engineer
Discover Financial Services
12.2020 - Current
Technology Specialist
Cognizant (Client: Discover Financial Services)
10.2019 - 11.2020
Technology Specialist
Cognizant (Client: Walgreens)
08.2018 - 10.2019
Lead Data Engineer
Cognizant (Client: Express Scripts)
02.2014 - 07.2018
Sr. Associate Engineer
Accenture Services Pvt. Ltd. (Client: Travelers)
10.2012 - 01.2014
Associate Data Engineer
Accenture Services Pvt. Ltd. (Client: Travelers)
07.2010 - 10.2012
Bachelor of Engineering Technology -
Laxmi Devi Institute of Engineering And Technology
Similar Profiles
Latasha PalmerLatasha Palmer
Home Loans Document Specialist at Discover Bank/Discover Financial ServicesHome Loans Document Specialist at Discover Bank/Discover Financial Services
Justin SicienskiJustin Sicienski
Principal Product Manager (Commercial Payments) at Discover Global Network - Discover Financial ServicesPrincipal Product Manager (Commercial Payments) at Discover Global Network - Discover Financial Services
Camille HolmesCamille Holmes
Quality Control Specialist at Discover Financial Services, DFSQuality Control Specialist at Discover Financial Services, DFS
HAZZEL MARTINEZHAZZEL MARTINEZ
Senior Operation Strategy Analyst at Discover Financial ServicesSenior Operation Strategy Analyst at Discover Financial Services
Jose FrancoJose Franco
Carpenter at R&D ThielCarpenter at R&D Thiel