Sergii Ch — Senior Data Engineer

Work Experience

Senior Data Engineer - Meetup, NY, USA

Sep 2021 - Present
Summary:

Participated in optimizing data infrastructure, creating robust ETL pipelines, data ingestion and processing tools, and automation for data quality and monitoring. Also focused on AWS Cloud cost optimization

Responsibilities: 

• Design and build ETL pipelines
• Building tools to ingest and jobs to process several terabytes of data per day
• Building an application for monitoring, audit, and data quality automation
• AWS Cloud Cost Optimisation
• On-call shift and support of the production environment
• Creating an ETL Redshift SQL script for data processing and aggregation

Technologies: SQL, NoSQL, AWS Cloud Services (Redshift, EC2, RDS, EMR, MWAA, S3, IAM, Sqoop, Airflow, Athena, Lambda), Python (Pandas, Boto3, SQLAlchemy), PySpark, Apache Spark, Elasticsearch (OpenSearch)

Senior Data Engineer - Nordstrom, WA, USA

Jan 2020 - Sep 2021
Summary: Involved in developing ETL pipelines using PySpark for data processing from Apache Kafka topics using an intermediate framework, integration of data quality checks, and creation of ETL Teradata SQL scripts.
Responsibilities: 

• Design and build ETL pipelines
• Building PySpark's jobs to process data from the Apache Kafka Topics with the use of the intermediate framework (IsF)
• Creating and integrating data quality checks
• Creating an ETL Teradata SQL script for data processing

Technologies: SQL, NoSQL, Teradata, Presto, Python, batch-oriented workflows with Apache Airflow, data monitoring with DashBoards in DataDog, New Relic

Oracle(SQL, PL/SQL)/ETL (IBM DataStage) Developer - Teva, Israel

Aug 2019 - Dec 2019
Summary: Worked on IBM Datastage server jobs and processes, creation and optimization of Oracle database objects, and performance tuning of SQL queries and PL/SQL.
Responsibilities: 

• Create/manage/support IBM Datastage server Jobs and Processes.
• Create/modify Oracle database objects.
• Optimizing SQL queries and stored procedures.
• Working with partitioned tables.
• Working with UC4 Job Scheduling.
• Create and optimize Oracle PL/SQL stored procedures and functions

Technologies: SQL, PL/SQL, IBM DataStage, Oracle database, UC4 Job Scheduling

Oracle (SQL, PL/SQL) Developer - Deutsche Bank, NY department, USA

Jun 2013 - Aug 2019
Summary: Engaged in supporting and developing data storage and processing tools within the DB Clear Platform, creating workflows in Informatica, and optimizing database performance.
Responsibilities: 

• DB Clear Platform (internal system) Supporting and development including DataStorage, Tool for Data Processing (ETL Tool), and UI Reporting Tool.
• Creating workflows in Informatica for data loading data to the staging layer.
• Creating Oracle DB objects such as packages, PL/SQL SPs and functions; tables (partitioned tables); indexes, and others.
• Optimization of SQL queries, SPs, and functions.
• Creating Workflows for data uploading into DB storage from flat files (CSV, txt, XML), from tables/views to another layer, from different sources to output flat files.
• Creating reports in the UI Reporting System.

Technologies: Oracle DB (packages, PL/SQL SPs, functions, tables, indexes), SQL performance tuning, Informatica, data loading workflows

DBA Engineer - various projects, USA based

Jun 2010 - Jun 2013
Summary: Focused on creating ETL processes, data migration, optimization of SQL queries and stored procedures, web programming, and database administration.
Responsibilities: 

• Creation of ETL Processes, SQL Server Integration Services, SalesForce.com, APEX Data Loader
• Data Migration: MySQL, PostgreSQL
• Creating, managing, and optimizing MySQL stored procedures that were used in the CrystalReports as a source
• Optimization of SQL queries
• Creating and optimizing Oracle PL/SQL stored procedures and functions.
• Web-programming, ColdFusion, JavaScript, JQuery
• Database administration: Oracle 9i, 10g, 11g, RMAN, Linux/Unix

Technologies: SQL Server Integration Services, Salesforce.com, APEX Data Loader, MySQL, PostgreSQL, Oracle PL/SQL, ColdFusion, JavaScript, JQuery, Oracle Database (9i, 10g, 11g), RMAN, Linux/Unix

Database Developer - various projects

Aug 2007 - Nov 2010
Summary: Responsible for the maintenance and creation of Oracle Database objects, development of complex SQL queries for various projects, and development of web and WinForms applications.
Responsibilities:

• Maintenance and creation of Oracle Database objects, such as tables, views, procedures, functions, packages, indexes, triggers, etc.
• Development of database structures;
• Build complex queries using an analytical function, PL/SQL Collection, and Dynamic SQL;
• SQL queries optimization;
• Creation and granting of roles and privileges on data access for users;
• Implementation Import/Export. Using Oracle Export/Import (exp, imp), Data Pump Export/Import (expdp, impdp) Utilities and Data Pump API of PL/SQL (DBMS_DATAPUMP package);
• Development of web applications on PHP + Oracle 10g;
• Development of WinForms with C Sharp (.Net)

Technologies: Oracle Database (objects, queries, analytics, PL/SQL), Export/Import utilities, PHP, Oracle 10g, C# (.Net)

Education

• Kharkiv National University of Internal Affairs
  Master’s degree in Information Control Systems and Technologies