Yuriy D., Data Engineer / Data Architect

Data Engineer
english B1 (Intermediate) English
seniority Senior (5-10 years)
location Ternopil, Ukraine UTC+02:00

Summary

- 14+ years of experience in IT;
- Data Engineering and Data Architecture Experience
- System-level programming, OOP and OOD, functional programming;
- Profiling and optimizing code;
- Writing reliable code;
- Writing product documentation, supporting products;
- Team working, team leading;
- Strong knowledge in Mathematics and physics (over 30 scientific publications);
- Mentoring skills as a senior developer;

Main Skills

Programming Languages

Scala Frameworks

Akka Apache Spark Play Framework

Scala Libraries and Tools

Akka Akka Actors Akka Streams Alpakka Scala Cats Scalatest

Java Frameworks

Apache Spark Hibernate Play Framework Spring

UI Frameworks, Libraries, and Browsers

CSS HTML jQuery XML

Java Libraries and Tools

Java Server Pages (JSP) Spring model-view-controller (MVC) framework Spring Security

JavaScript Frameworks

jQuery

Data Analysis and Visualization Technologies

Apache Spark

Databases & Management Systems / ORM

Aerospike Apache Hadoop Apache Spark AWS ElasticSearch Cassandra Data Lake Hadoop ecosystem Hibernate MySQL NoSQL PostgreSQL Redis Slick database query SQL

Cloud Platforms, Services & Computing

Amazon Web Services

AWS ElasticSearch

Third Party Tools / IDEs / SDK / Services

ActiveX DevPartner Studio Eclipse IntelliJ IDEA Visual Studio

Platforms

Aerospike MetaTrader

Virtualization, Containers and Orchestration

Docker

Operating Systems

FreeBSD GNU Linux macOS Unix Windows

Version Control

Git MS SourceSafe SVN

Message/Queue/Task Brokers

Kafka

SDK / API and Integrations

RESTful API Websocket API Windows API

QA, Test Automation, Security

Scalatest

UI/UX/Wireframing

STL

Mail / Network Protocols / Data transfer

TCP/IP

Other Technical Skills

COM GDI Google Guice Lightbend enterprise platforms MQL4 Multithreading Protocol buffer Reactive Specs2
ID: 300-087-150
Last Updated: 2023-07-04

Experience

A software company – Chief Technology Officer, Vilnius

2016–Present
Description: IT company that is aimed to power our client's business by solving the toughest challenges using cutting-edge technology and deep sector analysis.
Technologies:  Scala, Reactive (Akka, Play), Lightbend enterprise platforms, SQL and NoSQL DataBases, Data Lake implementation, Kafka, Spark, Hadoop framework, Docker, Git.

A software company - Chief Technology Officer

01/09/2016–Present
Description: Designing and developing backend servers for corporate systems for streaming and batch data processing.
Responsibilities:

  • Making architecture decisions related to AWS S3, microservices etc.
  • Prototype distributed systems
  • Design Data Lake infrastructure
  • Design batch and event-driven workflows for big data processing
  • Big Data Hadoop Architect
  • Implementation Hortonworks Data Flow ( HDF) and apache Nifi /miNifi and Kafka

Technologies: Amazon Web Services, Google Cloud Platform, Scala, Akka Actors, Akka Streams, Alpakka, Kafka, Playframework, Scalatest, Specs2, Cats, Slick, MySQL, PostgreSQL, Cassandra, Apache Spark, Apache superset, Hadoop ecosystem, Protocol buffer, Google Guice, Docker, Git.

Server backend team leader

19/01/2015–01/09/2016
Description: Designing and developing server side for messenger. Scala was used as a main language for development. Used technologies: Akka, Play frameworks, NoSQL DBs (cassandra, aerospike), inter datacenter interaction, REST and Websocket API development. ProtocolBuffer for client-server interaction was used. Elasticsesrch was used as a search engine. All servers requests processed asynchronously

Java/C++ developer

2009–2014
Description:  Web development, servers administration, metatrader experts programming, data analyzing etc.

C++ software developer 

2001–2009
Description:  Implementing and developing various software projects for MS Windows, Linux, FreeBSD. Designing and developing libraries for PDF, image, network tasks processing. Writing help documentation for the products. Products support.

C++ software developer 

2001–2009
Description:  Implementing and developing various software projects for MS Windows, Linux, FreeBSD. Designing and developing libraries for PDF, image, network tasks processing. Writing help documentation for the products. Products support.

Education

Master of Mathematics, Physics and IT
Ternopil National Pedagogical University, Physics and Mathematics department, Ternopil (Ukraine)
1992–1997

Ternopil National Pedagogical University, Ternopil (Ukraine)
Post-graduate 
1997–2001

Philosophy Doctor in Physics and mathematics
2006

Certificates

Scala and Akka Lightbend Certified Expert