Yuriy D. Data Engineer / Data Architect
Summary
- 14+ years of experience in IT;
- Data Engineering and Data Architecture Experience
- System-level programming, OOP and OOD, functional programming;
- Profiling and optimizing code;
- Writing reliable code;
- Writing product documentation, supporting products;
- Team working, team leading;
- Strong knowledge in Mathematics and physics (over 30 scientific publications);
- Mentoring skills as a senior developer;
Experience
A software company – Chief Technology Officer, Vilnius
2016–Present
Description: IT company that is aimed to power our client's business by solving the toughest challenges using cutting-edge technology and deep sector analysis.
Technologies: Scala, Reactive (Akka, Play), Lightbend enterprise platforms, SQL and NoSQL DataBases, Data Lake implementation, Kafka, Spark, Hadoop framework, Docker, Git.
A software company - Chief Technology Officer
01/09/2016–Present
Description: Designing and developing backend servers for corporate systems for streaming and batch data processing.
Responsibilities:
- Making architecture decisions related to AWS S3, microservices etc.
- Prototype distributed systems
- Design Data Lake infrastructure
- Design batch and event-driven workflows for big data processing
- Big Data Hadoop Architect
- Implementation Hortonworks Data Flow ( HDF) and apache Nifi /miNifi and Kafka
Technologies: Amazon Web Services, Google Cloud Platform, Scala, Akka Actors, Akka Streams, Alpakka, Kafka, Playframework, Scalatest, Specs2, Cats, Slick, MySQL, PostgreSQL, Cassandra, Apache Spark, Apache superset, Hadoop ecosystem, Protocol buffer, Google Guice, Docker, Git.
Server backend team leader
19/01/2015–01/09/2016
Description: Designing and developing server side for messenger. Scala was used as a main language for development. Used technologies: Akka, Play frameworks, NoSQL DBs (cassandra, aerospike), inter datacenter interaction, REST and Websocket API development. ProtocolBuffer for client-server interaction was used. Elasticsesrch was used as a search engine. All servers requests processed asynchronously
Java/C++ developer
2009–2014
Description: Web development, servers administration, metatrader experts programming, data analyzing etc.
C++ software developer
2001–2009
Description: Implementing and developing various software projects for MS Windows, Linux, FreeBSD. Designing and developing libraries for PDF, image, network tasks processing. Writing help documentation for the products. Products support.
C++ software developer
2001–2009
Description: Implementing and developing various software projects for MS Windows, Linux, FreeBSD. Designing and developing libraries for PDF, image, network tasks processing. Writing help documentation for the products. Products support.
Education
Master of Mathematics, Physics and IT
Ternopil National Pedagogical University, Physics and Mathematics department, Ternopil (Ukraine)
1992–1997
Ternopil National Pedagogical University, Ternopil (Ukraine)
Post-graduate
1997–2001
Philosophy Doctor in Physics and mathematics
2006
Certificates
Scala and Akka Lightbend Certified Expert