Yuriy D. — Data Engineer / Data Architect

Expertise in Data Engineer.

Last verified on March, 2026

Core Skills

Python

C++

Scala

Apache Airflow

Bio Summary

15+ years of experience in IT;
Strong knowledge in Mathematics and physics (over 30 scientific publications);
Data Engineering and Data Architecture Experience
System-level programming, OOP and OOD, functional programming;
Profiling and optimizing code; Writing reliable code; Writing product documentation, supporting products;
Team working, team leading; Mentoring skills as a senior developer;

Technical Skills

Programming Languages	C++, GLSL, Java, JavaScript, Python, Scala
Scala Frameworks	Akka, Apache Spark, Play Framework
Scala Libraries and Tools	Akka, Akka Actors, Akka Streams, Alpakka, Scala Cats, Scalatest
Java Frameworks	Apache Spark, Hibernate, Play Framework, Spring
Java Libraries and Tools	Java Server Pages (JSP), Spring model-view-controller (MVC) framework, Spring Security
JavaScript Frameworks	jQuery
Data Analysis and Visualization Technologies	Apache Airflow, Apache Spark
Security	Spring Security
Databases & Management Systems / ORM	Aerospike, Apache Hadoop, Apache Spark, AWS ElasticSearch, Cassandra, Data Lake, Hadoop ecosystem, Hibernate, MySQL, NoSQL, PostgreSQL, Redis, Slick database query, SQL
UI Frameworks, Libraries, and Browsers	CSS, HTML, jQuery
Cloud Platforms, Services & Computing	AWS, GCP
Amazon Web Services	AWS ElasticSearch
Third Party Tools / IDEs / SDK / Services	ActiveX, DevPartner Studio, Eclipse, IntelliJ IDEA, Visual Studio
Platforms	Aerospike, MetaTrader
Virtualization, Containers and Orchestration	Docker
Operating Systems	FreeBSD, GNU, Linux, macOS, Unix, Windows
Version Control	Git, MS SourceSafe, SVN
Message/Queue/Task Brokers	Kafka
SDK / API and Integrations	RESTful API, Websocket API, Windows API
QA, Test Automation, Security	Scalatest
UI/UX/Wireframing	STL
Mail / Network Protocols / Data transfer	TCP/IP
File Systems, Storage	XML
Other Technical Skills	COM, GDI, Google Guice, Lightbend enterprise platforms, MQL4, Multithreading, Protocol buffer, Reactive, Specs2

Experience

A software company – Chief Technology Officer, Vilnius

2016–Present
Description: IT company that is aimed to power our client's business by solving the toughest challenges using cutting-edge technology and deep sector analysis.
Technologies: Scala, Reactive (Akka, Play), Lightbend enterprise platforms, SQL and NoSQL DataBases, Data Lake implementation, Kafka, Spark, Hadoop framework, Docker, Git.

A software company - Chief Technology Officer

01/09/2016–Present
Description: Designing and developing backend servers for corporate systems for streaming and batch data processing.
Responsibilities:

Making architecture decisions related to AWS S3, microservices etc.
Prototype distributed systems
Design Data Lake infrastructure
Design batch and event-driven workflows for big data processing
Big Data Hadoop Architect
Implementation Hortonworks Data Flow ( HDF) and apache Nifi /miNifi and Kafka

Technologies: Amazon Web Services, Google Cloud Platform, Scala, Akka Actors, Akka Streams, Alpakka, Kafka, Playframework, Scalatest, Specs2, Cats, Slick, MySQL, PostgreSQL, Cassandra, Apache Spark, Apache superset, Hadoop ecosystem, Protocol buffer, Google Guice, Docker, Git.

Server backend team leader

19/01/2015–01/09/2016
Description: Designing and developing server side for messenger. Scala was used as a main language for development. Used technologies: Akka, Play frameworks, NoSQL DBs (cassandra, aerospike), inter datacenter interaction, REST and Websocket API development. ProtocolBuffer for client-server interaction was used. Elasticsesrch was used as a search engine. All servers requests processed asynchronously

Java/C++ developer

2009–2014
Description: Web development, servers administration, metatrader experts programming, data analyzing etc.

C++ software developer

2001–2009
Description: Implementing and developing various software projects for MS Windows, Linux, FreeBSD. Designing and developing libraries for PDF, image, network tasks processing. Writing help documentation for the products. Products support.

C++ software developer

2001–2009
Description: Implementing and developing various software projects for MS Windows, Linux, FreeBSD. Designing and developing libraries for PDF, image, network tasks processing. Writing help documentation for the products. Products support.

Education

Master of Mathematics, Physics and IT
Ternopil National Pedagogical University, Physics and Mathematics department, Ternopil (Ukraine)
1992–1997

Ternopil National Pedagogical University, Ternopil (Ukraine)
Post-graduate
1997–2001

Philosophy Doctor in Physics and mathematics
2006

Certificates

Scala and Akka Lightbend Certified Expert

How to hire with Upstaff

1

Talk to Our Talent Expert

Our journey starts with a 30-min discovery call to explore your project challenges, technical needs and team diversity.

2

Meet Carefully Matched Talents

Within 1-3 days, we’ll share profiles and connect you with the right talents for your project. Schedule a call to meet engineers in person.

3

Validate Your Choice

Bring new talent on board with a trial period to confirm you hire the right one. There are no termination fees or hidden costs.

Why Upstaff

Upstaff is a technology partner with expertise in AI, Web3, Software, and Data. We help businesses gain competitive edge by optimizing existing systems and utilizing modern technology to fuel business growth.

Real-time project team launch

<24h

Interview First Engineers

Upstaff's network enables clients to access specialists within hours & days, streamlining the hiring process to 24-48 hours, start ASAP.

x10

Faster Talent Acquisition

Upstaff's network & platform enables clients to scale up and down blazing fast. Every hire typically is 10x faster comparing to regular recruitement workflow.

Vetted and Trusted Engineers

100%

Security And Vetting-First

AI tools and expert human reviewers in the vetting process is combined with track record & historically collected feedbacks from clients and teammates.

~50h

Save Time For Deep Vetting

In average, we save over 50 hours of client team to interview candidates for each job position. We are fueled by a passion for tech expertise, drawn from our deep understanding of the industry.

Flexible Engagement Models

Custom Engagement Models

Flexible staffing solutions, accommodating both short-term projects and longer-term engagements, full-time & part-time

Unique Talent Ecosystem

Candidate Staffing Platform stores data about past and present candidates, enables fast work and scalability, providing clients with valuable insights into their talent pipeline.

Transparent

$0

No Hidden Costs

Price quoted is the total price to you. No hidden or unexpected cost for for candidate placement.

x1

One Consolidated Invoice

No matter how many engineers you employ, there is only one monthly consolidated invoice.

Ready to hire Yuriy D.
or someone with similar Skills?

Book a call with Yuriy D.

Start Hiring