Sandun Dayananda — Data Engineer

Expertise in Data Engineer (7.0 yr.), DevOps (3.0 yr.), Data Extraction and ETL (7.0 yr.), Database Management and Administration (7.0 yr.), Data Visualization (7.0 yr.).

Last verified on December, 2025

Core Skills

Unreal Engine

OOP

Clean Architecture

Python

Docker

Bio Summary

Expert Data Engineer with 6+ years of professional experience, specializing in DataOps and DevOps, with a master's degree in Industrial Analytics from Uppsala University. Proficient in building scalable data pipelines using a variety of technologies including Snowflake, AWS, Lambda, PySpark, and Kafka, evidenced by success in event-driven pipeline creation and real-time data ingestion projects. Skilled in automating deployment using Ansible and GitHub Actions, and in data transformation with a focus on automation and efficiency. Accomplished in data analysis and visualization, utilizing tools such as Power BI, DAX, and Power Query. Possesses strong programming skills with extensive use of Python, and experience in database support with expertise in SQL. Demonstrated ability to develop IoT solutions, engage in network engineering, and apply advanced Linux administration techniques.

Technical Skills

Programming Languages	PHP, Python
C++ Libraries and Tools	C/C++/C#
JavaScript Frameworks	jQuery
PHP Frameworks	Laravel
AI & Machine Learning	NLP, OpenCV
Python Libraries and Tools	PySpark
Data Analysis and Visualization Technologies	ETL, Power BI
Databases & Management Systems / ORM	AWS ElasticSearch, AWS Redshift, IBM DB2, Oracle Database, Snowflake
UI Frameworks, Libraries, and Browsers	jQuery
Amazon Web Services	AWS Aurora, AWS ElasticSearch, AWS Glue, AWS Lambda, AWS Redshift
Deployment, CI/CD & Administration	Ansible
Mail / Network Protocols / Data transfer	Cisco switches, VoIP
Methodologies, Paradigms and Patterns	Clean Architecture, OOP
Virtualization, Containers and Orchestration	Docker
Version Control	Github Actions
Platforms	IOT, WordPress
Operating Systems	Linux
Logging and Monitoring	Logstash
Message/Queue/Task Brokers	RabbitMQ
Other Technical Skills	DAX Studio, Firewall configuration, Gitlab Runner, SAS, Snowpipe, Unreal Engine

Work Experience

Data Engineer, Event driven pipeline for data ingestion from Snowflake to AWS Aurora

Duration: January 2024 - Present (2 years)
Summary: Event driven pipeline to ingest data from Snowflake to AWS Aurora with Lambda, Glue, PySpark, Snowflake Streams & Tasks
Responsibilities: Data engineering and automation for efficient data ingestion and processing
Technologies: Lambda, Glue, PySpark, Snowflake Streams, Tasks
Data Engineer, Ansible deployment with GitHub CI/CD

Duration: January 2024 - Present (2 years)
Summary: Ansible deployment on a remote server with a self hosted GitHub runner and GitHub Actions
Responsibilities: Implementing CI/CD pipelines and automation tasks
Technologies: Ansible, GitHub Actions, GitHub runner
Data Engineer, Kafka streaming solution in Docker

Duration: January 2024 - Present (2 years)
Summary: Kafka streaming solution in Docker with Snowpipe streaming
Responsibilities: Setting up streaming solutions and containers for data flow management
Technologies: Kafka, Docker, Snowpipe
Data Engineer, Network Port Mapping Data Transformation

Duration: January 2024 - Present (2 years)
Summary: Network Port Mapping Data Transformation - Automation
Responsibilities: Automating data transformations and network configurations
Technologies: Data transformation tools, Automation scripts
Data Engineer, Batch data pipeline from S3 to Snowflake

Duration: January 2024 - Present (2 years)
Summary: Build end to end batch data pipeline from S3 to Snowflake
Responsibilities: Constructing batch data pipelines for large scale data transfer
Technologies: Amazon S3, Snowflake
Data Engineer, Realtime data ingestion to Elasticsearch

Duration: January 2024 - Present (2 years)
Summary: Realtime data ingestion from RabbitMQ and Logstash to Elasticsearch
Responsibilities: Developing systems for realtime data ingestion and search optimization
Technologies: RabbitMQ, Logstash, Elasticsearch
Data Analyst, Design Power App and Power BI Dashboard for Operator Workloads

Duration: November 2022 - May 2023 (7 months)
Summary:

Design Power App to track operator workloads and get user inputs with the QR scanning option and load them into the Dataverse Database model
Finally, design a Power BI dashboard to visualize real-time data

Responsibilities: App development, data integration, and dashboard visualization
Technologies: Power Apps, Dataverse, Power BI, DAX, Power Query
Data Engineer, Oracle to Snowflake Data Migration

Duration: August 2021 - August 2022 (1 year 1 month)
Summary: Data Migration from Oracle to Snowflake, Design ETL flows and data integration
Responsibilities: Data migration, ETL flow design, and data integration
Technologies: Oracle, Snowflake, ETL tools, pandas, matplotlib, spark, kafka
Associate Data Engineer, Data Engineering for Banking Systems

Duration: December 2019 - July 2021 (1 year 8 months)
Summary: Associate Data Engineer working on various bank systems for data integration and ETL architecture analysis
Responsibilities: Data integration and analytics for banking systems
Technologies: SAS Data Integration Studio, Data Lake, IBM DB2, ETL architecture
Database Support Engineer, Custom SQL Queries and DB Optimization

Duration: July 2019 - November 2019 (5 months)
Summary: Developing customized queries and database optimization for customer needs
Responsibilities: Database support, customization, and optimization
Technologies: MS SQL, Database Indexing
Junior IOT Engineer, Image Processing and IOT Device Programming

Duration: October 2018 - April 2019 (7 months)
Summary: Developing an image processing application to identify Sinhala letters and a desktop automation tool
Responsibilities: Programming IOT devices and applications for image processing
Technologies: C++, Python, Shell Scripting, Open CV, Tesseract, Ubuntu OS
Associate Backend Developer, Backend Development with PHP

Duration: May 2018 - September 2018 (5 months)
Summary: Development of backend platforms using PHP frameworks and content management systems
Responsibilities: Backend development and web content management
Technologies: PHP, Laravel, Open Cart, WordPress
Network Engineer Intern, Network Engineering and Server Configuration

Duration: April 2017 - October 2017 (7 months)
Summary: Configuration and design of network systems, Linux server configuration
Responsibilities: Network engineering and server management
Technologies: CISCO, HP, Linux, VoIP
Education

Uppsala University
Master's degree, Industrial Analytics
August 2022 - August 2024
Wrexham Glyndŵr University
BSc (Hons) Computing, Data Science
2020 - 2021
Sri Lanka Institute of Advanced Technological Education (SLIATE)
Electrical and Electronic Engineering, Computer Systems and Network Engineering
2015 - 2018
SLIIT
Advanced Linux Administration
2017 - 2017

How to hire with Upstaff

Talk to Our Talent Expert

Our journey starts with a 30-min discovery call to explore your project challenges, technical needs and team diversity.

Meet Carefully Matched Talents

Within 1-3 days, we’ll share profiles and connect you with the right talents for your project. Schedule a call to meet engineers in person.

Validate Your Choice

Bring new talent on board with a trial period to confirm you hire the right one. There are no termination fees or hidden costs.

Why Upstaff

Upstaff is a technology partner with expertise in AI, Web3, Software, and Data. We help businesses gain competitive edge by optimizing existing systems and utilizing modern technology to fuel business growth.

Real-time project team launch

<24h

Interview First Engineers

Upstaff's network enables clients to access specialists within hours & days, streamlining the hiring process to 24-48 hours, start ASAP.

x10

Faster Talent Acquisition

Upstaff's network & platform enables clients to scale up and down blazing fast. Every hire typically is 10x faster comparing to regular recruitement workflow.

Vetted and Trusted Engineers

100%

Security And Vetting-First

AI tools and expert human reviewers in the vetting process is combined with track record & historically collected feedbacks from clients and teammates.

~50h

Save Time For Deep Vetting

In average, we save over 50 hours of client team to interview candidates for each job position. We are fueled by a passion for tech expertise, drawn from our deep understanding of the industry.

Flexible Engagement Models

Custom Engagement Models

Flexible staffing solutions, accommodating both short-term projects and longer-term engagements, full-time & part-time

Unique Talent Ecosystem

Candidate Staffing Platform stores data about past and present candidates, enables fast work and scalability, providing clients with valuable insights into their talent pipeline.

Transparent

No Hidden Costs

Price quoted is the total price to you. No hidden or unexpected cost for for candidate placement.

One Consolidated Invoice

No matter how many engineers you employ, there is only one monthly consolidated invoice.

Ready to hire Sandun Dayananda
or someone with similar Skills?

Book a call with Sandun Dayananda

Start Hiring