ETL Engineer (migrate pipelines from Cloudera to Databricks)

Data Extraction and ETL, Data Engineer

$ 4,500/month

Upper-Intermediate English

Senior

Ukraine

Are you a talented developer looking for a remote job that lets you show your skills and get decent compensation? Join Upstaff.com, a platform that connects you with hand-picked startups and scale-ups in the US and Europe.

Summary

•. Lead and coordinate the migration of ETL pipelines from Cloudera to Databricks.
•. Analyze existing pipelines, dependencies, and pain points, and design the target architecture on Databricks.
•. Start in January 2026
•. Domain: Bank

Required Skills

Cloudera

Databricks

SQL

Nice to Have

ETL Pipelines

CI/CD

troubleshooting

Delta lake

Unity

Mlflow

ETL/ELT

Data pipeline design

Apache Spark

Apache Hadoop

Azure

Factory

Synapse

DevOps

Python

PySpark

Git

ID: 800-113-989

Last Updated: 2025-12-15

Main Responsibilities:

Lead and coordinate the migration of ETL pipelines from Cloudera to Databricks.
Analyze existing pipelines, dependencies, and pain points, and design the target architecture on Databricks.
Support the team in troubleshooting and optimizing performance.
Communicate with business and technical stakeholders to align priorities and remove blockers.
Ensure delivery timelines and quality standards are met.

Technical Skills Required:

Strong hands-on experience with Databricks (Delta Lake, Databricks SQL, Unity Catalog, MLflow, Workspace management).
Deep understanding of ETL/ELT concepts, data pipeline design, and data orchestration.
Experience with Cloudera, Spark, and migration between Hadoop-based and cloud-based platforms.
Good knowledge of Azure ecosystem (Data Factory, Synapse, DevOps CI/CD).
Strong programming in Python and PySpark.
Experience with Git, CI/CD, and deployment automation in Databricks.

Advantage: previous experience as a technical lead or migration architect in similar projects.

Not your tech stack?

Join the Upstaff community and we are looking for the best project for you. Be ready for the next steps:

Create your profile on our website (import from LinkedIn)
20-30-minute screening call
Technical interview
Feedback
Project Selection (we are looking for the best project for you).

We work with developers from 50+ countries in different regions: Europe, LATAM, the U.S. (W-9 form owners), Canada, Asia (Philippines, Indonesia), Oceania (Australia, New Zealand, Papua New Guinea), and the the UK.

We don’t have a legal and ethical basis to accept applicants from the following countries: Russia, Belarus, Iran, North Korea
We do not provide visa assistance, and our cooperation model does not include the benefits typically offered with direct hire.