ETL Engineer (migrate pipelines from Cloudera to Databricks)

Data Extraction and ETL, Data Engineer.

Senior

Upper-Intermediate English

Required Skills

Cloudera

Databricks

SQL

Nice to Have

ETL Pipelines

CI/CD

troubleshooting

Delta lake

Unity

Mlflow

ETL/ELT

Data pipeline design

Apache Spark

Apache Hadoop

Azure

Factory

Synapse

DevOps

Python

PySpark

Git

Summary

• Lead and coordinate the migration of ETL pipelines from Cloudera to Databricks.
• Analyze existing pipelines, dependencies, and pain points, and design the target architecture on Databricks.
• Start in January 2026
• Domain: Bank

Are you a talented developer looking for a remote job that lets you show your skills and get decent compensation? Join Upstaff.com, a platform that connects you with hand-picked startups and scale-ups in the US and Europe.

Main Responsibilities:

Lead and coordinate the migration of ETL pipelines from Cloudera to Databricks.
Analyze existing pipelines, dependencies, and pain points, and design the target architecture on Databricks.
Support the team in troubleshooting and optimizing performance.
Communicate with business and technical stakeholders to align priorities and remove blockers.
Ensure delivery timelines and quality standards are met.

ETL Engineer (migrate pipelines from Cloudera to Databricks)

Technical Skills Required:

Strong hands-on experience with Databricks (Delta Lake, Databricks SQL, Unity Catalog, MLflow, Workspace management).
Deep understanding of ETL/ELT concepts, data pipeline design, and data orchestration.
Experience with Cloudera, Spark, and migration between Hadoop-based and cloud-based platforms.
Good knowledge of Azure ecosystem (Data Factory, Synapse, DevOps CI/CD).
Strong programming in Python and PySpark.
Experience with Git, CI/CD, and deployment automation in Databricks.

Advantage: previous experience as a technical lead or migration architect in similar projects.

How to Apply for ETL Engineer (migrate pipelines from Cloudera to Databricks)

Be ready for the next steps:

Create your profile on our website (import from LinkedIn)
20-30-minute screening call
Technical interview feedback
Project Selection (we are looking for the best project for you).

Who can apply:

We work with developers across Europe, LATAM, the U.S. (W-9 form owners), Canada, Asia, Oceania, and the UK.
We do not provide visa assistance, and this cooperation model does not include direct-hire benefits.
We cannot accept applicants from Russia, Belarus, Iran, or North Korea.

See Open Jobs

Not your stack?

Join the Upstaff community and we are looking for the best project for you.