Data Engineer (Python, Azure)

Data Engineer, Data Extraction and ETL.

Middle

B1 English

Required Skills

DWH

Data Platform

SQL

Python

Nice to Have

Databricks

Azure Data Factory

Fabric

AWS Glue

Apache Spark

ETL

CI/CD

API

GitLab

Atlassian Confluence

Jira

Azure

Summary

- Experience at least 3 years in DWH, Data Platform development
- Good knowledge of SQL, Python
- Experience working with at least one of the next technological stacks: DataBricks, Data Factory, Fabric, AWS Glue, Apache Spark.
- Experienced development of REST APIs
- Experience in GitLab, JIRA, Azure DevOps;
- Intermediate English

Are you a talented developer looking for a remote job that lets you show your skills and get decent compensation? Join Upstaff.com, a platform that connects you with hand-picked startups and scale-ups in the US and Europe.

Requirements

Bachelor’s degree in Computer Science or Technical degree.
Experience at least 3 years in DWH, Data Platform development.
Familiarity with data architecture, data modeling concepts.
Good knowledge of SQL, Python.
Experience working with at least one of the next technological stacks: DataBricks, Data Factory, Fabric, AWS Glue, Apache Spark.
Readiness to master new technologies and tools.
Experienced development of REST APIs
Experience in GitLab, JIRA, Azure DevOps;
High level of soft skills, work, and professional ethics.
English — at least Intermediate.

Responsibilities

Eliciting and gathering requirements, description of the requirements
Data model creation
ETL Pipelines & CICD
Definition and configuration and development of ETL pipelines
Preparation of data for quality assurance
Automation of deployment and test processes
Creation of documentation in Confluence and GitLab
API's creation
Testing the developed solutions
Maintenance the solution

Not your tech stack?

Join the Upstaff community and we are looking for the best project for you. Be ready for the next steps:

Create your profile on our website (import from LinkedIn)
20-30-minute screening call
Technical interview
Feedback
Project Selection (we are looking for the best project for you).

We work with developers from 50+ countries in different regions: Europe, LATAM, the U.S. (W-9 form owners), Canada, Asia (Philippines, Indonesia), Oceania (Australia, New Zealand, Papua New Guinea), and the the UK.

We don’t have a legal and ethical basis to accept applicants from the following countries: Russia, Belarus, Iran, North Korea
We do not provide visa assistance, and our cooperation model does not include the benefits typically offered with direct hire.