Andrey L. — Data Engineer

Expertise in Data Engineer.

Last verified on July, 2023

Core Skills

Python

Apache Spark

Bio Summary

- 9+ years of experience as a development and architecture of Big Data solutions.
- Advanced English
- Available ASAP

Technical Skills

Programming Languages	Python, Scala
JavaScript Frameworks	AngularJS, Node.js
Java Frameworks	Apache Spark, Hibernate
Scala Frameworks	Apache Spark
.NET Platform	ASP.NET
Mobile Frameworks and Libraries	Ionic
Java Libraries and Tools	Java SE, JPA
JavaScript Libraries and Tools	Yarn
Data Analysis and Visualization Technologies	Apache Hive, Apache Spark, Flume, HBase, MapReduce, Sqoop
Databases & Management Systems / ORM	Apache Hive, Apache Spark, Greenplum, Hibernate, Oracle Database
UI Frameworks, Libraries, and Browsers	Primefaces
Cloud Platforms, Services & Computing	Azure
Message/Queue/Task Brokers	Kafka
Third Party Tools / IDEs / SDK / Services	Yarn
Other Technical Skills	Ignite, SF

Experience

Big Data Specialist – Claro Brazil

Mar/2021 until now.
Responsibilities:

Tecnical leader of Big Data projects in cloud(Azure).
Development of batch solutions using Python, Spark and Hadoop ecosystem (Hive, Yarn and Sqoop).

Big Data Enginner – Safra Banking

Sep/2019 until Mar/2021.
Responsibilities:

Architecture, development and maintenance of solutions using such technologies: Batch processing - Spark (Python and Scala), Hadoop ecosystem (MapReduce, Hive, Yarn and Sqoop) and HBase.
Streaming processing – Flume, Kafka, Ignite, Spark (DStream and structured streaming libraries), Scala, Yarn and HBase.
Responsible for the architecture of legacy and new projects, identifying fragilities and evolution the architecture following the best practices of the market.
Responsible for cluster maintenance and infrastructure evolution(scalability, add new nodes, filesystems problems).

Big Data Enginner – Everis

Oct/2018 until Sep/2019.
Responsibilities:

Development of batch solutions using Python, Spark, Hadoop ecosystem (MapReduce, Hive, Yarn and Sqoop) and Oracle database.

Big Data Developer – Digiage Technologies / Dell EMC

Jul/2017 until Oct/2018.
Responsibilities:

Development of batch solutions using JavaEE, Hadoop ecosystem (MapReduce, Hive, Yarn and Sqoop) and Greenplum database.

Mobile Developer – Action Dev

Mar/2017 until Jul/2017.
Responsibilities:

Acting in the development and maintenance of software mobile applications using technologies such as Node.js, Agular.js and Ionic framework.

Java Developer – Brazilian Army

Feb/2016 until Mar/2017.
Responsibilities:

Development of applications for the internal management of certain sections, using technologies as JSF, Primefaces, JPA and Hibernate, as well as generating and exporting reports with IReport.

Internship in development .NET – Starcorp

Nov/2012 until Feb/2013.
Responsibilities:

Mantain client intranets in the ASP .NET environment.

Education

Master in Business Administration – Software Engineering - Devry Educacional
Jan/2018 until Dec/2018.

Bacharelor in Computer Science – Universidade Paulista
2012 until 2016.

English course – Wizard
2009 until 2012.

Technical Computer Course – Bento Quirino
2009 until 2011.

Integration Architecture(SOA).

Business Architecture.

Certificates

Oracle Certified Associate

Java SE Progammer 8 certification.

How to hire with Upstaff

1

Talk to Our Talent Expert

Our journey starts with a 30-min discovery call to explore your project challenges, technical needs and team diversity.

2

Meet Carefully Matched Talents

Within 1-3 days, we’ll share profiles and connect you with the right talents for your project. Schedule a call to meet engineers in person.

3

Validate Your Choice

Bring new talent on board with a trial period to confirm you hire the right one. There are no termination fees or hidden costs.

Why Upstaff

Upstaff is a technology partner with expertise in AI, Web3, Software, and Data. We help businesses gain competitive edge by optimizing existing systems and utilizing modern technology to fuel business growth.

Real-time project team launch

<24h

Interview First Engineers

Upstaff's network enables clients to access specialists within hours & days, streamlining the hiring process to 24-48 hours, start ASAP.

x10

Faster Talent Acquisition

Upstaff's network & platform enables clients to scale up and down blazing fast. Every hire typically is 10x faster comparing to regular recruitement workflow.

Vetted and Trusted Engineers

100%

Security And Vetting-First

AI tools and expert human reviewers in the vetting process is combined with track record & historically collected feedbacks from clients and teammates.

~50h

Save Time For Deep Vetting

In average, we save over 50 hours of client team to interview candidates for each job position. We are fueled by a passion for tech expertise, drawn from our deep understanding of the industry.

Flexible Engagement Models

Custom Engagement Models

Flexible staffing solutions, accommodating both short-term projects and longer-term engagements, full-time & part-time

Unique Talent Ecosystem

Candidate Staffing Platform stores data about past and present candidates, enables fast work and scalability, providing clients with valuable insights into their talent pipeline.

Transparent

$0

No Hidden Costs

Price quoted is the total price to you. No hidden or unexpected cost for for candidate placement.

x1

One Consolidated Invoice

No matter how many engineers you employ, there is only one monthly consolidated invoice.

Ready to hire Andrey L.
or someone with similar Skills?

Book a call with Andrey L.

Start Hiring