Andrey L. Data Engineer

Data Engineer

Summary

- 9+ years of experience as a development and architecture of Big Data solutions.
- Advanced English
- Available ASAP

Experience

Big Data Specialist – Claro Brazil

Mar/2021 until now.
Responsibilities:

  • Tecnical leader of Big Data projects in cloud(Azure).
  • Development of batch solutions using Python, Spark and Hadoop ecosystem (Hive, Yarn and Sqoop).

Big Data Enginner – Safra Banking

Sep/2019 until Mar/2021.
Responsibilities:

  • Architecture, development and maintenance of solutions using such technologies: Batch processing - Spark (Python and Scala), Hadoop ecosystem (MapReduce, Hive, Yarn and Sqoop) and HBase.
  • Streaming processing – Flume, Kafka, Ignite, Spark (DStream and structured streaming libraries), Scala, Yarn and HBase.
  • Responsible for the architecture of legacy and new projects, identifying fragilities and evolution the architecture following the best practices of the market.
  • Responsible for cluster maintenance and infrastructure evolution(scalability, add new nodes, filesystems problems).

Big Data Enginner – Everis

Oct/2018 until Sep/2019.
Responsibilities:

  • Development of batch solutions using Python, Spark, Hadoop ecosystem (MapReduce, Hive, Yarn and Sqoop) and Oracle database.

Big Data Developer – Digiage Technologies / Dell EMC

Jul/2017 until Oct/2018.
Responsibilities:

  • Development of batch solutions using JavaEE, Hadoop ecosystem (MapReduce, Hive, Yarn and Sqoop) and Greenplum database.

Mobile Developer – Action Dev

Mar/2017 until Jul/2017.
Responsibilities:

  • Acting in the development and maintenance of software mobile applications using technologies such as Node.js, Agular.js and Ionic framework.

Java Developer – Brazilian Army

Feb/2016 until Mar/2017.
Responsibilities:

  • Development of applications for the internal management of certain sections, using technologies as JSF, Primefaces, JPA and Hibernate, as well as generating and exporting reports with IReport.

Internship in development .NET – Starcorp

Nov/2012 until Feb/2013.
Responsibilities:

  • Mantain client intranets in the ASP .NET environment.

Education

Master in Business Administration – Software Engineering - Devry Educacional
Jan/2018 until Dec/2018.

Bacharelor in Computer Science – Universidade Paulista
2012 until 2016.

English course – Wizard
2009 until 2012.

Technical Computer Course – Bento Quirino
2009 until 2011.

Integration Architecture(SOA).

Business Architecture.

Certificates

Oracle Certified Associate

Java SE Progammer 8 certification.