Dmitriy K., Python Software Engineer
B2 (Upper-Intermediate) English
Senior (5-10 years)
Ukraine
UTC+02:00
Summary
- Experience in software development more than 9 years
- Proficiency in Python development
- Knowledge and understanding of principles and methodologies of software design
- Deep knowledge of Web development technologies
- Experienced developer with a desire to permanent self-development in the development field
- Data engineering in database/hadoop/ AWS environments
- Solid experience in the development of different back-end and front-end solutions
- Experience with scrapers, extracting data from sites, serializing and validating data
- Strong computer science expertise and commercial experience in web services architecture and development
- Experience with GIS and integration with Google Maps
- Strong analytical skills, good knowledge of math, and a high level of responsibility
- Prefer to research things as deeply as possible and come up with new solutions
- Communicative, team player, self-motivated
- Upper-Intermediate English.
Main Skills
Python
Programming Languages
JavaScript Frameworks
PHP Frameworks
PHP Libraries and Tools
Python Frameworks
JavaScript Libraries and Tools
Python Libraries and Tools
Data Analysis and Visualization Technologies
Databases & Management Systems / ORM
Cloud Platforms, Services & Computing
Amazon Web Services
Message/Queue/Task Brokers
Deployment, CI/CD & Administration
Virtualization, Containers and Orchestration
Version Control
SDK / API and Integrations
Collaboration, Task & Issue Tracking
Methodologies, Paradigms and Patterns
Operating Systems
QA, Test Automation, Security
Other Technical Skills
Experience
Data Engineer, Back-end developer, Thrasio
February 2020 – June 2023
Description: Scraping system of products (products, reviews, comments, user's profiles) data from Amazon marketplaces
Responsibilities:
- Scraping data from Amazon marketplaces, Walmart,
- Development of bots for downloading data from seller dashboards (Amazon Seller Central, Walmart Seller Central, Shopify Dashboards)
- API crawlers to collect data from Rainforest API, Amazon Seller Partner API
- Building microservice platform for pipelines management
- Building pipelines for data transformation/ normalization/ de-duplication in terms of ETL/ELT processes
- filling a data warehouse (Redshift, Snowflake) for use by other services
- Conducting technical interviews for new hires.
Technologies: Python, Apache Airflow, boto3, aws wrangler, Selenium, SqlAlchemy, pandas, Django, Flask, Celery, AWS (ECR, RDS (PostgreSQL), S3, Redshift, Kinesis, SQS, ElastiCache), docker, docker-compose, k8s, helm, helmfile, Snowflake, Fivetran, dbt, DataDog, Opsgenie, REST API, GraphQL, Apache Parquet, Kafka
Back-end developer, LookupLeads
April 2019 – February 2020
Description: Content data scraping from Linkedin and similar websites.
Responsibilities:
- Content data scraping from Linkedin and similar websites.
- Data processing using Celery chords, chains
- Generating datasets with results and providing a download link for users
- Filling a data warehouse (based ElasticSearch) for use by other services
- Conducting technical interviews for new hires.
Technologies: Python, boto3, Selenium, Scrapy, pandas, Django, Celery, AWS (EC2, ECR, RDS (PostgreSQL), S3, SQS, ElastiCache, SES, ElasticSearch Service), docker, docker-compose, nginx, supervisors
Full-stack developer, Verus RR
September 2017 - March 2019
Description: Users’ property accounting system
Responsibilities:
- Building of a system for loading and processing user data
- Building pipelines for data transformation/aggregation and saving reports on S3, sending emails to end users with a download link
- Conducting technical interviews for new hires.
Technologies: Python, Django, Django Rest Framework, Django Channels, Celery, Pandas, python-docx, AWS (EC2, RDS (PostgreSQL), S3, ElastiCache, SES), Vue.js, docker, docker-compose, nginx, Kafka
Full-stack developer, Daunert
March 2015 - August 2017
Description: Tracking system of customers` requests and the progress of their execution (current status, report, statistics, etc.).
Responsibilities:
- development of architecture;
- front-end development
- Database design
- Bug fixing
- Adding new functionality and modifying existing ones to adapt to new requirements
- Coaching less experienced team members
- Processing business requirements in the development of the project
- GIS integration for saving routes, all kinds of points (such as service stations, hotels, etc.)
- Integration Google Maps
Technologies: PHP, Laravel, Google SDK, AWS (EC2, RDS (MySQL), S3, ElastiCache, SES), Vue.js, docker, docker-compose, nginx, Google Maps, Postgis, GIS
Full-stack developer, Mevo
May 2013 – February 2015
Description: B2B system designed for distribution among sales managers. Main goals are: help sales managers to know better goods they sale, help brand owners to increase the amount of sales.
Responsibilities:
- development of architecture;
- front-end development
- Database design
- Bug fixing
- Adding new functionality and modifying existing ones to adapt to new requirements
- Coaching less experienced team members
- Processing business requirements in the development of the project
Technologies: PHP, Laravel, Ratchet, AWS (EC2, RDS (MySQL), S3, SES), Vue.js, Ionic + Angular (for moblie development), docker, docker-compose, nginx, MemCahced