Khiem T Data Engineer with Python & Scraping Skills

Employment History

Consulting Company, Senior Data Specialist

October 2022 - Present

• Designed and deployed a comprehensive software solution for monitoring thousands of employee machines Windows and Mac.
• Facilitated feedback delivery to both employees and employers, enhancing workplace efficiency based on the analytics of the data.
• Integrated GPT model into the client's data transformation platform that efficiently enables human query on data. Provided ongoing support and optimisation for the integrated solution.
• Writing frameworks and supporting colleagues in the solution.

Dagrofa A/S, Lead Data Engineer (Denmark)

January 2021 - October 2022

• Maintaining and developing legacy systems of Business Intelligence on retails stores and products data.
• Migrate system of pipelines from Java to Python for cost-saving and future development, save 60% cost on cloud services.
• Benchmark, apply best practices and distribute knowledge to members on routine.
• Scoping requirements, design and implement processes for new data feeds from other company departments.
• Monitor, resolve and recover from incidents as instant as possible within 24h max.

Tech: GCP, Python, Dataflow, BigQuery, Pubsub.

FullStack developer

August 2018 - Present

Building platform of digital data for the construction industry. Manage workforces, paper works and workflows with a press of a button. 

• Work on new features and maintain the existing one 
• Maintain code quality and usability 
• Support CS when customer raise issues 
• Guide, onboarding members 
• Maintain, setup and deploy system for new clients 

Tech: Rails, Kubenetes, ReactNative, Python, RabbitMQ, AWS

Backend Developer, Snapshop

March 2018 - July 2018

A new type of e-commerce that garther the products data from our partner and sell it on our platform (atm is an iOS app). The bussiness is sell the product and take the commission. The payment process is lead to the partner side and the money is transfer thought Stripe which automatically take our commission to our Stripe and the rest to the partner Write, test and deploy API continuously with rapid development of the project. 

Monitoring the production enviroment and act fast to recover from accidents if occurred. 

Tech: Django, AWS, Django REST Framework, PostgreSQL, Redis, AWS 

Banauten GmbH FullStack Developer

January 2017 - April 2018

Gather interaction metrics of an account across social medias (Facebook, Youtube, Twitter, Instagram) and generate on time report. Detail metrics for each marketing unit process and suggest actions to boost their result. Ours clients includes BMW, Mercedes, Audi, ...  

• Design and implement the a stable process of containly gather data 
• Setup and maintain a seamless production enviroments 
• Design data process pipeline that don't shut down over small errors, maintain the integrity and the whole of data Optimize speed of reading data from database for about 10 times (~ 5M records tables with at least 3 joins take ~100ms) 

Tech: Django, Celery, RabbitMQ, Docker, PostgreSQL 

FullStack Developer, Finizz

September 2016 - January 2017 

Comunity project for people to find, validate, review infomation about doctors, clinics, healthcare facilities. People can

Comunity project for people to find, validate, review infomation about doctors, clinics, healthcare facilities. People can also book a schedule with a doctor for their need or ask questions about healthcare 

• That ownership, the reponsible for the software to run properly and realiable. 
• Maintain system, design each of the component parts and apply (how they see, work, talk to each other).

Tech: Rails, PostgreSQL, AWS

Scrape from facebook search keywords, Scout 360

January 2015 - January 2016 

• Scrape data from tiki, lazada, shopee, aliexpres.
• Scrape from facebook search keywords
• Schedule scraping process run each day and gather all data into one database with API for client Developing Wordpress plugin to be the client and request data from datafeed database and update client WP site database seamlessly 
• Setup payment for customer to buy a subcription to access the data and have it automatically updated on their sites. 

Languages 

• English Native
• Vietnamese Native
• German Conversational

Education 

Bachelor's of Computer Science, University of Science