Hire Data Extraction and ETL Developer

- 8 years experience with various data disciplines: Data Engineer, Data Quality Engineer, Data Analyst, Data Management, ETL Engineer - Automated Web scraping (Beautiful Soup and Scrapy, CAPTCHAs and User agent management) - Data QA, SQL, Pipelines, ETL, - Data Analytics/Engineering with Cloud Service Providers (AWS, GCP) - Extensive experience with Spark and Hadoop, Databricks - 6 years of experience working with MySQL, SQL, and PostgreSQL; - 5 years of experience with Amazon Web Services (AWS), Google Cloud Platform (GCP) including Data Analytics/Engineering services, Kubernetes (K8s) - 5 years of experience with PowerBI - 4 years of experience with Tableau and other visualization tools like Spotfire and Sisense; - 3+ years of experience with AI/ML projects, background with TensorFlow, Scikit-learn and PyTorch; - Extensive hands-on expertise with Reltio MDM, including configuration, workflows, match rules, survivorship rules, troubleshooting, and integration using APIs and connectors (Databricks, Reltio Integration Hub), Data Modeling, Data Integration, Data Analyses, Data Validation, and Data Cleansing) - Upper-intermediate to advanced English, - Henry is comfortable and has proven track record working with North American timezones (4hour+ overlap)

- Data Engineer with a Ph.D. degree in Measurement methods, Master of industrial automation - 16+ years experience with data-driven projects - Strong background in statistics, machine learning, AI, and predictive modeling of big data sets. - AWS Certified Data Analytics. AWS Certified Cloud Practitioner. Microsoft Azure services. - Experience in ETL operations and data curation - PostgreSQL, SQL, Microsoft SQL, MySQL, Snowflake - Big Data Fundamentals via PySpark, Google Cloud, AWS. - Python, Scala, C#, C++ - Skills and knowledge to design and build analytics reports, from data preparation to visualization in BI systems.

Accomplished Software Architect and Hands-on Engineering Manager with a strong history of building, leading, and mentoring cross-functional teams in designing, developing, and deploying high-scalability, secure software solutions leveraging cloud platforms, microservices architectures, CI/CD pipelines, and performance optimization strategies. Experienced in both startup environments and well-established organizations, with expertise in architecting reliable distributed systems, implementing best practices, and driving innovation while delivering quality software.

* Experienced Data Engineer and BI Developer with 6+ years of expertise in Database Design and Business Intelligence Development. * Proficient in cloud technologies such as Amazon Web Services (AWS), Google Cloud Platform, and Microsoft Azure. * Skilled in building high-performance data integration and workflow solutions, including ETL operations for data warehousing and supporting OLAP, OLTP, and Data warehouse systems. Experience in optimizing DWH performance and automating data pipelines; * Modern data engineer skills such as data modeling, data warehousing, data lake, data governance, and data quality. * Experience with big data technologies such as Hadoop, Spark, and Kafka, and experience with data streaming and real-time data processing. * Proficiency in SQL and NoSQL databases, Snowflake, and ClickHouse * Data visualization tools such as Tableau or Power BI. * Programming languages such as Python, Java, or Scala, and understanding of machine learning concepts, with experience building and deploying machine learning models. * Experience with CI/CD, data governance, and security best practices.

Software engineer possesses robust problem-solving skills and experience in writing scalable code. Specializes in Delphi RAD Studio, with hands-on experience in ETL operations and third-party integration (Kawasaki, Honda, Briggs & Stratton, etc.). Brings proficiency in Azure Cloud Services, Salesforce (Admin + Developer), and diverse programming languages including C and C#. Holds certifications in Salesforce Platform Developer I, Azure Developer Associate, and Azure DevOps Expert. Educational background includes a BS in IT and an M.Sc in Criminology & Security Studies. Over 4 years of experience as a Senior Software Developer and adept in SMS/Email systems, payment gateways, and accounting software integrations.

- 4+ years of experience as a Data Engineer, focused on ETL automation, data pipeline development, and optimization; - Strong skills in SQL, DBT, Airflow (Python), and experience with SAS, PostgreSQL, and BigQuery for building and optimizing ETL processes; - Experience working with Google Cloud (GCP) and AWS: utilizing GCP Storage, Pub/Sub, BigQuery, AWS S3, Glue, and Lambda for data processing and storage; - Built and automated ETL processes using DBT Cloud, integrated external APIs, and managed microservice deployments; - Optimized SDKs for data collection and transmission through Google Cloud Pub/Sub, used MongoDB for storing unstructured data; - Designed data pipelines for e-commerce: orchestrated complex processes with Druid, MinIO, Superset, and AWS for data analytics and processing; - Worked with big data and stream processing: using Apache Spark, Kafka, and Databricks for efficient transformation and analysis; - Amazon sales forecasting using ClickHouse, Vertex AI, integrated analytical models into business processes; - Experience in Data Lake migration and optimization of data storage, deploying cloud infrastructure and serverless solutions on AWS Lambda, Glue, and S3.

As a passionate AI developer with a strong command over machine learning, data analytics tools, deep learning, Django, Flask, SQL, data extraction, and web automation, I have gained valuable experience through various roles. I have worked as a data analyst on contracts with an Indian MNC, making significant contributions. Additionally, I played a key role in a ship maintenance-based startup by providing a corrosion segmentation solution. Moreover, I have worked on RAG techniques and implemented personalised chatbot features using LLMs like ChatGPT using LangChain technology. I have successfully provided customers more than a million units of required data by implementing efficient data extraction methods.

An adept software engineer with significant expertise in AI technologies, focusing on Generative AI solutions for media companies. Demonstrates proficiency in DevOps methodology, with extensive experience in orchestrating CI/CD pipelines, cloud infrastructure, and MLOps from roles at top gaming and tech companies.Notable achievements include driving a 300% reduction in production time and up to a 200% increase in quality capabilities for AI projects.Experience extends over a decade, with strong proficiency in various programming languages and tools such as C#, Unity3D, Terraform, EKS, K8s, Helm, Docker, Linux, Jenkins, and Gitlab. Known for leading pivotal projects, displaying ownership, and training multilingual personnel while optimizing costs and resources in cloud deployments.