Hire PySpark Developer

- Data Engineer with a Ph.D. degree in Measurement methods, Master of industrial automation - 16+ years experience with data-driven projects - Strong background in statistics, machine learning, AI, and predictive modeling of big data sets. - AWS Certified Data Analytics. AWS Certified Cloud Practitioner. - Experience in ETL operations and data curation - PostgreSQL, SQL, Microsoft SQL, MySQL, Snowflake - Big Data Fundamentals via PySpark, Google Cloud, AWS. - Python, Scala, C#, C++ - Skills and knowledge to design and build analytics reports, from data preparation to visualization in BI systems.

- 12+ years experience working in the IT industry; - 12+ years experience in Data Engineering with Oracle Databases, Data Warehouse, Big Data, and Batch/Real time streaming systems; - Good skills working with Microsoft Azure, AWS, and GCP; - Deep abilities working with Big Data/Cloudera/Hadoop, Ecosystem/Data Warehouse, ETL, CI/CD; - Good experience working with Power BI, and Tableau; - 4+ years experience working with Python; - Strong skills with SQL, NoSQL, Spark SQL; - Good abilities working with Snowflake and DBT; - Strong abilities with Apache Kafka, Apache Spark/PySpark, and Apache Airflow; - Upper-Intermediate English.

- 9+ years experience working with Python; - 3+ years of experience with AI/ML projects; - 5 years of experience with PowerBI and 4 years of experience with Tableau and other visualization tools like Spotfire; - Good skills with Vaex, and Dask; - Was a part of a financial debt management project; - 6 years of experience working with MySQL, SQL, and PostgreSQL; - 8 years of experience with various data sets (ETL, Data Engineer, Data Quality Engineer); - 3 years of experience with Amazon Web Services (AWS), Google Cloud Platform (GCP); - Proven commercial experience in HR and related Talent projects; - Extensive experience with Spark and Hadoop; - Background with TensorFlow, Scikit-learn and PyTorch; - Data Analytics/Engineering with Cloud Service Providers (AWS, GCP); - Deep abilities working with Kubernetes (K8s); - Hands-on scripting experience with Python; Microsoft Power BI, Tableau, Sisense, CI/CD principles, Data Validation, Data QA, SQL, Pipelines, ETL, and Automated web scraping; - Pet web3 projects (solidity, wallet integration); - Upper-intermediate English.

- 2+ years of experience with Python as a Data Engineer and Deep/Machine Learning Intern - Experience with Data Vault modeling and AWS cloud services (S3, Lambda, and Batch) - Cloud Services: Sagemaker, Google BigQuery, Google Data Studio, MS Azure Databricks, IBM Spectrum LSF, Slurm - Data Science Frameworks: PyTorch, TensorFlow, PySpark, NumPy, SciPy, scikit-learn, Pandas, Matplotlib, NLTK, OpenCV - Proficient in SQL, Python, Linux, Git, and Bash scripting. - Had experience leading a BI development team and served as a Scrum Master. - Native English - Native German

- Senior Data Engineer with 10+ of experience specializing in designing, optimizing, and maintaining data infrastructures, data flow automation, and algorithm development. - Has expertise in Python, SQL/NoSQL, ETL processes, PySpark, Apache Airflow, and an array of AWS services, complemented by a strong foundation in database systems and cloud-based solutions. Proven capability in handling large-scale data analytics and processing with a focus on performance and cost efficiency in cloud environments. Proficient in developing robust ETL pipelines, performing data migrations, and optimizing complex queries and storage procedures, leveraging extensive experience across multiple industries and platforms. - Start: ASAP - English: Upper-Intermediate

- 10+ years experience working in the IT industry; - 8+ years experience working with Python; - Strong skills with SQL; - Good abilities working with R and C++; - Deep knowledge of AWS; - Experience working with Kubernetes (K8s), and Grafana; - Strong abilities with Apache Kafka, Apache Spark/PySpark, and Apache Airflow; - Experience working with Amazon S3, Athena, EMR, Redshift; - Specialised in Data Science and Data Analysis; - Work experience as a team leader; - Upper-Intermediate English.

- Senior Data Engineer with a strong technology core background in companies focused on data collection, management, and analysis. - Proficient in SQL, NoSQL, Python, Pyspark, Oracle PL/SQL, Microsoft T-SQL, and Perl/Bash. - Experienced in working with AWS stack (Redshift, Aurora, PostgreSQL, Lambda, S3, Glue, Terraform, CodePipeline) and GCP stack (BigQuery, Dataflow, Dataproc, Pub/Sub, Data Studio, Terraform, Cloud Build). - Skilled in working with RDBMS such as Oracle, MySQL, PostgreSQL, MsSQL, and DB2. - Familiar with Big Data technologies like AWS Redshift, GCP BigQuery, MongoDB, Apache Hadoop, AWS DynamoDB, and Neo4j. - Proficient in ETL tools such as Talend Data Integration, Informatica, Oracle Data Integrator (ODI), IBM Datastage, and Apache Airflow. - Experienced in using Git, Bitbucket, SVN, and Terraform for version control and infrastructure management. - Holds a Master's degree in Environmental Engineering and has several years of experience in the field. - Has worked on various projects as a data engineer, including operational data warehousing, data integration for crypto wallets/De-Fi, cloud data hub architecture, data lake migration, GDPR reporting, CRM migration, and legacy data warehouse migration. - Strong expertise in designing and developing ETL processes, performance tuning, troubleshooting, and providing technical consulting to business users. - Familiar with agile methodologies and has experience working in agile environments. - Has experience with Oracle, Microsoft SQL Server, and MongoDB databases. - Has worked in various industries including financial services, automotive, marketing, and gaming. - Advanced English - Available in 4 weeks after approval for the project

Data Engineer with 7 years of expertise in data analytics/science, ETL, and cloud technologies, blending deep healthcare and pharma industry knowledge. Proficient in Python, SQL, and a suite of data engineering tools including, Apache Spark, Airflow, and BI tools such as Power BI. Implemented real-time data streaming using Kafka, and has experience with multiple cloud services from AWS, Azure, and GCP. Key achievements include optimizing SQL database performance, automating data quality checks, and uncovering new drug candidates through computational data discovery—demonstrating a strong fusion of domain knowledge and technical acumen.

A seasoned Data Engineer with over 6 years of experience in the field of software and big data engineering. Holds a strong academic background in Computer Science and Software Engineering, certified as a Google Cloud Professional Data Engineer. Demonstrates deep expertise in high-load system design, performance optimizations, and domain-specific solutions for Healthcare, Fintech, and E-commerce. Proficient in Python and SQL, with significant exposure to data engineering tools such as Apache Hadoop, Apache Spark, and Apache Airflow, and cloud technologies from AWS and GCP. Adept at working with various databases and message brokers, excelling in data modeling, BI, and data visualization using tools like Looker, Power BI, and Tableau. Enhanced system efficiencies through SQL and data pipeline optimizations, driving significant improvements in processing speed and system performance. A collaborative engineer with a strong grasp of DevOps practices, committed to best-in-class data governance and security standards.

- More than 8 years of Data Engineering experience in the Banking and Health sector. - Worked on Datawarehousing and ETL pipeline projects using AWS Glue, Databrew, Lambda, Fivetran, Kinesis, Snowflake, Redshift, and Quicksight. - Recent project involves loading data into Snowflake using Fivetran connector and automation of pipeline using Lambda and Eventbridge. - Performed Cloud Data Migrations and automation of ETL pipeline design and implementations. - Fluent English - Available from 18.08.2022

- About 6 years of experience in Data Engineering - Upper-Intermediate English. - Available ASAP.

- Solution Architect with 7 years of experience. My experience includes architecting, managing, and implementing various platform solutions. I have extensive knowledge of designing complex data solutions. I understand the tradeoffs of implementing commercial and open-source data solutions and have helped clients implement the best platform based on their business requirements. - IT engineer with 15 years of solid experience in the following areas: full development life cycle, CI/CD, software development processes and methodologies, architecture and infrastructure design, and disaster recovery solution elaboration. - Outstanding analytical and problem-solving skills. Professional oriented on a result with leadership and communications skills.