Hire PySpark Developer

- Data Engineer with a Ph.D. degree in Measurement methods, Master of industrial automation - 16+ years experience with data-driven projects - Strong background in statistics, machine learning, AI, and predictive modeling of big data sets. - AWS Certified Data Analytics. AWS Certified Cloud Practitioner. Microsoft Azure services. - Experience in ETL operations and data curation - PostgreSQL, SQL, Microsoft SQL, MySQL, Snowflake - Big Data Fundamentals via PySpark, Google Cloud, AWS. - Python, Scala, C#, C++ - Skills and knowledge to design and build analytics reports, from data preparation to visualization in BI systems.

- 12+ years experience working in the IT industry; - 12+ years experience in Data Engineering with Oracle Databases, Data Warehouse, Big Data, and Batch/Real time streaming systems; - Good skills working with Microsoft Azure, AWS, and GCP; - Deep abilities working with Big Data/Cloudera/Hadoop, Ecosystem/Data Warehouse, ETL, CI/CD; - Good experience working with Power BI, and Tableau; - 4+ years experience working with Python; - Strong skills with SQL, NoSQL, Spark SQL; - Good abilities working with Snowflake and DBT; - Strong abilities with Apache Kafka, Apache Spark/PySpark, and Apache Airflow; - Upper-Intermediate English.

- 8 years experience with various data disciplines: Data Engineer, Data Quality Engineer, Data Analyst, Data Management, ETL Engineer - Extensive hands-on expertise with Reltio MDM, including configuration, workflows, match rules, survivorship rules, troubleshooting, and integration using APIs and connectors (Databricks, Reltio Integration Hub). - 8+ years with Python for data applications, including hands-on scripting experience - Data QA, SQL, Pipelines, ETL, Automated web scraping. - Data Analytics/Engineering with Cloud Service Providers (AWS, GCP) - Extensive experience with Spark and Hadoop, Databricks - 6 years of experience working with MySQL, SQL, and PostgreSQL; - 5 years of experience with Amazon Web Services (AWS), Google Cloud Platform (GCP) including Data Analytics/Engineering services, Kubernetes (K8s) - 5 years of experience with PowerBI - 4 years of experience with Tableau and other visualization tools like Spotfire and Sisense; - 3+ years of experience with AI/ML projects, background with TensorFlow, Scikit-learn and PyTorch; - Upper-intermediate to advanced English, - Henry is comfortable and has proven track record working with North American timezones (4hour+ overlap)

- 3+ years of experience as a BI Engineer; - Strong abilities in Power BI, SSIS, Tableau, and Google Data Studio; - Deep skills in developing and optimizing ETL processes within business intelligence; - Experience with SQL, Python; - Familiar with Docker, Apache Airflow, and PySpark; - Good knowledge of data warehousing and business intelligence principles.

- 2+ years of experience with Python as a Data Engineer and Deep/Machine Learning Intern - Experience with Data Vault modeling and AWS cloud services (S3, Lambda, and Batch) - Cloud Services: Sagemaker, Google BigQuery, Google Data Studio, MS Azure Databricks, IBM Spectrum LSF, Slurm - Data Science Frameworks: PyTorch, TensorFlow, PySpark, NumPy, SciPy, scikit-learn, Pandas, Matplotlib, NLTK, OpenCV - Proficient in SQL, Python, Linux, Git, and Bash scripting. - Had experience leading a BI development team and served as a Scrum Master. - Native English - Native German

- Senior Data Engineer with 10+ of experience specializing in designing, optimizing, and maintaining data infrastructures, data flow automation, and algorithm development. - Has expertise in Python, SQL/NoSQL, ETL processes, PySpark, Apache Airflow, and an array of AWS services, complemented by a strong foundation in database systems and cloud-based solutions. Proven capability in handling large-scale data analytics and processing with a focus on performance and cost efficiency in cloud environments. Proficient in developing robust ETL pipelines, performing data migrations, and optimizing complex queries and storage procedures, leveraging extensive experience across multiple industries and platforms. - Start: ASAP - English: Upper-Intermediate

- 10+ years experience working in the IT industry; - 8+ years experience working with Python; - Strong skills with SQL; - Good abilities working with R and C++; - Deep knowledge of AWS; - Experience working with Kubernetes (K8s), and Grafana; - Strong abilities with Apache Kafka, Apache Spark/PySpark, and Apache Airflow; - Experience working with Amazon S3, Athena, EMR, Redshift; - Specialised in Data Science and Data Analysis; - Work experience as a team leader; - Upper-Intermediate English.

Data Engineer with 7 years of expertise in data analytics/science, ETL, and cloud technologies, blending deep healthcare and pharma industry knowledge. Proficient in Python, SQL, and a suite of data engineering tools including, Apache Spark, Airflow, and BI tools such as Power BI. Implemented real-time data streaming using Kafka, and has experience with multiple cloud services from AWS, Azure, and GCP. Key achievements include optimizing SQL database performance, automating data quality checks, and uncovering new drug candidates through computational data discovery—demonstrating a strong fusion of domain knowledge and technical acumen.

A seasoned Data Engineer with over 6 years of experience in the field of software and big data engineering. Holds a strong academic background in Computer Science and Software Engineering, certified as a Google Cloud Professional Data Engineer. Demonstrates deep expertise in high-load system design, performance optimizations, and domain-specific solutions for Healthcare, Fintech, and E-commerce. Proficient in Python and SQL, with significant exposure to data engineering tools such as Apache Hadoop, Apache Spark, and Apache Airflow, and cloud technologies from AWS and GCP. Adept at working with various databases and message brokers, excelling in data modeling, BI, and data visualization using tools like Looker, Power BI, and Tableau. Enhanced system efficiencies through SQL and data pipeline optimizations, driving significant improvements in processing speed and system performance. A collaborative engineer with a strong grasp of DevOps practices, committed to best-in-class data governance and security standards.

- Senior Data Engineer with a strong technology core background in companies focused on data collection, management, and analysis. - Proficient in SQL, NoSQL, Python, Pyspark, Oracle PL/SQL, Microsoft T-SQL, and Perl/Bash. - Experienced in working with AWS stack (Redshift, Aurora, PostgreSQL, Lambda, S3, Glue, Terraform, CodePipeline) and GCP stack (BigQuery, Dataflow, Dataproc, Pub/Sub, Data Studio, Terraform, Cloud Build). - Skilled in working with RDBMS such as Oracle, MySQL, PostgreSQL, MsSQL, and DB2. - Familiar with Big Data technologies like AWS Redshift, GCP BigQuery, MongoDB, Apache Hadoop, AWS DynamoDB, and Neo4j. - Proficient in ETL tools such as Talend Data Integration, Informatica, Oracle Data Integrator (ODI), IBM Datastage, and Apache Airflow. - Experienced in using Git, Bitbucket, SVN, and Terraform for version control and infrastructure management. - Holds a Master's degree in Environmental Engineering and has several years of experience in the field. - Has worked on various projects as a data engineer, including operational data warehousing, data integration for crypto wallets/De-Fi, cloud data hub architecture, data lake migration, GDPR reporting, CRM migration, and legacy data warehouse migration. - Strong expertise in designing and developing ETL processes, performance tuning, troubleshooting, and providing technical consulting to business users. - Familiar with agile methodologies and has experience working in agile environments. - Has experience with Oracle, Microsoft SQL Server, and MongoDB databases. - Has worked in various industries including financial services, automotive, marketing, and gaming. - Advanced English - Available in 4 weeks after approval for the project

- More than 8 years of Data Engineering experience in the Banking and Health sector. - Worked on Datawarehousing and ETL pipeline projects using AWS Glue, Databrew, Lambda, Fivetran, Kinesis, Snowflake, Redshift, and Quicksight. - Recent project involves loading data into Snowflake using Fivetran connector and automation of pipeline using Lambda and Eventbridge. - Performed Cloud Data Migrations and automation of ETL pipeline design and implementations. - Fluent English - Available from 18.08.2022

- 20+ years of experience in Software development; - Strong skills in data engineering and cloud architecture; - Experience with encompasses cloud platforms AWS and Azure; - Deep abilities in Big Data technologies Databricks, Hadoop; - Experience with Python, MySQL, PostgreSQL and SQL; - Good knowledge of CI/CD implementation; - Holds certifications such as AWS Certified Solutions Architect and Microsoft Certified Azure Data Engineer Associate; - Experience with ETL; - Knowledge of designing scalable data solutions, leading cloud migrations, and optimizing system performance.