Hire Apache Spark Streaming Developer

A seasoned Data Engineer with over 6 years of experience in the field of software and big data engineering. Holds a strong academic background in Computer Science and Software Engineering, certified as a Google Cloud Professional Data Engineer. Demonstrates deep expertise in high-load system design, performance optimizations, and domain-specific solutions for Healthcare, Fintech, and E-commerce. Proficient in Python and SQL, with significant exposure to data engineering tools such as Apache Hadoop, Apache Spark, and Apache Airflow, and cloud technologies from AWS and GCP. Adept at working with various databases and message brokers, excelling in data modeling, BI, and data visualization using tools like Looker, Power BI, and Tableau. Enhanced system efficiencies through SQL and data pipeline optimizations, driving significant improvements in processing speed and system performance. A collaborative engineer with a strong grasp of DevOps practices, committed to best-in-class data governance and security standards.

- Java Team Lead and Architect with 10+ years of a demonstrated history of working in various industries, including finance, entertainment, and retail. - Proficient in Java, Scala, AWS, Jenkins, Docker, Maven, and other technologies for building high-load applications and services. - Extensive experience with Kafka Streaming applications for data transformation and aggregation. - Successfully designed and managed high-load applications utilizing Kafka for data processing and prediction. - Strong background in AWS, utilizing services like AWS Lambda, Docker, and Kubernetes to build scalable and efficient systems. - Strong experience designing and implementing technical solutions, setting up Agile teams, and mentoring developers. - Proven ability to handle multiple projects through the entire lifecycle, ensuring timely and within-budget delivery. - Experienced in conducting requirement analysis, identifying risks, and conducting mitigation action planning - Upper-Intermediate English

- Experience in developing 8+ years - 8+ years of professional experience with Python - Experience in development projects using: Python, Spark, Hadoop, Kafka - Good knowledge in Machine Learning (Keras, Tensorflow) - Experience with databases such as PostgreSQL, SQLite, MySQL, Redis, MongoDB - Experience in program automation testing. - Upper-intermediate English - Available ASAP

• 15 years of proven experience in IT industry • 7 years experience as Solution Architect, 3 years of which in a position of Senior Architect • 12 years of experience in Java, Spring Boot, Micro Services and AWS, Google, Azure Cloud for deployment. • Worked with Ant and Maven and Gradle Build tools in Java. • Experience in designing, developing and overseeing the implementation of solutions that improve the stability, scalability, availability and latency • Expertise in steaming tools such as Kafka • Experience in MySQL, Cassandra, PostgreSQL • Automated environments setup for Developers, Staging for SQA and Production for customers • Extensive experience with Continuous Integration Tools like Jenkin, Hudson, circleci, TeamCity, Bamboo, GitLab and configuring CI/CD with unit test on builds • Experience with AWS API gateway, Lambda functions, Elastic Load Balancers, VPC, Security groups, Jump Servers, Route53, Cloud Watch and servers Auto Scaling • Worked with different Bug Tracking Tools like Remedy, Jira, ServiceNow and Clear Quest. • Ability in development and execution of XML, Shell Scripts and Perl Scripts. • Experience in cloud cost optimization, resources cleanup, automated services scaling based on load and ensuring latest security standards • Experience in linux/Unix Systems • Worked on SDLC Methodologies like Agile, Waterfall.