Python Developer

Hi, Good Afternoon, Hope you are doing well. Please let me know if you are interested in this position. Role Kafka Developer Location Toronto, ON ( Hybrid 2 days in a week onsite) Type of Hire - Contract/ C2H Contract Duration 6 Months Number of Interviews L1HRClient Client Interview Yes/No Yes Position requirements 2 Days onsite Mandatory Skills: Kafka (confluent or apache kakfka or MSK) is a must. Expert level development experience with Python and scalable solutions. Experience with Kafka (confluent or apache kakfka or MSK) is a must. Sound knowledge and work experience with SQL. Experience with spark and Spark Streaming (either python or scala is MUST) Ability to integrate different components in a streaming data pipeline. Sound knowledge on AWS (data related) components, ex: AWS kafka, AWS Airflow, AWS S3, AWS EMR, Lmabda, AWS kinesis and firehose. Should be able to Design and Develop Streaming pipelines with Kafka by developing publisher and subscriber scripts. Able to troubleshoot data issues and suggest fixes by monitoring cloudwatch and other AWS logs. Ability to write testcases in python, Unittest, pytest etc. Good understanding and experience working with different Bigdata file formats along with regular JSON, xml and txt formats. Shell scripting is a plus. Should be able to work with Terraform or Cloud formation and able to handle deployment activities in AWS. 10-12 years of overall IT experience and 8 years in expert level development experience with Python and scalable solutions. Experience with Kafka (confluent or apache kakfka or MSK) is a must. Experience with spark and Spark Streaming (either python or scala is MUST) Ability to integrate different components in a streaming datapipeline. Sound knowledge on AWS (data related) components, ex: AWS kafka, AWS Airflow, AWS S3, AWS EMR, Lambda, AWS kinesis and firehose. Should be able to Design and Develop Streaming pipelines with Kafka by developing publisher and subscriber scripts. Good understanding and experience working with different Bigdata file formats along with regular JSON, xml and txt formats.