Data DevOps Engineer
A company is looking for a Data DevOps Engineer with 8+ years of experience to join their ML/AI team.
Key Responsibilities
Work on data pipeline for various ML/AI products
Interface with DevOps teams to build out the pipelines
Collaborate with Data Scientists and Software Engineers to implement new features
Improve monitoring and debuggability of existing pipelines
Required Qualifications
Experience in setting up multitenant Spark & Kafka clusters
Experience with infrastructure automation using Jenkins/Ansible/Terraform or similar tools
Strong skills in at least Python, Scala, or Java
Experience in cleaning, processing, managing, analyzing, and searching vast collections of data
Some experience with database technologies, including NoSQL and SQL databases
A company is looking for a Data DevOps Engineer with 8+ years of experience to join their ML/AI team.
Key Responsibilities
Work on data pipeline for various ML/AI products
Interface with DevOps teams to build out the pipelines
Collaborate with Data Scientists and Software Engineers to implement new features
Improve monitoring and debuggability of existing pipelines
Required Qualifications
Experience in setting up multitenant Spark & Kafka clusters
Experience with infrastructure automation using Jenkins/Ansible/Terraform or similar tools
Strong skills in at least Python, Scala, or Java
Experience in cleaning, processing, managing, analyzing, and searching vast collections of data
Some experience with database technologies, including NoSQL and SQL databases