Senior Databricks Engineer

A company is looking for a Senior Consultant (Databricks Engineer) with expertise in Databricks tools and a background in the Healthcare domain. Key Responsibilities Design and develop scalable data pipelines using Databricks tools and frameworks Ingest and process healthcare data products while ensuring compliance with data standards such as HL7, CCDA, and FHIR Continuously monitor and optimize pipeline performance and provide guidance to junior engineers Required Qualifications 5+ years of experience in data engineering, with 3+ years of hands-on experience with Databricks Proven experience in the healthcare domain and knowledge of healthcare data standards (HL7, CCDA, FHIR) Strong knowledge of Delta Lake and expertise in PySpark, Scala, or Python Bachelor's degree in Computer Science, Information Systems, or equivalent experience Experience designing and implementing ETL/ELT workflows in cloud environments (Azure or AWS)

May 14, 2025 - 23:06
 0
Senior Databricks Engineer
A company is looking for a Senior Consultant (Databricks Engineer) with expertise in Databricks tools and a background in the Healthcare domain. Key Responsibilities Design and develop scalable data pipelines using Databricks tools and frameworks Ingest and process healthcare data products while ensuring compliance with data standards such as HL7, CCDA, and FHIR Continuously monitor and optimize pipeline performance and provide guidance to junior engineers Required Qualifications 5+ years of experience in data engineering, with 3+ years of hands-on experience with Databricks Proven experience in the healthcare domain and knowledge of healthcare data standards (HL7, CCDA, FHIR) Strong knowledge of Delta Lake and expertise in PySpark, Scala, or Python Bachelor's degree in Computer Science, Information Systems, or equivalent experience Experience designing and implementing ETL/ELT workflows in cloud environments (Azure or AWS)