Senior Databricks Engineer
A company is looking for a Senior Consultant (Databricks Engineer) with expertise in Databricks tools and a background in the Healthcare domain.
Key Responsibilities
Design and develop scalable data pipelines using Databricks tools and frameworks
Ingest and process healthcare data products while ensuring compliance with data standards such as HL7, CCDA, and FHIR
Continuously monitor and optimize pipeline performance and provide guidance to junior engineers
Required Qualifications
5+ years of experience in data engineering, with 3+ years of hands-on experience with Databricks
Proven experience in the healthcare domain and knowledge of healthcare data standards (HL7, CCDA, FHIR)
Strong knowledge of Delta Lake and expertise in PySpark, Scala, or Python
Bachelor's degree in Computer Science, Information Systems, or equivalent experience
Experience designing and implementing ETL/ELT workflows in cloud environments (Azure or AWS)
A company is looking for a Senior Consultant (Databricks Engineer) with expertise in Databricks tools and a background in the Healthcare domain.
Key Responsibilities
Design and develop scalable data pipelines using Databricks tools and frameworks
Ingest and process healthcare data products while ensuring compliance with data standards such as HL7, CCDA, and FHIR
Continuously monitor and optimize pipeline performance and provide guidance to junior engineers
Required Qualifications
5+ years of experience in data engineering, with 3+ years of hands-on experience with Databricks
Proven experience in the healthcare domain and knowledge of healthcare data standards (HL7, CCDA, FHIR)
Strong knowledge of Delta Lake and expertise in PySpark, Scala, or Python
Bachelor's degree in Computer Science, Information Systems, or equivalent experience
Experience designing and implementing ETL/ELT workflows in cloud environments (Azure or AWS)