Azure Databricks Engineer
A company is looking for an Azure Databricks Engineer to design, develop, and optimize large-scale data processing systems using Azure Databricks.
Key Responsibilities
Design and implement data ingestion and transformation pipelines using Azure Databricks and other Azure data services
Develop ETL/ELT processes for various data types and optimize Apache Spark jobs for performance
Collaborate with cross-functional teams to build and manage scalable data lakehouse solutions and integrate with Azure resources
Required Qualifications
2+ years of hands-on experience with Azure Databricks and Apache Spark
Strong programming skills in Python, Scala, and SQL
Expertise in Azure Data Lake, Blob Storage, and Azure Synapse
Bachelor's degree in IT or related field is highly preferred
Databricks Certified Associate Developer for Apache Spark or related certification is preferred
A company is looking for an Azure Databricks Engineer to design, develop, and optimize large-scale data processing systems using Azure Databricks.
Key Responsibilities
Design and implement data ingestion and transformation pipelines using Azure Databricks and other Azure data services
Develop ETL/ELT processes for various data types and optimize Apache Spark jobs for performance
Collaborate with cross-functional teams to build and manage scalable data lakehouse solutions and integrate with Azure resources
Required Qualifications
2+ years of hands-on experience with Azure Databricks and Apache Spark
Strong programming skills in Python, Scala, and SQL
Expertise in Azure Data Lake, Blob Storage, and Azure Synapse
Bachelor's degree in IT or related field is highly preferred
Databricks Certified Associate Developer for Apache Spark or related certification is preferred