Junior Data Engineer
A company is looking for a Junior Data Engineer (Remote US or Canada).
Key Responsibilities
Write and deploy crawling scripts to collect source data from the web
Write and run data transformers in Scala Spark to standardize bulk data sets
Analyze and report on internal datasets to answer questions and inform feature work
Required Qualifications
Professional experience with Python and a JVM language (e.g., Scala, Java, Kotlin)
2+ years of experience designing and maintaining data pipelines
Experience using Apache Spark and Apache Airflow
Experience working on a cloud platform like GCP, AWS, or Azure
Experience with SQL and NoSQL databases
A company is looking for a Junior Data Engineer (Remote US or Canada).
Key Responsibilities
Write and deploy crawling scripts to collect source data from the web
Write and run data transformers in Scala Spark to standardize bulk data sets
Analyze and report on internal datasets to answer questions and inform feature work
Required Qualifications
Professional experience with Python and a JVM language (e.g., Scala, Java, Kotlin)
2+ years of experience designing and maintaining data pipelines
Experience using Apache Spark and Apache Airflow
Experience working on a cloud platform like GCP, AWS, or Azure
Experience with SQL and NoSQL databases