The role focuses on reducing model deployment time by leveraging advanced tools, automation, and modern engineering practices
Job Summary
The role focuses on reducing model deployment time by leveraging advanced tools, automation, and modern engineering practices.
Candidates will design and maintain scalable ETL pipelines using AWS Glue, PySpark, and Spark while orchestrating workflows with Apache Airflow.
This position requires strong collaboration with data scientists and analysts to deliver reliable data solutions that support predictions and reporting.
Matching Summary
The role focuses on reducing model deployment time by leveraging advanced tools, automation, and modern engineering practices.
Skills & Requirements
Must-have
12+ years of Data Engineering experience
Deep expertise in Apache Airflow
Strong experience with AWS Glue
Proficiency in Python programming
Experience with Spark and PySpark
Nice-to-have
Excellent problem-solving abilities
Strong communication skills
Ability to thrive in cross-functional teams
Knowledge of Hadoop or Teradata systems
Experience with data governance policies
Key Requirements
Bachelor's or Master's degree in Computer Science or IT