Supporting + maintaining production data pipelines, including incident investigation, safe recovery, root cause analysis + permanent remediation.
Experience of Spark SQL, Delta Lake, Parquet + Hive metastore tables, schemas, partitions and the relationship between table metadata and underlying files.
Hands-on AWS experience, particularly S3, IAM and CloudWatch, with an understanding of role-based access, KMS encryption + diagnosing data access failures.
Owning incidents from investigation through recovery and closure. Diagnosing issues in Python, PySpark, SQL, Databricks jobs and AWS integrations + providing clear progress updates and timely escalation.
Working knowledge of Git, code reviews, CI/CD and controlled production deployments, including testing, rollback and release validation.
We use essential cookies to make this site work. With your permission we would also like to use the optional cookies below. Nothing optional is set until you choose, and you can change your mind at any time from "Cookie settings" at the bottom of every page. Cookie policy.
Essential — keep the site working and secure, and remember the choice you make here. Always on.