To build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure.
Accountabilities
Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data.
Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures.
Skillset Required
Experience in Python, PySpark and SQL
Experience with AWS is a plus
Strong proficiency in Core Java, including Collections, Concurrency, and Memory Management.
Proficient in version control systems such as Git, GitLab, or Bitbucket.
Strong background in performance tuning, profiling, and resolving production issues in distributed systems.
Working knowledge of Agile methodologies and collaborative development practices.
We use essential cookies to make this site work. With your permission we would also like to use the optional cookies below. Nothing optional is set until you choose, and you can change your mind at any time from "Cookie settings" at the bottom of every page. Cookie policy.
Essential — keep the site working and secure, and remember the choice you make here. Always on.