Join the team, an exciting new project aiming to have us enter the Consumer Credit Bureau space in the United Kingdom and eventually become a fully-fledged Consumer Reporting Agency. We’re looking for a Data Engineer experienced in testing cloud-native software systems.
Privately owned and independently minded, at Creditsafe, we are guided by values of customer-focus, trust, respect, and a willingness to try new things. For over 20 years, these values have shaped a culture of growth, innovation, and support, where our team members build successful, long-term careers.
With a diverse team spread across 25 offices in 14 countries, we value collaboration, learning, and problem-solving together. We have been featured twice in The Sunday Times' '100 Best Companies to Work For' and continue to prioritize well-being, career growth, and inclusion.
Our continued success has made us the most used business data provider in the world and one of the industry’s strongest growing business intelligence providers. Today Creditsafe has 23 offices across 3 continents serving110,000 customersfrom SMEs to enterprise businesses.
Join a team of highly technically skilledengineerswhoaredesigningCreditsafe’snewConsumer Bureauwithdata quality,lineage, andauditabilityas primary goals whilstmaintaininghigh throughputand scalability.Thedata platformwill be builtusingAWSinfrastructure such as S3and S3-tables(Iceberg), AuroraServerless, DynamoDB, Lambda,Fargate, ECS, Airflow,Sparkand Kinesis.Theplatformisexpectedto manage overone hundred millionobjectswith a high volume of daily updateshandlingaddition, deletion,andcorrectionof our dataand indexesinanauditable manner.The platform will employ a sophisticated matching algorithm to enable us to assign incoming updates to existing objects.Our data processing application is entirely based onPythonand designed toefficientlytransformincomingrawdata volume intoAPIconsumableschema.The teamis alsobuildinghighlyavailableand low latency APIstoenableour clientswithfasterdata delivery.
Contributing activelyto the codebaseandparticipatingin peer reviews.This is not a passive "take a ticket and close it" role -- you will drive development from 3-Amigo's refinement sessions all the way to post-deployment observability.
Design and build metadata driven,eventbaseddistributeddata processing platformusing technologies such asPython,Spark,Airflow, Iceberg,DynamoDB,AWS Glue, S3.
Playan activerole in the design, development, and deployment ofour business-criticalsystem.
Building and scalingCreditsafe’sdata pipelinescombining batch and streaming approachesandtargetingsub-500ms latency serving.
Understandingdomaindatatomake recommendationsto improvetheexisting product.
Employing various AI tools such as Perplexity, Cursor, CoPilot, etc to aid in all aspects of your work.
You understand and can implement data engineering best practices.
You demonstrate the ability to write clean&efficient code and combine it with the cloud environment forbestperformance.
You have a minimum6years ofdevelopment experience within a commercial environment creating production gradedatapipelines in python.
You are looking to growyour skillsthrough daily technical challenges andenjoyproblem solving,whiteboardingin collaboration with team.
You have excellentcommunication skills,andability to explain your viewsclearlytotheteam andare open tounderstandingtheviews of others.
You have a proventrack recordto draw from a deep and broad technicalexpertiseto mentor engineers, complete hands-on technical work, and provide leadership on complex technology issues.
You share your ideascollaborativelyviawikis,discussions boards, etcandshareany decisionsmade,for the benefit of others.
You take ownership of end-to-end deliverables from planning all the way to production.
We are committed to providing a welcoming, supportive environment. Creditsafe is an equalopportunitiesemployer that values diversity. Please contact us if you need anyassistancewith your application.
#J-18808-Ljbffr
Full job description from WhatJobs. Apply for this role →
Cardiff
Join the team, an exciting new project aiming to have us enter the Consumer Credit Bureau space in the United Kingdom and eventually become a…
Explore: Data Analyst jobs in Cardiff Data Analyst jobs in the UK Engineering recruitment Specialist jobs in Cardiff
Worked with Verifera as a candidate or employer? Your honest review helps the next person trust verified hiring.