Lead Data Platform Engineer - AWS, Spark
The advert
As posted by EXPERIANCompany Description
Experian is a global data and technology company, powering opportunities for people and businesses around the world. We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more. Experian invests in people and new advanced technologies to unlock the power of data. We have an amazing team of 25,200 people in 32 countries.
Internal Grade D/EB8
Job Description
Experian Credit Services & Verifications are looking for a Lead Data Platform Engineer to provide hands-on technical leadership for a new fraud data capability that will connect fraud-related data assets into Experian's Data Analytics Platform.
Reporting into our Engineering Director, you will lead a technical team that supports innovation, learning and collaboration. Ensuring that the team follows the highest technical standards.
You will work closely with the central Data Analytics Platform team, data owners, security, compliance, platform and delivery stakeholders to agree practical implementation approaches, align with established platform patterns, and ensure the team delivers secure, scalable and supportable solutions.
This is a hands-on leadership role suited to someone who can combine strong data engineering depth with cloud platform experience, engineering discipline and team leadership. You will apply effective DevSecOps practices and contribute to technical roadmap discussions where there are shared or overlapping platform requirements, while working collaboratively with central platform teams where broader architectural ownership sits outside the local team.
This is a Hybrid, Nottingham based role (40% in the office).
Key responsibilities
- Lead and support an agile technical team delivering data platform solutions for fraud-related data assets.
- Help guide the delivery of AWS-based data pipelines, data lake components and producer-side data platform capability.
- Support the handover, ownership, maintenance and enhancement of pipelines and cloud components initially developed by the central DAP team.
- Lead the team in building, testing and maintaining high-quality data pipelines from source systems such as Snowflake and internal product/data platforms.
- Ensure metadata is prepared and published accurately so assets can be surfaced through the DAP catalogue.
- Champion DevSecOps practices, CI/CD, Infrastructure as Code and cloud-native tooling to improve reliability, security and delivery efficiency.
- Mentor and coach senior and junior engineers, supporting innovation, learning and collaboration within the team.
- Promote modern engineering practices, including automation and AI-assisted development where appropriate, to improve delivery speed, quality and repeatability.
Qualifications
- Strong experience building data pipelines, data lake solutions or data platform capabilities.
- Strong experience with AWS cloud services relevant to data engineering and platform delivery, including services such as AWS Glue, S3, Step Functions, IAM, Lake Formation, EC2, Lambda, EventBridge and SQS.
- Strong experience with DevOps and Infrastructure as Code tooling, including Terraform, CI/CD pipelines, Git and Jenkins.
- Strong experience developing on Apache Spark or Hadoop.
- Significant programming experience using Scala or Python.
- Experience with Configuration as Code principles and API integration.
- Strong understanding of cloud security, data privacy, access control and governance principles in data platform environments
Desired skills
- AWS Developer Certification or other relevant AWS certification.
- Strong expertise in Terraform or CloudFormation.
- Experience with OpenShift or Kubernetes.
- Experience with automated testing tools such as pytest or Scalatest.
- Familiarity with code quality and security scanning tools such as SonarQube and Veracode.
- Knowledge of RESTful APIs and microservice architectures.
- Experience working with sensitive, governed or regulated data environments.
- Familiarity with data catalogue, metadata management, data marketplace or federated data mesh concepts.
Additional Information
Benefits package includes
- Great compensation package and discretionary bonus plan
- 25 days annual leave with 8 bank holidays and 3 volunteering days. You can purchase additional annual leave.
- Core benefits include pension, bupa healthcare, sharesave scheme and more
Our uniqueness is that we celebrate yours. Experian's people first, inclusive and purpose driven culture is multi award-winning; World's Best Workplaces™ 2025 (Fortune Global Top 25), Great Place To Work™ in 26 countries to name a few.
Check out Experian Life on social or explore our Careers Site to understand why. Experian is also proud to be an Equal Opportunity and Affirmative Action employer. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.
Recruitment Fraud Awareness - Experian's recruitment process is conducted only through authorised channels. Recruitment communications will only be sent from an @experian.com email address. Experian will never ask candidates to make any payment as part of an application, interview, assessment, onboarding, or recruitment process. To apply for roles or verify opportunities, please visit experian.com/careers.
Experian Careers - Creating a better tomorrow together
Find out what its like to work for Experian by clicking here
Sponsor check
EXPERIAN holds a Home Office sponsor licence (A-rated · Skilled Worker route), checked against the register published 19 Nov 2026. We read this advert: no sponsorship restrictions. Home Office FOI figures: 138 visa sponsorships in 2021–24.
How we check sponsorshipSponsor check
- Sponsor register
EXPERIAN is on the Home Office register of licensed sponsors: A-rated, licensed since at least 2021.
Home Office register · published 19 Nov 2026
- Visa sponsorships
138 visa sponsorships in 2021–24 (Home Office FOI 2025/12841).
- From the advert
The advert doesn't mention sponsorship.
Read from the advert below
Facts from the Home Office register of licensed sponsors and Home Office FOI figures. We don't judge employers; check the advert and the register yourself.
Our estimate from the job title
- Likely occupation
- SOC 2134 · Programmers and software development professionals
- Going rate
- £54,700 a year (£28.05/h)estimate
- Visa route
- Likely eligible for Skilled Worker sponsorship
- Visa salary for this occupation
- £54,700 · new entrants £38,300estimate
- Typical UK pay
- £56,914 median full-time
The employer picks the real occupation code on the Certificate of Sponsorship. If it picks a different one, the visa salary changes. How we read this
EXPERIAN
- Sponsor licence
- A-rated · Worker
- Visa sponsorships
- 138 · 2021–24
- Visa routes
- Global Business Mobility: Graduate Trainee, Global Business Mobility: Senior or Specialist Worker, Skilled Worker
- Industry
- Technology
- Location
- Nottingham
EXPERIAN is a licensed UK visa sponsor (A-rated). Home Office figures released under the Freedom of Information Act show EXPERIAN assigned 138 Certificates of Sponsorship in 2021–24 and 29 in 2025 for Skilled Worker and Global Business Mobility visas.
Similar sponsor-licensed roles
The closest matches at other employers with active sponsor licences.
Lead Data Engineer EPAM Systems · London Sponsorable from abroad
Data Platform Engineer - SAS Yorkshire Building Society · Leeds Sponsorable from abroad
Lead Data Engineer Nottingham Community Housing Association · United Kingdom Sponsorable from abroad
Data Engineer Stark Associates · United Kingdom Sponsorable from abroad
Data Engineering Lead DAC Beachcroft · London Sponsorable from abroad
Lead Data Engineer Acuity Knowledge Partners · London Sponsorable from abroad New roles like this
Added in the last 48 hours by other sponsor-licensed employers.
Senior Data Engineer Hack the Box · London Sponsorable from abroad
Senior Software Engineer - Data Engineering Moody's Investors Service · Manchester Sponsorable from abroad IB Data Engineer Investec Bank · United Kingdom Sponsorable from abroad HS Data Engineer HCC Service Company Inc · London Sponsorable from abroad
Principal Data Engineer FUNDING CIRCLE · London Sponsorable from abroad UM Database Administrator Universal Music Operations Ltd · United Kingdom Sponsorable from abroad Roles like this at sponsors
Licensed UK visa sponsors
Lead Data Engineer EPAM Systems · London Sponsorable from abroad
Data Platform Engineer - SAS Yorkshire Building Society · Leeds Sponsorable from abroad
Lead Data Engineer Nottingham Community Housing Association · United Kingdom Sponsorable from abroad