Principal Data Engineer

Job summary

Companies House is building a Cloud Data Platform from the ground up, and we're looking for a Principal Data Engineer to lead its evolution, shaping the data platform utilising Snowflake and dbt building the data systems that underpin our analytical products and lead the platforms adoptions across the organisation. Your work will directly support our ambition to become a data-driven organisation, providing technical leadership for our data engineering capability, guiding the design, development, and optimisation of our data platform while leading a team of engineers and championing modern engineering practices.

This role is offering between 30 - 37hrs per week with a minimum of 4 day working week. It can accommodate flexible working patterns along with compressed hours depending on candidate requirements.

Job Description

• Shape the strategic direction and continued evolution of the organisation's data platform, driving adoption across business areas and ensuring it delivers long-term value.
• Lead the design, development and optimisation of scalable data engineering solutions, transforming complex operational and business data into trusted datasets that support strategic decision-making.
• Provide technical leadership for data engineering across Companies House, establishing standards, patterns and best practices that promote quality, automation, security and reliability.
• Drive continuous improvement by identifying opportunities to enhance data architecture, engineering processes, performance and operational effectiveness.
• Ensure appropriate technical documentation, standards, processes and governance arrangements are maintained to support knowledge sharing, service continuity and compliance.
• Build effective relationships with senior stakeholders, influencing decision-making and promoting the value of data-driven approaches across the organisation.
• Lead, coach and develop a team of data engineers, creating an inclusive and supportive environment that enables colleagues to grow, perform and deliver excellent outcomes.
• Manage team performance, resource planning and capability development to ensure the organisation has the skills and expertise required to meet current and future business needs.

Person Specification

• Experience establishing and promoting data engineering best practices, including coding standards, automation, testing, reproducibility, quality assurance and continuous improvement across teams.
• Advanced SQL skills and practical experience with tools such as Python, Git, dbt, Snowflake, Databricks or comparable technologies, including designing solutions for analytical data platforms and data warehouses.
• Strong understanding and practical application of data modelling techniques, including Kimball methodologies, star schemas, fact and dimension modelling, and slowly changing dimensions.
• The ability to take ownership of a data product, platform or service, shaping its strategy and roadmap around the needs of its users, and balancing immediate delivery needs with longer-term objectives and continuous improvement.
• A commitment to fostering an inclusive, collaborative and high-performing team culture, supporting colleagues to develop their skills and achieve successful outcomes.

What to expect when applying

• You will need to make your full application via Civil Service Jobs page Civil Service job search - Civil Service Jobs - GOV.UK
• You will have to complete and submit your full application before the deadline on 11th October 23:55.
• Your application will require you to submit a version of your CV and an application form of 1250 words based on the 5 key criteria listed in the Person Specification. Full details of the role and application is in the advert for this role on Civil Service Jobs.
• After application deadline, a sift will take place and all applications will receive an email update on the outcome of their application.
• You can reach out to the Companies House recruitment team for further questions or assistance with your application: recruitmentch@companieshouse.gov.uk

Don't forget Companies House offers

• Generous leave package – 30 days annual leave + 8 bank holidays + 1 privilege day
• Civil Service Pension – with around 28% employer contribution (worth approx. £16,956 for this role)
• Flexible and mobile working – hybrid working, flexible hours and flexitime from day one
• Career development – funded training, professional qualifications and clear progression pathways
• Wellbeing first – Investors in People Platinum accreditation, occupational health support and mental health advocates
• Family-friendly policies – generous maternity, paternity, adoption and shared parental leave
• Financial wellbeing – access to financial advice and support
• Lifestyle benefits – staff discounts, Cycle to Work scheme, gym offers and childcare support
• Inclusive culture – equality, diversity and inclusion at the heart of everything we do, with active colleague networks
• Recognition & community – staff recognition schemes, social groups and 3 days paid volunteering leave
• Everyday extras – seasonal flu jabs and access to support initiatives
• Location perks – including free parking in Cardiff and great on-site facilities