Senior Data Engineer

About Us

Oxfordshire County Council’s central Data Office brings together data architecture, engineering, analytics and spatial data expertise. We work across the organisation to improve how data supports effective public services, operational delivery and better outcomes for residents.

About the Role

As a Senior Data Engineer, you will take a hands-on role in designing and delivering scalable data pipelines, integrations, lakehouses, data warehouses and data models. The role requires strong SQL, Python and ETL/ELT experience, with a particular focus on designing and developing solutions in Microsoft Fabric.

Key responsibilities include

• Designing and delivering scalable, reliable and reusable data engineering solutions.
• Building ETL/ELT pipelines and integrations using ETL tools, Microsoft Fabric, SQL, Python and other appropriate technologies.
• Designing and configuring Microsoft Fabric pipelines, lakehouses, data warehouses and data models.
• Supporting the migration of on-premises data workloads to Microsoft Fabric.
• Implementing data quality controls, testing, monitoring and technical documentation.
• Applying data architecture standards and engineering best practices.
• Translating complex business requirements into practical, maintainable data solutions.
• Creating and maintaining data catalogue, metadata management and data lineage.
• Working collaboratively with technical teams, analysts and business stakeholders.

About you

• Significant experience of developing data integration, migration and data warehousing solutions using one or more ETL platforms, such as Talend, Microsoft Fabric, FME or SSIS.
• In-depth working knowledge of SQL, with the ability to write and optimise queries and stored procedures.
• Experience building robust data pipelines using Python, PySpark or other relevant programming languages.
• Solid hands-on experience of designing and developing Microsoft Fabric solutions across pipelines, lakehouses, warehouses and data layers.
• Strong data modelling skills, with experience designing scalable and maintainable models for data integration, warehousing, analytics and reporting.
• Strong data discovery skills, including locating, understanding and analysing source data.
• Experience of implementing testing and data quality controls to identify, prevent and resolve data anomalies.
• Experience of creating and maintaining data catalogues, technical metadata and data lineage using Microsoft Purview or another metadata management platform would be advantageous.

We recommend reviewing the attached job description on our careers site.

Rewards and benefits

At OCC, you'll be part of a team that’s not only passionate about what we do, but also about how we do it. We foster a culture of inclusion, respect, and continuous improvement, and we’re proud to offer flexible working arrangements, professional development opportunities, and a strong sense of purpose in everything we do.

• Hybrid working – Benefit from a flexible mix of home and office working, with typically around one day a week in the office for collaboration.
• Culture of flexible working - Flexibility is important to deliver the service and to suit individual lifestyles. We encourage discussion at interview as we acknowledge there isn’t a one-size-fits-all approach.
• Great learning and development opportunities to support your growth
• Technology to support agile working – with unlimited access to Copilot for smarter productivity
• Employee Assistance Programme with health and wellbeing support
• Generous annual leave - up to 30 days plus bank holidays, and an option to 'buy' additional time off
• Enhanced family-friendly policies
• Local Government Pension Scheme - employer contributions up to 19.9%
• Discounts - local and national offers for shopping and travel

For informal enquiries or further information about the role, please contact Gowri Nagarajan, Data Architecture and Engineering Lead on Gowri.Nagarajan@Oxfordshire.gov.uk.

Please note: We reserve the right to close this vacancy early if we receive a high number of applications, so we encourage you to apply as soon as possible.