Data Engineer
Glasgow, Scotland, United Kingdom Contract Posted 1 hour ago
Role Overview
We are seeking an experienced AWS Data Engineering Consultant to provide technical leadership and hands-on engineering support.
Role Information:
- Role: Data Engineer
- Location: Glasgow
- Working model: Hybrid
- Length: Until EOY + extensions
- Start: ASAP
Key Responsibilitie:
- Design and implement scalable AWS data platforms, pipelines and analytics solutions.
- Develop and optimise data ingestion, transformation and integration workflows across enterprise systems.
- Investigate pipeline failures, data processing issues and performance bottlenecks, providing root cause analysis and remediation recommendations.
- Review code, data architecture and integration patterns to improve scalability, security and performance.
- Support vector data stores and retrieval architectures for AI and analytics use cases.
- Support data modelling, data quality and metadata management across cloud-based platforms.
- Implement and maintain infrastructure using Terraform and/or AWS CloudFormation.
- Collaborate with Data Architects, Data Engineers and business stakeholders to translate requirements into technical solutions.
Required Skills and Experience
- Strong hands-on experience with AWS data services, including S3, Glue, Lambda, Redshift, Athena, EMR and DynamoDB.
- Proven experience designing, building and troubleshooting enterprise-scale data pipelines and ETL/ELT frameworks.
- Strong proficiency in Python and SQL, with Spark and/or PySpark experience.
- Experience reviewing code and resolving complex issues within distributed data processing environments.
- Experience delivering cloud infrastructure using Terraform and/or CloudFormation.
- Strong understanding of data modelling, data quality, metadata management and cloud data architecture.
- Ability to communicate technical findings and recommendations clearly to engineering teams and business stakeholders.
Desirable Experience
- Experience with vector databases, embeddings and retrieval architectures supporting AI applications.
- Previous delivery experience within banking, financial services or another regulated enterprise environment.
