Data Engineer
London Area, United Kingdom Contract Posted 2 weeks ago
Role/Job title
Data Engineer
Work Location
London/Edinburgh
Role type
Contract InsideIR35
Mode of working
Hybrid
If Hybrid, how many days are required in office?
2 to 3 days
Duration of assignment
6 months
The Role
As a Data Engineer, you will design and build scalable data pipelines and data products using modern cloud technologies, ensuring efficient ingestion, transformation, and consumption of data.
Your Profile
Key Responsibilities
- Build and maintain data ingestion, transformation, and consumption pipelines
- Develop ETL/ELT processes using cloud-native services
- Implement batch and real-time data pipelines (Kafka/event streams)
- Ensure data quality, performance, scalability, and security
- Work with Data Modellers to implement data structures and schemas
- Integrate data from multiple sources (S3, Snowflake, MongoDB, DynamoDB, etc.)
- Contribute to DataOps practices, CI/CD, and automation
Essential skills/knowledge/experience:
- Strong experience in building data pipelines on AWS-based platforms
- Expertise in ETL/ELT, data pipeline orchestration, and cloud-native tools
- Strong programming skills (Python, SQL; Spark preferred)
- Experience with services such as S3, Glue, Kafka, Snowflake
- Understanding of DataOps, CI/CD, and data platform best practices
- Experience in large-scale data platforms and distributed systems
