Senior Data Engineer
Licensed sponsor Edinburgh Full-time Posted 6 hours ago
The Opportunity
We’re looking for a Senior Data Engineer to help design, build, and scale modern data platforms for our clients with a strong focus on Databricks and cloud‑native architectures.
You’ll work in multi‑disciplinary consulting teams, delivering high‑impact data engineering solutions across a range of commercial sectors. This role combines hands‑on engineering with technical leadership, shaping architectures, setting standards, and driving engineering excellence.
What You’ll Be Doin
- Design and build scalable data pipelines and lakehouse solutions using Databricks, Spark, and modern ELT pattern
- Develop and optimise cloud‑based data architectures, including data lakes and data warehouse
- Implement reliable ETL/ELT workflows to ensure high data quality, performance, and accessibility
- Work closely with data scientists, analysts, and client stakeholders to deliver production‑grade solution
- Optimise performance, reliability, and cost across data platform
- Identify automation opportunities and improve engineering workflow
- Lead technical initiatives and mentor junior engineers within project teams
What We’re Looking For
- 5+ years’ experience in data engineering, ideally in consulting or client‑facing environment
- Strong hands‑on experience with Databricks and Apache Spa
- Proficiency in Python (or similar) for data engineering
- Experience with cloud platforms such as Azure, AWS, or G
- Solid understanding of data warehousing, schema design, and data modelling
- Familiarity with orchestration and CI/CD tooling (e.g. Airflow, Git, Docker
- Strong communicator able to translate technical concepts for non‑technical audience
- A collaborative, problem‑solving mindset with a passion for engineering excellence
Join Optima Partners as a Senior Data Engineer and design, build, and scale cloud‑native Databricks lakehouse platforms for leading organisations, combining hands‑on engineering with technical leadership in a fast‑growing, practitioner‑led consultantcy
What We Offer
- Competitive salary + bonus up to 15%
- 37 days holiday (incl. Christmas shutdown)
- Private medical insurance, life & income protection
- Pension scheme
- 1,000+ employee perks
- Dedicated learning, training, and certification support
