Senior Data Engineer
London, England, United Kingdom Full-time Posted 1 week ago
About Freemarket
Freemarket is the next-generation payments network for fast, compliant, borderless payments for businesses.
We started our company in 2010 to challenge the methodology of the FX market. We thought the sector had been poorly served - both in terms of efficiency and price - and we wanted to bring transparency and value to customers. That philosophy remains today.
Now we are a trusted payment network for cross-border settlement. We connect businesses with vital payment and banking services. Customers control the speed, routing, timing, price and settlement in our portal, giving them control, choice and confidence over all their payments. Through our rail-agnostic network, customers can access 140 currencies, USDT Stablecoin, short-term lending and a range of other services designed to make payment faster, cheaper and more transparent.
We have strong financial backing, a well-connected Board behind us, real experience in our management group and a brilliant team. That team is a powerful network of people, driven by a common goal to enable growth for our clients.
Our Collective Success Is Powered By Shared Values
We Own It - high empowerment for our people and high accountability for results. Results for our clients, our business and for your careers.
We are Relationship-Led - trust and depth in the relationships across our team and with our clients and partners is what enables us to operate at speed and enjoy ourselves every day
We Make-it-Happen - a strong executional focus. We make considered decisions and then execute with resolve. We learn from mistakes and then execute again. Everybody at Freemarket takes responsibility for keeping us moving forward.
We Stay Curious - Regardless of career-stage, we are all on a learning journey, individually and together. In particular, we embrace the opportunities AI brings to all of us to grow and evolve
We Think Bigger - We don't wake up every day to do the same thing we did yesterday. We are inspired by what is possible and welcome it when others challenge our thinking.
Together, we are Freemarket.
Working at Freemarket
Data at Freemarket is a high-performance, high-quality, fast-paced environment. We have direct commercial impact, direct integration with business strategy, and a pro-AI culture. The roadmap is established and the opportunity to build something great is there. Deadlines can be tight and the goals the business sets are exciting and challenging in equal measure.
What Good Looks Like In This Role
We are seeking a Senior Data Engineer to continue building and developing our newly launched Databricks platform. There is an existing roadmap for projects with direct commercial impact and AI integration for speed to revenue. Experience working in the Payments space is a big plus!
We’re committed to building a diverse and inclusive workplace. We welcome applications from all backgrounds and experiences and believe that diversity of thought makes better products and better teams. Adjustments are available throughout the recruitment process.
Freemarket is the next-generation payments network for fast, compliant, borderless payments for businesses.
We started our company in 2010 to challenge the methodology of the FX market. We thought the sector had been poorly served - both in terms of efficiency and price - and we wanted to bring transparency and value to customers. That philosophy remains today.
Now we are a trusted payment network for cross-border settlement. We connect businesses with vital payment and banking services. Customers control the speed, routing, timing, price and settlement in our portal, giving them control, choice and confidence over all their payments. Through our rail-agnostic network, customers can access 140 currencies, USDT Stablecoin, short-term lending and a range of other services designed to make payment faster, cheaper and more transparent.
We have strong financial backing, a well-connected Board behind us, real experience in our management group and a brilliant team. That team is a powerful network of people, driven by a common goal to enable growth for our clients.
Our Collective Success Is Powered By Shared Values
We Own It - high empowerment for our people and high accountability for results. Results for our clients, our business and for your careers.
We are Relationship-Led - trust and depth in the relationships across our team and with our clients and partners is what enables us to operate at speed and enjoy ourselves every day
We Make-it-Happen - a strong executional focus. We make considered decisions and then execute with resolve. We learn from mistakes and then execute again. Everybody at Freemarket takes responsibility for keeping us moving forward.
We Stay Curious - Regardless of career-stage, we are all on a learning journey, individually and together. In particular, we embrace the opportunities AI brings to all of us to grow and evolve
We Think Bigger - We don't wake up every day to do the same thing we did yesterday. We are inspired by what is possible and welcome it when others challenge our thinking.
Together, we are Freemarket.
Working at Freemarket
Data at Freemarket is a high-performance, high-quality, fast-paced environment. We have direct commercial impact, direct integration with business strategy, and a pro-AI culture. The roadmap is established and the opportunity to build something great is there. Deadlines can be tight and the goals the business sets are exciting and challenging in equal measure.
What Good Looks Like In This Role
- Self-starter who thinks ahead: Comfortable dealing with ambiguity and turning a concept or idea into something tangible, anticipating the steps ahead and driving work forward independently.
- Driven and Team player: Wants to deliver great work and sees the wider impact of it. We are here to grow and support each other, so working in isolation is not the right way.
- Thrives under variety and pace: Comfortable with a broad range of work and tight deadlines, while keeping quality high.
- Team-first: Joins a high-performing data team of talented, collaborative thinkers who look after one another.
We are seeking a Senior Data Engineer to continue building and developing our newly launched Databricks platform. There is an existing roadmap for projects with direct commercial impact and AI integration for speed to revenue. Experience working in the Payments space is a big plus!
- AI-first ways of working: Claude is our primary development tool for coding, QA, planning, and documentation. Experience with Claude Code, or a strong interest in adopting it, is expected for this role.
- Process data: Efficiently process wide variety of data, including structured and unstructured, ensuring the required business frequency of data availability is met.
- Data quality and controls: Set up and maintain controls ensuring data quality, completeness, and delivery.
- External integrations: Integrate external data sources and providers, such as HubSpot, PassFort, and potential other data providers via API.
- Contracts: Set up data contracts with the Engineering team, ensuring a strong relationship between the two teams and a fluid data ingestion process.
- ETL Development: Design and build robust and reusable ETL/ELT pipelines through the Medallion architecture in Databricks. For example, shaping HubSpot commercial intelligence for network and business reporting, ingesting external data sources for market segmentation, and perfecting transactional data by blending it with commercial and compliance context
- Pipeline Orchestration: Develop and manage workflow orchestration within Databricks, including jobs, triggers, and dependencies. The business has a range of data-availability requirements, so we maintain hourly, x4 and daily pipelines.
- Error Handling: Design and implement effective logging, monitoring, and alerting strategies for robust error management and recovery. Errors come with human input, particularly on the CRM and platform, so we capture and resolve them before they affect reporting.
- Scalability & Futureproofing: Contribute to architectural discussions and decisions, ensuring scalability, data quality, and future-proof data systems. We are growing fast and so is our data, but the stakeholder’s expectations on speed of reporting stay constant, so our pipelines have to be scalable and futureproof.
- Collaboration: Work closely with Data Analysts, Data Scientists, Finance, Marketing, and the BI team, providing pipelines for direct commercial impact data analytics/science products, AI initiatives and wider data availability for the business.
- Documentation & Planning: Maintain comprehensive documentation covering data models, architecture decisions, transformation logic, and operational procedures, leveraging Claude for planning, drafting, and documentation.
- Data Governance & Security: Ensure compliance with data security policies, data retention rules, and privacy regulations. The role handles PII and sensitive private information, so it must be processed securely.
- Custom Dashboards: Experience spinning up HTML / Python / Java dashboards on Databricks Apps or alternative service. We have already built custom reporting for our network intelligence and there is more to come, so we need to transform this intelligence into Databricks and host it for business use safely, efficiently, and cost- effectively.
- Significant demonstrable experience in data engineering or similar roles.
- Strong hands-on experience with Databricks on Azure, including notebooks, cluster configuration, Databricks apps, Parquet data and Delta Lake
- Coding/Developing: Python, PySpark, SQL, Claude Code.
- CI/CD: Terraform, GitHub, Octopus Deploy.
- Good to have: HTML, Java.
- Room to grow into ownership: The successful candidate has the opportunity to grow into a platform owner role, defining the roadmap and strategy for the engineering function, as well as the wider process and tech stack.
- A futureproof tech stack: Work with the latest tools and an AI-first approach, on a stack that is built to last.
- A strong team of thinkers: We share ideas, learn from each other, and support each other, so we can all succeed together.
- Real commercial impact: Data is not a supporting function. We are building something epic, the commercial intelligence that will define our network expansion.
- A voice that’s heard: Have a great idea that aligns with strategy and carries business or commercial impact? We will listen, and we will help you make it happen.
- A platform to build on: Our Data Platform has recently been completed, with the opportunity to grow it into the engine behind all reporting, intelligence, and AI projects.
- Hybrid working - an average of 2 days per week in our office near London Bridge
- Participation in the discretionary company bonus scheme
- 25 days annual leave plus bank holidays
- Enhanced pension contribution with Aviva, plus the option to boost your savings further with salary sacrifice
- Private healthcare and wellbeing support
- Access to rewards, discounts and financial coaching platforms
We’re committed to building a diverse and inclusive workplace. We welcome applications from all backgrounds and experiences and believe that diversity of thought makes better products and better teams. Adjustments are available throughout the recruitment process.
