Senior Data Engineer
✨ AI Summary
Transform, an end-to-end transformation consultancy specializing in public sector and public-facing organizations, is hiring a Senior Data Engineer in London. The role involves designing and building scalable data pipelines on cloud platforms like Azure or AWS, with a tech stack including SQL, Python, Azure Data Factory, Databricks, Fabric, and Snowflake. Requires proven experience delivering production-ready data pipelines, strong data quality practices, and CI/CD knowledge; mentoring and AI/vector database experience are desirable. Perks include 28 days holiday, private healthcare, pension matching, and flexible benefits.
About us
We're Transform.
Transform is a fresh alternative to Big Consulting. As an end-to-end transformation partner, we define, design, build and operate systems that solve our clients’ toughest challenges and seize their biggest opportunities. That often means combining strategy, data, AI, technology, and change management. Sometimes we manage and operate the systems we create; other times, we hand it over for the client to run – standing by to make improvements when things change. It all comes down to making an impact: improving lives, supporting citizens, streamlining workflows, and making the world a better place. We specialise in public sector and public-facing organisations—from government agencies and local authorities to energy, utilities, transportation and healthcare. We also work for some of the world’s most dynamic brands across automotive, retail, financial services, and consumer goods. We work closely (often on site) with our clients; to deliver impact you are keen to help us build the workforce of the future, we should talk.
We’re all in! That's what gets us out of bed every day. We hope you feel the same.
The Role: Senior Data Engineer
The Senior Data Engineer will play a key role within an Agile delivery team to design, build, and maintain robust, scalable data solutions. You will contribute to the delivery of a range of data products that support business intelligence, reporting, analytics, and AI-driven use cases, ensuring data is accessible, reliable, secure, and fit for purpose.
Working collaboratively across multidisciplinary teams, you will engage closely with other engineers, product owners, business analysts, data architects, data analysts, project managers, and data scientists to understand business requirements and translate them into effective technical solutions. You will be responsible for developing and optimising data pipelines and integrating diverse data sources within cloud-based data platforms.
As a senior member of the team, you will provide technical guidance, promote engineering best practices, and contribute to the continuous improvement of delivery processes, tooling, and standards. You will champion data quality, ensuring that solutions are scalable, maintainable, and aligned with organisational and regulatory requirements.
We are looking for individuals who bring a growth mindset and a passion for continuous learning. You will be curious about emerging technologies, particularly within the AI and data landscape, and proactive in identifying opportunities to innovate and improve delivery.
The Senior Data Engineer will play a key role within an Agile delivery team to design, build, and maintain robust, scalable data solutions. You will contribute to the delivery of a range of data products that support business intelligence, reporting, analytics, and AI-driven use cases, ensuring data is accessible, reliable, secure, and fit for purpose.
Working collaboratively across multidisciplinary teams, you will engage closely with other engineers, product owners, business analysts, data architects, data analysts, project managers, and data scientists to understand business requirements and translate them into effective technical solutions. You will be responsible for developing and optimising data pipelines and integrating diverse data sources within cloud-based data platforms.
As a senior member of the team, you will provide technical guidance, promote engineering best practices, and contribute to the continuous improvement of delivery processes, tooling, and standards. You will champion data quality, ensuring that solutions are scalable, maintainable, and aligned with organisational and regulatory requirements.
We are looking for individuals who bring a growth mindset and a passion for continuous learning. You will be curious about emerging technologies, particularly within the AI and data landscape, and proactive in identifying opportunities to innovate and improve delivery.
- Working with clients to understand their needs, and implement the best technological solution
- Building and configuring complex end-to-end data pipelines
- Delivering in fact-paced environments where requirements may evolve over time
- Collaborate effectively within agile, cross-functional teams to deliver high-quality data solutions
- Solid foundations in data engineering principles and best practices
- Proven experience of designing, building and delivering production-ready data pipelines
- Strong communication skills, with the ability to engage and influence stakeholders at all levels
- Strong SQL and Python expertise, with experience in the development of reusable frameworks and components
- Strong understanding of data quality and experience embedding appropriate controls throughout the data platform and delivery lifecycle
- Significant experience designing and delivering data solutions on cloud platforms such as Azure or AWS
- Hands-on experience with modern data engineering platforms and services, such as Azure Data Factory, Databricks, Fabric, Snowflake or equivalent technologies
- Experience working with a diverse range data sources, including structured and semi-structured data
- Understanding of CI/CD tooling and processes used to support reliable and efficient deployments
Desirable Skills:
- Experience of mentoring junior to mid-level Data Engineers would be beneficial
- Experience of vector databases or knowledge graphs
- Experience of using AI to assist development
Our culture is built on:
- We raise the bar
- We look out for each other
- We embrace our differences
- We shape a changing world
- We’re all in
Our benefits include:
- Holiday entitlement, 28 days with the option to buy/sell up to 5 days (note that 3 days are held for Christmas holidays)
- Day off (on or in the week of) your birthday
- Pension eligibility, up to 5% matched contributions
- Private healthcare
- Life assurance
- Enhanced maternity and enhanced paternity and shared parental leave
- Cycle to work schemes
- Gym & retail discounts
- Regular social events/activities
- A range of other benefits from our flexible benefits package
At Transform, you can expect meaningful work, with real impact and the space to grow as people as well as a professional.
You’ll work alongside curious, authentic experts who care deeply about doing the right thing, for our clients and for each other with no egos, no blame, and no standing on the sidelines.
We’re all in on creating an environment where people feel supported, included and trusted to do their best work. In return, we ask for curiosity, honesty and a willingness to lean into learning, quality, teamwork, and to making change that truly lasts.
We’re committed to equality of opportunity for all, and we actively seek applications from all ethnicities, orientations, beliefs, gender identities + those with neurodiverse traits and disabilities. We want you to have the best opportunity to show us who you are and what you can do. Please do let us know if you need any adjustments now or at any point in the recruitment process.
If this sounds like you, please get in touch to discuss in more detail.
Use of AI in CV and Interviews
We value authenticity and transparency in our hiring process. To ensure fairness and accuracy in assessing your skills and experience, we ask that you refrain from using AI-assisted tools to generate answers during the application process or within interviews.
We are looking for genuine insights into your abilities, experiences, and personality. Any misrepresentation through AI-generated content may impact our ability to make an informed decision. We look forward to getting to know the real you!
About the Company
More jobs at Transform
-
Senior Solutions Architect
London, London · hybrid · Aug 19, 2026
-
Senior/Lead Data Solutions Architect
London, London · hybrid · Aug 19, 2026