Senior Data Engineer
Our client, a leading global supplier for IT services, requires Senior Data Engineer to be based at their client’s office in Warwick, UK.
This is a hybrid role – you can work remotely in the UK and attend the Warwick office 3 days per week .
This is a 6+ month temporary contract to start asap
Day rate: Competitive Market rate
The Interconnectors Data Platform (ICDP) is a cloud-based data warehouse enabling critical commercial, financial modelling, and operational decision-making. As the platform moves toward a modernized Medallion Architecture and Azure-native ingestion patterns, we are hiring a Senior Data Engineer to provide architectural direction and hands-on technical leadership.
Key Responsibilities
Data Architecture & Platform Engineering
- Lead the design and implementation of scalable data architectures, including Bronze/Silver/Gold layered models.
- Drive the platform’s architectural roadmap and ensure alignment with modern engineering best practices.
- Develop robust, secure, and observable ingestion and transformation pipelines.
Pipeline Development & Operations
- Lead the migration from legacy ETL tools (e.g., Matillion) into modern Azure-based pipelines, including Azure Functions, Azure Data Factory (ADF), and event-driven frameworks.
- Build and maintain performant SQL-based transformations, curated layers, and reusable data models.
- Ensure CI/CD, testing, version control, and observability are fully embedded in workflows.
Data Quality & Governance
- Implement data validation, reconciliation, profiling, and auditability across platform layers.
- Work with business stakeholders to ensure output meets analytical and operational needs.
Leadership
- Mentor data engineers and contribute to the growth of technical capability within the ICDP team.
- Collaborate with Product teams, IT&D, and external partners to deliver high-quality outcomes.
- Serve as a technical authority for engineering approaches, patterns, and standards.
Key Requirements
Essential Skills:
- Python: Strong, hands-on experience building production-grade data pipelines, transformations, and orchestration using Python.
- Advanced SQL: Expert-level analytical SQL, query optimization, and data modelling.
- Azure Cloud: Experience with Azure Functions, Azure Data Factory, Azure Storage, Key Vault, and cloud security fundamentals.
- Data Warehousing: Deep understanding of data architecture principles, dimensional modelling, and scalable enterprise data design.
- Strong grounding in Git, CI/CD, automated testing, branching strategies, and modern engineering practices.
- Experience with API ingestion, SFTP ingestion, and resilient pipeline design
Desirable Skills:
- Experience contributing to or leading data-platform re-architecture programs.
- Exposure to Medallion/Lakehouse patterns or Databricks-style ecosystems.
- Experience in regulated or high-assurance data environments.
- Collaboration with modelling teams or environments where engineering and modelling intersect.
Due to the volume of applications received, unfortunately we cannot respond to everyone.
If you do not hear back from us within 7 days of sending your application, please assume that you have not been successful on this occasion.
Please do keep an eye on our website https://projectrecruit.com/jobs/ for future roles.
