Data Engineer

Purpose of the Role

Support the development and maintenance of enterprise data solutions, including the Data Lakehouse, Data Warehouse, and Medallion Architecture. Work alongside senior engineers and architects to build, test, and deploy scalable data pipelines, with a focus on ingestion, data validation, and structured transformations.

This is a hands-on opportunity for someone early in their data engineering career to gain deep experience with Microsoft’s Azure Data Platform and Microsoft Fabric, working on real-world solutions under guidance and mentorship.

How You Will Spend Your Time

• Data Integration Support: Assist with building and maintaining data ingestion pipelines from various sources using Microsoft Fabric, Azure Data Factory, and Synapse pipelines.
• ETL Development: Develop and maintain reusable ETL processes that support all layers of the Medallion Architecture, focusing on reliability, reusability, and simplicity.
• Notebook Automation Support: Help implement and schedule metadata-driven notebooks in Fabric using Spark under the supervision of senior engineers.
• Data Quality and Testing: Assist in implementing and monitoring data quality checks, validation rules, and basic lineage tracking.
• Documentation and Data Catalogue Support: Document data flows and transformations, and support updates to data cataloguing tools or metadata repositories.
• BI & Reporting Integration: Assist with connecting data models to Power BI, and help develop certified datasets and semantic layers for self-service users.
• Environment & DevOps Support: Learn and contribute to CI/CD processes using Azure DevOps and Git. Support code reviews and testing cycles.
• Learning and Development: Participate actively in code reviews, design sessions, and platform learning. Take ownership of tasks and work through feedback constructively.
• Testing and Data Quality Assurance: Develop and maintain unit tests to validate pipeline logic and data transformations. Collaborate with engineering peers to continuously refine test coverage and uphold data integrity standards.

Skills and Experience Needed

• Deliver sprints to the satisfaction of stakeholders.
• Support data pipeline reliability, with minimal failures and auto-recovery.
• Meet defined SLAs for data freshness across Bronze, Silver, and Gold layers.
• Contribute to delivering valuable business insight through new solutions.
• Drive innovation through regular adoption of new Fabric AI and automation features.
• Implement robust solutions with minimal time spent fixing bugs.

What Sets Us Apart?

• Global Impact: With offices in the UK, US, and Australia, and plans for further expansion, you will be part of a dynamic, globally-minded team with opportunities to explore new markets and make a difference on a global scale.
• Flexible Working: Work from anywhere in the world for up to 30 days a year. We prioritize work-life balance and recognize that your well-being matters.
• Commitment to Diversity and Inclusion: We celebrate our diverse culture and value individuals regardless of background, disability, religion, gender identity, sexuality, or ethnicity. Diversity is welcomed and celebrated as a key driver of growth and innovation.

Hybrid Working

Hybrid working typically means 2 days in the office location listed on this advert and 3 days working at home each week. Occasional travel to other offices may be required.

What Happens Next?

Once we receive your application, it will be reviewed by a human. The average process typically takes around 2–3 weeks, with 2 stages of video interviews using Teams. This can vary depending on the role; you may be invited for a face-to-face meeting or asked to complete only 1 video interview. If you have questions or need support, the Recruitment Team will assist you.

Ready to join us on our journey to digitise, decarbonise, and localize the future of energy? Apply now.