The data engineering team at Confused.com is committed to providing high-quality data/reporting services to our customers.
We’re looking for a Senior Data Engineer, a role that has evolved from the role traditional Senior SQL Developer.
Ideally, we’re looking for an experienced cloud engineer, but we would consider taking on someone who is an experienced SQL developer with the capability and drive to fill this role.
The role
With the rise of the cloud, data has become more important than ever, and this role provides an opportunity for the right person to shine as a data expert.
Working closely with colleagues from across the business, you’ll get the chance to expand your knowledge of different data technologies and explore new and exciting capabilities—including big data and artificial intelligence.
You’ll be working with a team of data experts tasked with fully automating a new cloud data platform as well as maintaining our existing solution.
Within Confused.com, there’s a growing focus on data and data-driven decision-making. As such, we’ll rely on you to generate well-articulated data-oriented test cases and determine the positive, negative and boundary cases.
We work in a fast-paced, agile, and continuous delivery release-driven environment. The right candidate for this position will be motivated by this challenge and will help to develop our future ways of working.
Coding languages currently used by the team
- SQL Server 2016 and above, Azure DevOps, C#, Business Intelligence Markup Language (BIML), PowerShell, Azure Resource Manager (ARM), Tableau.
Key competencies
- You’ll work closely with our cross-functional agile product teams to identify and deliver projects that will drive value to customers of Confused.com.
- Experience of working in highly dynamic teams using agile methodologies
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources, including third-party providers and our existing Azure platform.
- Identify, design, and implement internal process improvements: automating manual processes, optimising data delivery, re-designing infrastructure for greater scalability, etc.
- Foster a self-service data culture; working closely with other data engineers, architects, and technologists to share knowledge, evaluate opportunities and proactively recommend improvements in architecture, pipelines, data models, tools and processes.
- Translates data into valuable insights that inform decisions. Involves teams in analytics and synthesis to increase consensus and challenge assumptions.
- Must be passionate about DevOps and have a resilient attitude in pushing the DevOps perspective within a Kanban team.
- Maintaining and creating continuous delivery pipelines in Azure DevOps.
- Positive outlook and desire to learn and help drive and instil technical excellence within the Confused.com IT department.
- Deliver projects to time, budget and quality in order to deliver business goals.
Essential skills
- Experience of tools such as VSTS (Azure DevOps).
- Designs, writes and iterates code from prototype to production-ready. Understands security, accessibility and version control.
- Knowledge of data warehousing concepts, including data warehouse technical architectures, infrastructure components, ETL/ELT and reporting/analytic tools.
- Strong SQL skills and familiarity with data modelling and relational databases.
- A passion for data, cloud-based services and customer experience.
- Knowledge and experience of Kimball design.
- Ensures risks associated with deployment are adequately understood and documented.
Desirable skills
- Keeping current with new capabilities of and improvements in the services provided by Microsoft.
- Experience with code versioning systems (e.g. git) and CI/CD tools such as MS Build.
- Hands-on experience in cloud based services, most notably Database, Compute and Storage
- Develops fit for purpose, resilient, scalable and future-proof data services to meet user needs. Has a demonstrable understanding of how to expose data from systems (for example, through APIs), link data from multiple systems and deliver streaming services.
- Experience of cloud-based testing.
Why you should apply
At Confused.com, you’ll be working in an innovative and agile environment, using cutting-edge technology, with access to many benefits including flexible working.
At Confused.com, we’re proud to be a diverse business where we put our people and customers first.We understand that a good work-life balance is important, and we want you to have an element of freedom to define a working lifestyle that supports this.We’re happy to talk about flexible working. Please contact recruitment@confused.com for more information. We're relaxed on dress code and are social in and out of work. Without blowing our own trumpet too much, we think it's pretty sweet working at Confused.com!
Think you’ve got what it takes?
Complete the application form and send us your CV.
