Data engineer
Grade SEO
What data engineers do
A data engineer develops and constructs data products and services, and integrates them into systems and business processes.
Role responsibilities
As a Data Engineer, you will be joining a team of talented data engineering professionals, who are committed to delivering high-impact and secure data solutions to achieve departmental and directorate objectives.
This role sits in Data Engineering Division. As a division, we provide a full range of engineering capabilities including data sourcing, management, operations, and maintenance of underlying infrastructure.
In the Department for Education you will:
- work as part of a multidisciplinary team to build, and deliver high performance, scalable data solutions
- partner with the product owners, architects, software engineers, and data scientists to understand data needs, and deliver on those needs
- work on Azure cloud-based tech stack, Databricks, Python, Informatica DEI, and Data Quality product set
- be part of Agile development teams, adapting and embedding practices such as CI/CD and DevOps
- coach and mentor junior members of the team to support their professional development
- help build and maintain our data engineering community to facilitate knowledge sharing, innovation, and collaboration
Skills you need
It is essential that you can demonstrate the following experience in your application and at the interview:
- data development process. Good experience of building data pipelines on cloud platforms
- agile working. Experience of delivering data products in an agile delivery environment through DevOps working practices CI/CD, automation etc
- collaboration. Ability to work alongside others to ensure the stability, robustness, and resilience of products you build.
- programming and build. Good experience of programming and proficiency in SQL, Python, Azure Data Factory, Informatica DEI, and/or Databricks
- problem resolution. Good understanding of the types of common problems in data structures, process, and products, and their resolution techniques
- data innovation. Understanding of business requirements and spotting opportunities to innovate. Willingness to step out of comfort zone and learn modern data engineering practices and trends
It is desirable if you can demonstrate the following:
- coaching and mentoring. Experience of mentoring junior members of the team.
- data structures. Experience with relational data models and/or cloud data warehouses.