Senior Data Engineer

Senior Data Engineer – Databricks | FTSE 250 | Hybrid – York | £60,000 + 5K Car + up to 12% bonus

We are currently working with a FTSE 250 housebuilder who are looking for an experienced Data Engineer to join their team.

As a Senior Data Engineer, you'll join a small, highly collaborative team and play a key role in the development and evolution of the company's cloud-based data platform. You'll be responsible for developing and maintaining ETL pipelines, enhancing their in-house ingestion framework, administering the Databricks platform, and supporting a range of data initiatives across Business Intelligence, Analytics and AI.

This role would suit an experienced Data Engineer with strong Databricks, PySpark/Python and SQL expertise looking to step up in a senior role.

Responsibilities

• Development and maintenance of ETL pipelines
• Development and maintenance of our in-house ingestion framework
• Administration of the Databricks platform including data governance
• Supporting the Business Intelligence team in report development
• Supporting the wider business' data needs, including the AI lab and various other group functions

Key Skills & Qualifications

• Ideally a BSc / MSc in Computer Science (equivalent experience / similar degrees may also suffice)
• Databricks experience (ideally 3 years)
• Experience with Declarative Automation Bundles and Lakeflow Declarative Pipelines would be beneficial
• Python (including pyspark and declarative pipelines)
• SQL (especially DBSQL, experience with Databricks-native AI functions is a plus)

Preferred

• Databricks Data Engineering Associate / Professional Certifications
• git
• GitHub (including GitHub Actions)
• Star Schema Modelling
• Experience using Power BI or providing data for users of Power BI would be helpful in this regard
• Preparation of Feature Tables for Machine Learning
• Previous mentorship experience or line management would be a plus, but not essential

Salary and Benefits:

• £60,000 base salary
• £4,900 car allowance or equivalent company car
• Up to 12% annual bonus
• Private healthcare
• Discount scheme
• Hybrid Working from either York, Birmingham or Warrington office