Data Engineer – DataFactory, Spark, CI/CD - £85,000 - £110,000

Amazing technology stack!Tons of room for growth!Amazing clients!Great culture!

We’re looking for a skilled Data Engineer to join an amazing client with some of the best technology stacks available on the market. You’ll play a critical role in designing, building, and maintaining production-grade data pipelines using Spark and Databricks technologies.

This role is ideal for someone with hands-on experience in building robust, scalable data pipelines in a modern data stack environment and a passion for clean, automated, and testable code. If you’re comfortable working in agile teams and delivering quality at speed, we’d love to hear from you.

Key Responsibilities:

• MUST HAVE DELIVERY EXPERIENCE


• Develop and maintain production-ready Spark pipelines using PySpark and Spark SQL


• Implement and manage Delta Lake architecture and Unity Catalog for data governance


• Collaborate in Agile teams with clear sprint planning and delivery cadence


• Apply Git workflows (feature branches, PRs, code reviews) for code versioning


• Build and support CI/CD pipelines across 3-tier environments (Dev, Test, Prod)


• Participate across the full SDLC, including automated testing and production releases


• Proven experience building production Spark pipelines (PySpark, Spark SQL)


• Deep hands-on expertise with Databricks (including workspace management, clusters, jobs)


• Experience delivering solutions within a medallion architecture


• Knowledge of CI/CD pipelines and deployment automation across environments

This is a huge opportunity to join a fast-paced, fast-growing business and become a key player within the Senior Management team and gives you some epic career growth within a phenomenal organisation.

Please hit the button to Apply and/or call Jimmy Hearne 020 3950 1996 at InfraView for further info. If this role is not for you, register with us letting us know your preferences and will be in touch when the right role comes in.

Data Engineer – DataFactory, Spark, CI/CD - £85,000 - £110,000