Backend Engineer - Data Platform

We’re looking for a mid-level Backend Engineer to join Spotify’s Data Platform team. We in the Data Processing Product Area, enable Spotify to solve complex and critical data engineering problems by providing a platform and tooling for the production, management and consumption of high-quality data. We are an amplifier for efficiency, quality, and innovation across Spotify.

You’ll design, build and develop scalable infrastructure services and tools, and collaborate in a cross-functional team. In the DataEx squad, we are looking for a backend/data engineer to help us increase productivity, optionality and flexibility for data practitioners through scalable, portable and reliable data processing platforms. What You'll Do You’ll collaborate with product and engineering to build and support the infrastructure that empowers Spotify teams to process data to solve critical business needs.

Increase developer productivity by building innovative tools that reduce overhead of working with data pipelines, help increase platform reliability, and are cost-efficient. Work with engineers with deep expertise in data and collaborate closely with squads in Spotify to drive improvements in the data processing ecosystem through support, best-practices and standards. Help the platform orchestrate data jobs in a seamless way, for the users not having to worry about what is happening “under the hood” Who You Are You are proficient in backend development using Java.

You are comfortable working with big data using SQL and data analytics platforms such as BigQuery. You have experience with one or more higher-level JVM-based data processing frameworks such as Flink, Beam, Dataflow, Spark, etc. Devops is part of your day-to-day work and you are used to working with cloud-based infrastructure and services, containerised applications.

You have some experience working with Kubernetes and are familiar with its basic concepts. You have experience of working with data engineering pipelines in Scala and/or Python. Quality is important to you and you know what it means to ship high-quality code.

You appreciate agile software processes, and sound engineering practices like continuous delivery, defensive programming, and automated testing. You love working in an environment where you constantly experiment and iterate quickly. You are comfortable with ambiguity, enjoy working on open ended problems, and believe data is the most powerful tool for informed decision-making.

Where You'll Be This role is based in London We offer you the flexibility to work where you work best! There will be some in person meetings, but still allows for flexibility to work from home.