Data Engineering Manager

  • Mixcloud
  • Remote (United Kingdom)
  • Sep 10, 2021
Full time App Development Product Manager Web Development

Job Description


Are you interested in data engineering and building a more sustainable ecosystem for music creators? The ideal applicant will have the technical expertise to lead on a variety of projects, but also manage a small team of engineers. You will contribute technically to projects and also grow as a leader in your field. You have strong knowledge of Python and SQL, and ideally some experience with data processing technologies such as Apache Spark. The Data engineering manager will help lead the development projects for royalties reporting and guide the continued growth and development of our engineering team. Sitting across project delivery from start to finish, you will help create a smooth process, from requirements gathering, communicate updates and ensure effective delivery.

Millions of creators across the world use Mixcloud to share music, engage with their communities and make money from their passions. Mixcloud takes care of paying royalties on millions of tracks and this requires precise processing of a large amount of data. We have a large user base and a long tail of user uploaded mixes, but a small and nimble development team. This means you'll have the opportunity to move quickly and the work is generally diverse and interesting.

Our existing reporting pipeline uses Luigi, BigQuery, Cloud Dataproc and GCS, so experience with these technologies would be very helpful. Alternatively, experience with Django (or a similar python web framework) is also a big plus, although web experience for this role is not strictly required. We ingest revenue data from Stripe and track data from DDEX deliveries and Gracenote.



What will you do:

  • Take initiative, drive new projects, and be a hands-on contributor.
  • Manage, delegate tasks and advise engineers on handling royalties reporting.
  • Ship enhancements and new functionality to our backend
  • Provide technical input to product ideas, prioritising and making resource delivery tradeoffs
  • Help deliver: directly contribute to the code and also enable your team to deliver reports on time.
  • Develop and empower your team. Provide leadership and guidance to your dedicated team while assisting internal and external partners with troubleshooting data issues.
  • Create effective lines of communication among the team
  • Collaborate and synchronise with external royalties stakeholders in technical discussions.
  • Be accountable for technical and delivery outcomes for your team.
  • Champion Diversity & Inclusion, by creating an environment of high trust. You can represent others and be an advocate or ally.

Who you are:

  • 2+ years of technical management experience
  • Strong background in Data Engineering
  • Python & SQL experience
  • Knowledge of Git and unit-testing
  • Able to communicate precisely and clearly with non-engineers
  • Accustomed to working to deadlines
  • You are a strategic thinker that can break down complex problems into relevant, actionable steps.

Nice to have:

  • Experience with Cloud Dataproc / GCS / BigQuery or other data warehouses.
  • Experience writing and debugging Apache Spark jobs, possibly with pyspark.
  • Experience working with DDEX formats such as DSR.
  • Experience working with revenue pipelines, payment calculations and VAT.
  • You are able to get stakeholder buy-in when identifying opportunities and balancing requests.