[London] Songkick (YC S07) WLTM Senior Data Engineer...

Songkick is looking for an experienced developer to lead the data acquisition and processing activities of our small but extremely talented technical team.

This is an opportunity to work on some very hard, very intriguing problems; we are engaged in massive-scale data acquisition and processing. Our CEO and CTO have backgrounds in machine learning which is indicative of the way we approach these challenges.

SALARY + START DATE + PERKS

Competitive salary + generous stock options. Start date ASAP. Perks include monthly concert tickets stipend (use-it-or-lose-it), great location, and charming multi-national colleagues hailing from California to Rio Grande via Bedford and Schwäbisch Hall.

RESPONSIBILITIES

- heading the data acquisition- and processing side of our development operations, providing tools to maintain our comprehensive database of live music information

- developing strategies for data acquisition, storage, quality assurance and processing to support our website and other products

- leading and growing a ‘data team’ within our team of in-house developers:

- motivating individuals and developing their skills

- identifying, and recruiting for, skills gaps

- interacting with outsourced developers to provide datafeed adaptors, web scrapers etc. as necessary

- monitoring our data processing systems and ensuring scalability as demand increases

- interacting with our quality assurance team to ensure that data-related issues are resolved in a timely fashion

WHAT WE’RE LOOKING FOR

- experience providing and scaling an infrastructure from an early stage to maturity to support data intensive web applications and services, ideally within a UNIX/Linux environment

- experience designing and implementing systems to aggregate noisy, ambiguous, heterogeneous data from multiple sources

- experience designing and implementing systems using a combination of automated and manual processes to ensure a high level of data quality

- proven ability to effectively lead, motivate and grow a team of developers

Also a big plus would be experience of:

- agile / lean development practices

- test- and behaviour-driven development

- Ruby on Rails

- popular data processing and search tools such as Nutch, Lucene, Hadoop, Ferret

To apply please send your CV, URLs of cool things you've built / worked on, and a short email introducing yourself to joinsongkick@songkick.com. Tell us about the most recent gig you’ve been to if you like!

No deadline. We'll keep looking until we find our (wo)man.