In this talk I will introduce the unique requirements and exciting challenges presented by mining social media for high-quality, user-generated content. I will outline how we approach these both as data scientists and big data engineers, finally sharing first-hand experience of building tooling and architecture that supports rapid model development.