Big Data: Methodological Challenges and Approaches for Sociological Analysis

The emergence of big data is both promising and challenging for social research. This paper suggests that realising this promise has been restricted by the methods applied in social science research, which undermine our potential to apprehend the qualities that make big data so appealing, not least in relation to the sociology of networks and flows. With specific reference to the micro-blogging website Twitter, the paper outlines a set of methodological principles for approaching these data that stand in contrast to previous research; and introduces a new tool for harvesting and analysing Twitter built on these principles. We work our argument through an analysis of Twitter data linked to political protest over UK University fees. Our approach transcends earlier methodological limitations to offer original insights into the flow of information and the actors and networks that emerge in this flow