Analysing Reddit Data on Standard error

Analysing reddit data: data analysis

Wed, 09 Dec 2015 00:00:00 +0000

Part of the series

Analysing Reddit Data

1. Analysing reddit data: setting up the environment

2. Analysing reddit data: extracting the data

3. Analysing reddit data: cleaning and describing the data

4. Analysing reddit data: data analysis

This week ends a 4-part series on extracting and analysing JSON-encoded data from reddit, using the subreddit /r/relationships as an example. In the first two entries I set up the environment and collected the data. Last week, I finished by cleaning the data and doing some basic analyses. This week we'll finish with some fairly simple bivariate analyses. We'll answer some questions about both posters to the subreddit and how the readers react to these posts, and play around with visualisation in matplotlib. In the interest of brevity (i.e., not having to check parametric assumptions), I'll be using non-parametric tests, but if you were doing this properly (not being lazy!) you would need to complete all of these checks and consider the use of parametric tests.

Analysing reddit data: cleaning and describing the data

Wed, 02 Dec 2015 00:00:00 +0000

Part of the series

Analysing Reddit Data

1. Analysing reddit data: setting up the environment

2. Analysing reddit data: extracting the data

3. Analysing reddit data: cleaning and describing the data

4. Analysing reddit data: data analysis

Over the past two weeks (here and here) we have been discussing how to use JSON-encoded data from reddit. So far we have set up our environment and extracted the top 1,000 posts of all time from the subreddit /r/relationships into a pandas Dataframe. This week, we will work on cleaning the data, extracting further data from our existing variables and describing these variables. We'll end this series next week by doing some basic inferential analyses.

Analysing reddit data: extracting the data

Wed, 25 Nov 2015 00:00:00 +0000

Part of the series

Analysing Reddit Data

1. Analysing reddit data: setting up the environment

2. Analysing reddit data: extracting the data

3. Analysing reddit data: cleaning and describing the data

4. Analysing reddit data: data analysis

In last week's post, we covered the basics of setting up our environment so we can extract data from reddit. Now it's time to start on the meat of this topic. This week I will show you how to use the reddit public API to retrieve JSON-encoded data from the subreddit /r/relationships, although this technique will translate to both the reddit mainpage and other subreddits. As I mentioned last week, this is aimed at people who are completely new to working with JSON data, so we will go through everything step-by-step.

Analysing reddit data: setting up the environment

Wed, 18 Nov 2015 00:00:00 +0000

Part of the series

Analysing Reddit Data

1. Analysing reddit data: setting up the environment

2. Analysing reddit data: extracting the data

3. Analysing reddit data: cleaning and describing the data

4. Analysing reddit data: data analysis

Early in my career (before I discovered all I wanted to do was work with data) I thought I wanted to be a relationships psychologist. I actually wrote my Ph.D. thesis on hurtful events in relationships, and my Honours thesis on romantic jealousy, so you get the point! I still have a bit of a fascination with people's relationship problems, so a guilty pleasure of mine is reading the subreddit /r/relationships. Given how much time I spend on this subreddit, it seemed like a good place for a first attempt at extracting JSON-encoded data from the web.