I actually did two surveys this week with the students this week, both on Socrative.
For the first survey, I simply asked students via Socrative, who did most of the domestic work when they were a child (mostly mother or mostly father – full range of possible responses are in the results below), with ‘domestic work’ broken down into tasks such as cleaning, laundry, DIY etc…
For the second Survey, I got students to write down possible survey questions on post it notes, then I selected 7 of them to make a brief questionnaire which they then used as a basis for interviewing three couples about who did the housework.
Selected results from the initial student survey on parents’ housework
These results were based on students’ memory!
Selected results from the second survey
based on student interviews with couples
Discussion of the validity of the results…..
These two surveys on the domestic division of labour (and other things) provided a useful way into a discussion of the strengths and limitations of social surveys more generally….we touched on the following, among other things:
memory may limit validity in survey one
lack of possible options limits validity in survey two, also serves as an illustration of the imposition problem.
asking couples should act as a check on validity, because men can’t exaggerate if they are with their partner.
there are a few ethical problems with the ‘him’ and ‘her’ categories, which could be improved upon.
Postcript – on using student surveys to teach A-level sociology
All in all this is a great activity to do with students. It brings the research up to date, it gets them thinking about questionnaire design and, if you time it right, it even gets them out of the class room for half an hour, so you can just put yer feet up and chillax!
If you want to use the same surveys the links, which will allow you to modify as you see fit, are here:
Quiz one – https://b.socrative.com/teacher/#import-quiz/16728393
Quiz two – https://b.socrative.com/teacher/#import-quiz/33508597
A Likert* scale is a multiple-indicator or multiple-item measure of a set of attitudes relating to a particular area. The goal of a Likert scale is to measure intensity of feelings about the area in question.
A Likert scale about Likert scales!
In its most common format, the Likert scale consists of a statement (e.g. ‘I love Likert scales’) and then a range of ‘strength of feeling’ options which respondents choose from – in the above example, there are five such options ranging from strongly agree to strongly disagree.
Each respondents reply on each item is scored, typically with a high score (5 in the above example) being given for positive feelings and a low score (1 in the above example) for negative feelings.
Once all respondents have completed the questionnaire, the scores from all responses are aggregated to give an overall score, or ‘strength of feeling’ about the issue being measured.
Some examples of sociological research using Likert scales:
The World Values Survey is my favourite example – they use a simple four point scale to measure happiness. The poll below gives you the exact wording used in the survey…
The results on the web site (and below) show you the percentages who answer in each category, but I believe that the researchers also give scores to each response (4 to 1) and then do the same for similar questions, combine the scores and eventually come up with a happiness rating for a country out of 10. I think the USA scores around 7.2 or something like that, it might be more! Look it up if you’re interested….
Important points to remember about Likert scales
The items must be statements, not questions.
The items must all relate to the same object being measured (e.g. happiness, strength of religious belief)
The items that make up the scale should be interrelated so as to ensure internal reliability is strong.
*The Likert Scale is named after Rensis Likert, who developed the method.
Social Surveys are one of the most common methods for routinely collecting data in sociology and the social sciences more generally. There are lots of examples of where we use social surveys throughout the families and households module in the A level sociology syllabus – so what do they tell us about family life in modern Britain, and what are their strengths and limitations….?
This information should be useful for both families and households and for exploring the strengths and limitations of social surveys for research methods…
Attitudes to marriage surveys
Headline Fact – in 2016, only 37% of the UK population believe people should be married before they have children.
For the first time since NatCen started asking whether people who want to have children ought to be married, the proportion who disagree (35%) is almost the same as those who agree (37%).
Back in 1989, seven people in ten (70%) felt that people should be married if they want to have children, compared with less two in ten (17%) who disagreed.
It’s actually worth noting how quickly attitudes have changed since the previous survey in 2012, as demonstrated in the info graphic below – in 2016 it’s now down to 37%
What are the strengths of this survey (focussing on this one question)?
I’m tempted to say the validity is probably quite good, as this isn’t a particularly sensitive topic, and the focus of the question is the ‘generalised other’, so there should be no social desirability.
It’s very useful for making comparisons over time – given that the same question has been asked in pretty much the same way for quite a few years now…
Representativeness seems to be OK – NatCen sampled a range of ages, and people with different political views, so we can compare all that too – no surprises here btw – the old and the conservatives are more likely to be in favour of marriage.
What are the limitations of this survey?
As with all surveys, there’s no indication of why belief in marriage is in decline, no depth or insight.
The question above is so generalised, it might give us a false impression of how liberal people are. I wonder how much the results would change if you made the questions more personal – would you rather your own son/ daughter should be married before they had children? Or just different – ‘all other things being equal, it’s better for children to be brought up by married parents, rather than by non-married-parents’ – and then likehert scale it. Of course that question itself is maybe just a little leading….
Headline ‘fact’ – women still do 60% more housework than men (based on ONS data from 2014-15)
Women put in more than double the proportion of unpaid work when it comes to cooking, childcare and housework and on average men do 16 hours a week of such unpaid work compared to the 26 hours of unpaid work done by women a week.
The only area where men put in more unpaid work hours than women is in the provision of transport – this includes driving themselves and others around, as well as commuting to work.
This data is derived from the The UK Time Diary Study (2014-15) – which used a combination of time-use surveys and interviews to collect data from around 9000 people in 4000 households.
It’s worth noting that even though the respondents were merely filling in a few pages worth of diary, this document contains over 200 pages of technical details, mainly advice on how researchers are supposed to code responses.
What are the strengths of this survey?
The usual ease of comparison. You can clearly see the differences in hours between men and women – NB the survey also shows differences by age and social class, but I haven’t included that here (to keep things brief).
It’s a relatively simply topic, so there’s unlikely to be any validity errors due to interpretation on the part of people completing the surveys: it’s obvious what ‘washing clothes’ means for example.
This seems to suggest the continued relevance of Feminism to helping us understand and combat gender inequality in the private sphere.
What are the limitations of this data?
click on the above link and you’ll find that there is only a 50% response rate…. which makes the representativeness of this data questionable. If we take into account social desirability, then surely those couples with more equal housework patterns will more likely to return then, and also the busier the couple, the less likely they are to do the surveys. NO, really not convinced about the representativeness here!
this research tells us nothing about why these inequalities exist – to what extent is this situation freely chosen, and to what extent is it down to an ‘oppressive socialisation into traditional gender norms’ or just straightforward coercion?
given all of the coding involved, I’m not even convinced that this is really that practically advantageous…. overall this research seems to have taken quite a long time, which is a problem given the first criticism above!
Surveys on Children’s Media Usage
Headline Fact: 5 – 15 year olds spend an average of 38 hours a week either watching TV, online or gaming.
It’s also worth noting that for the first time, in 2016, children aged 5-15 say they spend more time online than they do watching television on a TV set.
It makes comparisons over time easy, as the same questions are asked over a number of different years.
Other than that, I think there are more problems!
Limitations of this Survey
There are no details of how the sample was achieved in the methodology – so I can’t comment on the representativeness.
These are just estimations from the children and parents – this data may have been misrepresented. Children especially might exaggerate their media usage when alone, but downplay it if a parent is present.
I’m especially suspicious of the data for the 3-7 year olds, given that this comes from the parent, not the child… there’s a strong likelihood of social desirability leading to under-reporting… good parents don’t let their kids spend too much time online after all!
Further examples of surveys on the family
If you like this sort of thing, you might also want to explore these surveys…