The strengths and limitations of covert participant observation

Covert Observation may be the only way you can gain access to deviant groups but there are SEVERAL limitations too…

Covert participant observation or ethnography is where the researcher does not reveal that he is actually a researcher.

There are different degrees to which ethnographic research may be covert – fully covert research is where every member of the group being studied believes the researcher to be ‘one of them’ and no one has any idea that the researcher is actually a researcher conducting research.

However, many ‘covert’ studies are actually only partially covert – in some studies researchers may reveal themselves to some participants but not others: Ditton (1977) had to this during her research on ‘fiddling’ in a bakery – she kept making frequent visits to the toilet in order to get off the bakery-line and take field notes about recent, interesting conversations. Some participants became concerned about her and so she had to ‘out’ herself to those people (but not others) so as to maintain her position there.

Examples of covert participation

  • Lloyd’s (2012) research while employed in a call centre in Middlesborough
  • Pearson’s (2009) research study on football hooligans
  • Matley’s (2006) research on a sex fantasy phone line
  • The BBC (2003) documentary ‘The Secret Policeman’ – investigating police racism. This is journalistic rather than sociological, but just so interesting.
  • Macintyre’s (1999) BBC documentary on football hooligans – again,  journalistic rather than sociological, but it does tie in nicely with Pearson’s research.
  • Patrick’s (1973) study on a violent Glasgow gang
  • Humphries (the one and only): Tea Room Trade.

Advantages of covert participant observation

  • Gaining access, especially to closed groups, is much easier because the researcher does not have to seek permission.
  • Reactivity is not a problem – if respondents are not aware research is taking place, they are less likely to act differently.

Disadvantages of covert participant observation

  • The problem of taking field notes – it is almost impossible to take notes as you go when in a covert role. In his study of football hooligans, Pearson had to take notes as soon after the matches as possible, but admits that much information was probably forgotten.
  • You can’t use other methods – if you’re in a covert role, you have to act as the natives do without raising suspicion, and you can hardly whip our your social survey or start doing probing-interviews, because that’s not normal. (unless you’re researching social researchers who spend their lives researching each other).
  • Stress – the covert researcher is under constant pressure due to having to ‘maintain a front’ (frontstage, if you like) and on top of this has to then record data back-stage – it’s like working two jobs. Add to this the worry of having your cover blown, and the fact that if this happens, the entire project may be down the drain, and that’s a lot of stress.
  • Ethical problems – Covert research does not allow for the participants to give informed consent, because it involves deception. There is also the issue of privacy being violated, and the fact that some researchers may have to engage in criminal acts in order to not blow their cover, as in the case of Pearson’s research with football hooligans.

SignPosting and Related Posts:

Covert Participant Observation is one of the main methods taught as part of the social research methods module within A-level sociology.

You might also like this post on participant observation more generally: Participant Observation in Social Research

Please click here to return to the homepage – ReviseSociology.com

Sources:

Bryman (2016) Social Research Methods)

Please click here to return to the homepage – ReviseSociology.com

Education in the UK – Key Facts and Stats

Official Statistics on schools, teachers and educational achievement provided by the United Kingdom government provide an overview of the education system. They are useful for providing an ‘introduction to the state of education in the U.K’, before embarking on the core content of any sociology of education course and providing a basis for comparing the U.K. education system to the education systems of other countries, which would be relevant to the module on global development.

I will also provide a brief discussion of the validity and representativeness of the official statistics below, tying this into research methods.

I only deal with state-schools in this post, I’ll do a separate post in future on private, or independent schools in comparison to state schools.

Also, the post below deals primarily with England and Wales, I will add in details for Wales and Scotland when I can.

Education and Training Statistics UK 2020-21

Government spending on Education 2021-2

The government spent a total of £94.9 billion on education in 2020-21, equivalent to 4.5% of the nation’s Gross Domestic Product (GDP).

Education and Training Statistics UK 2020-21

For 2020-21 expenditure per education sector broke down as follows:

  • Primary education expenditure – £27.3 billion
  • Secondary education expenditure – £40.0 billion
  • Tertiary education expenditure – £4.9 billion

Spending Per Pupil was £6500 in 2019-2020

The above chart, from the Institute for Fiscal Studies shows us education spending in real terms at 2019-2020 places. We can see that in real terms expenditure per pupil has decreased slightly since 2010, when New Labour left office and the Tories came to power.

There are 32, 163 schools in the U.K.

Education and Training Statistics UK 2020-21
  • There are almost 21000 primary schools
  • There are almost 4100 secondary schools

This means primary schools are lot smaller in scale in that each of them has, on average, fewer pupils in them, and should be more ‘locally based’ for most parents.

Secondary schools are a lot larger, will have many more pupils in them, have more of an ‘education factory’ feel to them and be more widely dispersed, meaning children will have to travel further to them.

This is despite the fact that there are more secondary school aged pupils compared to primary school aged pupils.

There were 10.5 million school pupils in England and Wales in 2020-2021

Education and Training Statistics UK 2020-21
  • There were 5.5 million secondary school pupils
  • There were 4.1 million primary aged pupils
  • This reflects recent demographic trends in the United Kingdom – a baby boom which started in the mid 2000s has seen an increase of 400 000 pupils in the school system as a whole (primary and secondary).

There were 11 600 pupils in Pupil Referral Units in 2021

The number of pupils in PRUs fell from over 15000 in 2015/16 to just just 11 000 by 2020/21

A total of 12.6% of pupils have Special Education Needs in 2021-2022

And four percent of these have a formal statement.

SEN Statistics, gov UK 2022

There has been a slight increase in the number of Special Education Needs pupils since 2015/ 16 – a 1% increase in all SEN pupils and a 1.2% increase in SEN pupils with statements.

I’ve left the following historical data in place following a recent update of this post (updated October 2022) as I think it demonstrates how such statistics in particular are socially constructed…

Between 2010 to 2015 the number of pupils with special educational needs fell from 21% to 15%

NB – if you read this in conjunction with the ‘types of school chart’ above, then it suggests that special educational needs (SEN) students are becoming increasingly segregated into special schools and/ or pupil referral units, rather than being dealt with in mainstream secondary schools.

You might also want to think about the extent to which ‘Special Educational Needs’ and ‘Special Educational Needs with statements’ are socially constructed.

Looking back at 2007, 20% of pupils were officially characterised as SEN, but by 2021 this had fallen to 12.6%.

According to labelling theory this is more likely to be because the formal criteria and processes according to which pupils are given the SEN label have changed over the past 15 years, rather than any underlying changes in the actual number of pupils with Special Educational needs.

At the end of 2020 the proportion of 16-18 year olds in education and work-based learning was 81.2%

Education and Training Statistics

This proportion has been stable (around the 80% mark) since at least 2015.

  • At age 17 the rate was 90.5%.
  • At age 18 it was 62.3% (almost 30% are in work with just under 10% being classified as NEET )
  • Overall only 6.4% of 16-18 year olds are classified as NEET (Not in Employment, Education or Training.

11% of 16-24 year olds classify as NEET

Young People Not in Education, Employment or Training.

NEET stands for ‘Not in Education, Employment or Training’ and the government keeps records of the proportion of 16-14 year olds which fit into this category.

The medium term trend in NEETs is that the proportion has fallen from 16% of 16-24 year olds in 2013 down to 11% in 2017.

The NEET figure has been relatively stable for the last five years, holding at around 11% up until today in 2022.

There were 2.4 million students in UK Higher Education Institutions in 2019-2020

Higher Education Facts and Figures

The number of full time equivalent students studying their first degrees or post graduate degrees has been increasing steadily over the past few years.

Around 1.9 million students are studying undergraduate degrees or equivalent while 0.5 million are studying towards a Postgraduate degree.

The vast majority of students studying towards their first degree are British, almost 80% in fact, but around 40% of students studying PostGraduate degrees in UK institutions are from abroad, and most of those from outside the UK!

There were 465000 Teachers (FTE) in the UK in 2021/22

  • There were 465 000 Full Time Equivalent (FTE) teachers employed in England and Wales in 2021/22.
  • There were 503 000 Full Time Equivalent support staff
  • The total FTE number of staff employed in schools in 2021/22 was 968 000.

30% of teachers drop out after 5 years of qualifying

  • 12.5% of teachers drop out after just one year of qualifying
  • Just over 30% drop out within five years.

How useful are these education statistics?

Such statistics are a useful starting point if we wish to make cross-national comparisons between the U.K. education system and the rest of the world, which would be useful for students of global development, given that education plays a key role in development. Indeed if we wish to compare the relationship between education and development in several countries, statistical rather than qualitative comparisons may be the only way of doing so.

From an arrogant, modernisation theory perspective, these statistics provide an indication of the level of investment required in terms of expenditure and teachers, and the types of outcome that less developed countries should be aiming for.

Most of the education statistics above count as ‘hard statistics’, i.e. there’s little room for disagreement over the ‘social facts’ which they show – for example, it’s hard to argue with the stats on ‘number of schools’ and ‘number of qualified teachers’.

However, others are much softer, and have more validity problems, and can be criticised for being social constructions rather than reflecting underlying reality: the statistics on special educational needs clearly come under this category – there is simply no way the underlying numbers of students with ‘SEN’ have decline from 21 to 15% in 5 years while the number of certificated SEN kids have increased – what’s really happened is that the number of kids which schools categorise as having Special Education Needs has decreased in the last 5 years, probably because the Tory’s cut previously existing funding for this category of student in 2010 (ish).

Signposting and Related Posts

As mentioned above this is introductory material for the education topic. For more posts covering theories of education, education policies and educational inequalities by class, gender and ethnicity, please see my sociology of education page.

Please click here to return to the homepage – ReviseSociology.com

Links to statistics on education in the United Kingdom:

Most of the statistical sets below are updated yearly, or more frequently.

Education and Training Statistics for the U.K. – published by the department for education. In this source you’ll find data on the number of schools, teachers, and teacher-pupil ratios as well as basic educational achievement data by Free School Meals, gender and ethnicity. Published annually in November.

Schools, Pupils and their Characteristicsincludes data on pupils in England by PRU, FSM and Ethnicity status.

School Workforce in England – covers teacher numbers and pupil-teacher ratios in primary and secondary schools in England and Wales. The latest figures from November 2021.

Special Education Needs in England – details of children with special education needs, by type of need, and broken down by school type and gender (statistics derived from the ‘schools census’).

Participation in Education, Training and Employment by 16-18 year olds in England: End 2015 – produced by the DFS focusing on 16-18 education and training.

Young People Not in Education or Trainingpublished in August 2022.

The Higher Education Statistics Agency – or HESA for short – collects data on university figures and publishes them online in a very accessible way!

The Institute for Fiscal Studies – section on trends in government expenditure on education

The Association of Colleges produces a useful document of infographics focusing on colleges – ‘Key Further Education Statistics’

Some (Relatively) Recent Examples of Participant Observation Studies

Participant observation is one the main research methods on the A level sociology syllabus, but many of the examples in the main text books are painfully out of date.  This post provides some more recent examples of research studies which employed participant observation as their main research method.

Covert Participant Observation

Pearson’s (2009) covert participant observation study of Blackpool Football Club’s supporters

Pearson carried out covert participant observation of supporters of Blackpool Football Club between 1995 and 1998. He was known to other supporters as a student pursuing a degree in law, but his status as an academic researcher was unknown to them. His approach was to meet up with them in the pub before a match or sometimes on entering the stadium, and to meet up with them afterwards for a drink. He attended seventy-eight matches but notes that because he did not live in the area, he was unable to observe the supporters outside of a football context.

He chose Blackpool F.C. because it was close to Lancaster, where he was a student, and because of its reputation as having problems with football hooliganism. He seems to have been able to gradually insinuate himself into the supporters’ world by being recognised as a regular fan. Pearson played up his knowledge of the game and the club and was able to integrate himself into their world.

Dr Geoff Pearson – only committed ‘minor’ offences while doing covert research

Pearson says of his research…’ whilst it was possible to avoid committing some individual offences, a refusal to commit crimes on a regular basis would have aroused suspicions and reduced research opportunities. As a result I committed ‘minor’ offences (which I tentatively defined as those would not cause direct physical harm to a research subject). My strategy was to commit only the offences which the majority of the research subjects were committing and that I considered necessary to carry out the research. Furthermore, whilst I would commit lesser offences with regularity, I would, if possible, avoid more serious ones.’ (Pearson, 2009).

You can read an interview with Dr Geoff Pearson here.

Pearson’s research is a good example of covert research in which Pearson participated fully with the activities of the group…he was a ‘covert full member’ of the group he was observing.  

Overt Participant Observation

Khan’s (2011, 2014) ethnography of an elite high school in the United States

The majority of ethnographic work seems to have been carried out with (on?) the poor and the marginalised, Khan’s work provides us with a rare ethnographic study of an elite institution.

Khan says: ‘ethnography is a method wherein the scholar embeds himself in the relations under study, spending long periods of time with research subjects. For me, it meant getting a job at St. Paul’s School… I moved into an apartment on campus, and… observed the daily life of the school. After my years at St. Paul’s I returned many times, and I sought out alumni to interview and discuss some of the things I’d learned (Khan 2014).

Privilege: The Making of an Adolescent Elite at St Paul’s School – link to Amazon. The first few reviews summarise aspects of the book!

Similarly to Pearson, Khan is also a full member of the group which he is observing, it’s just that his group knows he is doing research.

In contrast to Pearson’s research, this ethnography by Khan illustrates one of the main advantages overt participant observation has over covert: you can carry on collecting data from the respondents afterwards!

Mears’s (2011) ethnography of the world of the fashion model

Ashley Mears (NB this may have been before she started her formal research!)

‘Two and a half years would be spend in participant observation, or more like ‘observant participation’ (a term borrowed from Wacquant 2004) working for both agencies in the full range of modelling work, including five Fashion Weeks, hundreds of castings, and dozens of jobs in every type of modelling work – catwalk shows, magazine shoots in studios and outdoors…. I sat besides bookers at their table in the office drank with them at their favourite pubs, and hung out with them backstage at fashion shows. As I was nearing the end of the participant observation phase… and withdrawing from modelling work, I formally interviewed a sample of bookers, managers and accountants’ (Mears, 2013).

Mears’s ethnography is reviewed in this London School of Economics book review post

In contrast to Khan’s research, Mears explicitly puts the observation before the participation, which suggests she is less immersed in the day to day life of her group than Kahn was.

Sampson’s (2013) ethnographic research on international seafarers

In April 1999, Sampson boarded her first cargo ship. ‘Contrary to my fears, the crew of Swedish and Filipino seafarers welcomed me into their lives and for forty-two days I lived and worked alongside them, painting the ship with them, venturing ashore to Seamen’s bars with them, laughing with them, even dancing and singing with them’. (2013)

Sampson’s study actually won Thinking Allowed’s first ethnography award in 2014 – A summary of the research can be found at the end of the show here – Thinking Allowed ethnography awards 2014.

This final example is what Bryman refers to as a ‘participating’ observer’ rather than a ‘full member’ – Sampson is working for the shipping company with the men on a very temporary basis.

The above four examples of participant observation studies are all taken from Bryman’s (2016) research methods book. Bryman ranges several studies (23 in total) on a scale ranging from ‘full member’ through to ‘partially participating observer’ down to ‘non-participating observer with interaction’.

Students might find it interesting to note that the well known study ‘Gang Leader for a Day’ (Venkatesh, 2008) is in Bryman’s ‘minimally participating observer’ category, 17th out of 23rd on the above scale, which makes it closer to a non-participant study! Actually I’ve read it, and I can see his point.

Anna Lora-Wainwright (2018) Resigned Activism – Living with Pollution in Rural China

Lora-Wainwright spent from 2009-2013 studying how people in rural China cope when they know severe pollution is having a severely detrimental effect on their health.

NB – this isn’t ‘ordinary pollution’ she’s looking at – she studied three villages in total, all of which are coping with the effects of large-scale industrial pollution because of the heavy manufacturing or waste disposal that occurs in those areas. All of these villages have well over the national average of cancer deaths reported, and it’s obvious the pollution is the problem.

One village was dealing with phosphorus pollution, another Zinc and Lead pollution and the third the pollution from electronic waste. The later village has global notoriety – Guiyu is well known as the world’s largest e waste site.

Lora-Wainwright focused on how people responded when they knew they were being subjected to a significant cancer risk from pollution – how they organised and protested, but also how they just coped on a day to day basis -living with things such as polluted water that’s going to give you cancer if you drink it.

She also focused on how this all ties in with the wider Chinese government’s industrialization agenda and the fact that the government would rather keep reports about such pollution quiet.

The book is currently under revision, but you can listen to a podcast which summarises the findings here.

Sources

Bryman, Alan (2016) Social Research Methods, Oxford University Press

Please click here to return to the homepage – ReviseSociology.com

Evidence of Right Wing Media Bias

Is there a right-wing bias in the British media? Here I explore some of the sociological evidence which suggests that there is a right wing bias in the media and point out some of the limitations of this evidence.

In a recent (May 2017) interview with the Radio Times, David Dimbleby pointed out that Jeremy Corbyn has been treated unfairly by the U.K. Media, but that didn’t appear to surprise him because he believes we have a ‘right wing’ press.

But is David Dimbleby right about the media being ‘to the right’? In this post I explore some of the available evidence to see how far it supports this view.

NB – I am aware that how you answer this question depends on how you define left and right, and that not only are there different dimensions to left and right (YES I have come across the political compass!), but that the meanings of left and right shift over time, so they are relative concepts.

Having said that, we have to start somewhere – so I broadly define ‘right wing’ as neoliberal – pro-privatisation of public services, deregulation and lowering taxation, an emphasis on economic growth rather than social progress, and a current commitment to austerity. I also include within my broad definition of ‘right wing’ anti-immigration sentiments (sorry, I know it’s vague!). Left wing I define as against further privatisation of public services (more to the left is in favour of re-nationalisation), an enhanced role of the state in regulating especially big business, and a belief in higher levels of taxation of especially the wealthy (those earning over £50K a year for example). Also included within a broadly leftist perspective is a commitment to end austerity and a commitment to internationalism – the free movement of people across boarders and so a much more relaxed attitude to migration than the right.

NB – That was all just off the top of my head, I’ll write something more articulate when I get around to it!

Something I find very interesting is that the first piece of evidence below gets around the whole tricky issue of operationalizing right and left wing… just by asking people ‘do you think the media is right or left wing’? This raises all sorts of sociological questions about objectivity and subjectivity and categories. From a teaching perspective I’m currently thinking this ‘measuring political attitudes’ topic could be the perfect one for explaining the difference between positivist and phenomenological approaches to social research.

Anyway – on to the point of this post…

Four pieces of evidence of right wing bias in the media

The general public certainly seem to feel that British newspapers have a right-wing bias, as the results of this March 2017 YouGov poll demonstrate:

right wing bias newspapers UK.png

The two most popular newspapers in Britain are the Daily Mail and the Sun (a joint readership of 10 million) and these are two of the most ‘right wing’ according to public opinion, which again suggests that according to people’s ‘gut feelings’ we do, indeed have a right wing press.

However, there are limitations with this evidence – it is only based on the subjective feelings of people – just because people feel a paper has a left or right wing bias, doesn’t mean that the paper actually has a left or right bias.

From a positivist point of view, in order to answer the question of whether there actually IS a right wing bias in the press, what we need is some more objective data, and in order to get that we need to find some content analysis of media sources which pin down, or operationalise more precisely what they actually mean by left and right wing views…..the rest of the sources below do just this, by focusing on specific aspects of right, or left wing thought.

A 2016 London School of Economic Report: Journalistic Representations of Jeremy Corbyn in the British Press found that Jeremy Corbyn was represented unfairly in the media before he was elected party leader.

The research cites the following examples of unfair representation:

  • through a process of vilification that went well beyond the normal limits
  • being denied his own voice in the reporting
  • sources that were anti-Corbyn tended to outweigh those that support him
  • He systematically  treated  with  scorn  and  ridicule  in  both  the broadsheet  and  tabloid  press  in  a way  that  no  other  political  leader  is  or  has
  • The press repeatedly  associated  Corbyn with  terrorism  and positioned him as a friend of the enemies of the UK.

Given that Jeremy Corbyn’s views are much more left wing than most labour MPs, evidenced by the fact that JC is one of the most outspoken critics of right wing neoliberal austerity policies, his vilification in the mainstream media could suggest a right wing bias: the very fact that he is generally talked about critically, rather than being allowed to express his views without distortion suggests an attempt to prevent left-wing political view points coming to public attention, and if they do come to public attention, an attempt to dismiss them as silly.

HOWEVER, a fundamental limitation with this piece of research evidence is its lack of representativeness of coverage of people with left wing views – it only focuses on Jeremy Corbyn – it might just be the case that during 2015 there were other people with left wing views who were being taken more seriously, so the vilification of Corbyn might have nothing to do with his left-wing views, it might be purely personal. This is unlikely, I know, but we don’t know this from the above research.

Neoliberalism, Austerity and the Mainstream Media – a 2015 report by the university of Sheffield looked at how over 1000 news articles about the impact of social policies. The research specifically looked at whether news articles had a neoliberal framework – i.e. did they discuss things like austerity purely in terms of economics (‘squeezing public finances’) or did they widen their discussion to talk about the broader human impact (family breakdowns, illness and death for example)

If an article limited itself to how policies would impact people’s finances, or the wider economy, then it was classified as a ‘neoliberal frame’, if it focused on the impacts on family, education, health or other non-economic impacts on individuals, it was coded as a non-neoliberal frame.

To my mind this is much stronger evidence of a ‘right wing’ bias in the media than the previous two pieces – at least if we accept the operationalization of ‘neoliberal framing’ as indicating a ‘right wing’ point of view.

However, a problem with the above research is that the category ‘neoliberal frame’ is quite broad, and precisely what statements come within the category is open to differential interpretation by researchers.

Also – exploring neoliberal framing is a very general level of content analysis – for more valid evidence of a ‘right wing’ bias you would have to look at how the media treated specific neoliberal policies such as privatisation, deregulation, lowering taxation, or the issue of immigration…

A recent 2016 Report on the United Kingdom by the European Commission against Racism and Intolerance noted that:

“Hate speech in some traditional media, particularly tabloid newspapers, continues to be a problem, with biased or ill-founded information disseminated about vulnerable groups, which may contribute to perpetuating stereotypes.

It singled out Katie Hopkins’ article in The Sun, published in April 2015, as an example of how bad things can get – the article was entitled “Rescue boats? I’d use gunships to stop migrants”, in which Katie Hopkins likened migrants to “cockroaches”, “feral humans” and that gunboats should be dispatched to prevent further arrivals.

While the above does suggest a clear right wing bias in The Sun, case studies are not representative, so we’d need something more quantitative to see how widespread such a tone of reporting is.

So that’s four pieces of evidence, based on systematic research of several sources (NB the last one did look at more than one article!) which suggest a right wing bias in media content, however, they all have there limitations, so I’ll leave it to you to decide whether there’s sufficient evidence here to conclude that we really do have a right-wing media here in the U.K.

Further pieces of evidence of right wing media bias

Jeremy Corbyn being accused of making a U-turn on a promise to abolish student debt, when he didn’t actually promise to abolish student debt.

According to Channel 4’s Fact Check

In the run-up to the general election, Jeremy Corbyn made a comment about student debt. Speaking to the NME about the issue, he said: “I will deal with it.”

At the time, this was not widely picked up on by the national media. But – where it was reported – most papers accurately reflected that Corbyn had not explicitly promised to write off all debts. For instance, the Daily Mail said the Labour leader had pledged to “reduce or even write off” student debt.

But then (on Sunday (23rd July 2017) Corbyn was quizzed about this remark during a BBC interview.

Presenter Andrew Marr put it to him: “If you are a young voter and you heard those words: ‘I will deal with it’, you might have thought Jeremy Corbyn is going to relieve me of my debt.”

Corbyn was forced to defend his position, saying: “We never said we would completely abolish it.”

For some, this constituted a U-turn.

The Mail said: “Labour has backtracked on its promise to write off £100 billion of student debt.” The Telegraph said the party had “retracted its pledge to abolish student debt”. And Alan Sugar called Jeremy Corbyn a “cheat” and said he should resign for having “lied”.

So – the above is a great example of how a hostile right-wing editorial team from the BBC, fronted by Andrew Marr, can take a positive vote-winning part of Labour’s education policy, spin it out of context and turn it into a negative, which an even more hostile right-wing press further exaggerate. 

If you know of any more systematic content analysis on this topic, please do share – sharing is caring – which is very much NOT a right wing idea of course!

Related Posts

In this post Craig Murray analyses the political background of senior bureaucrats at the BBC – finding that they range from Blairite to UKIP – in other words, very right wing.

Good Resources for Teaching and Learning Research Methods

Being able to choose appropriate research methods and executing those methods effectively are absolutely essential if we are to collect valid, reliable and representative data, and below I present some links to some of the best resources which enable us to do so. These are mainly relevant to the selection, application and evaluation of research methods within sociology, but might also be of interest to students of other social science related subjects such as psychologists, business studies students, international relations students, and anthropologists. 

I start off below by including some good ‘general resources’ such as text books and general web sites, followed by some links which focus on specific research methods – surveys, experiments, interviews, participant observation and secondary quantitative and qualitative data.

The point of this post is to provide links which take you to sources which are as broad as possible but where this isn’t possible, I provide links to specific examples of studies using certain research methods.

links to my own posts on research methods can be found at my main page on research methods!

This list is very much a work in progress and will be updated in an ongoing manner. 

Good general resources 

Bryman, Alan (2015) Social Research Methods – A great introductory book on research methods organised by the major different types of research method (surveys, interviews, etc.), with supplementary material including PowerPoints and mutli-choice quizzes.

Gilbert, Nigel (2015) Researching Social Life – A classic introductory text book which takes you through the research process step by step, from research design, to data collection and analysis.

Supporting web site for ‘Researching Social Life’ – I’ve set the link to the Sage Journal publication links page, which is probably the most useful of the supporting pages, but if you want something a bit more advanced than A-level then you might like to check out their Quizlet Flash Cards too – definitely first year degree level (or maybe even beyond that)

The British Sociological Association Code of Ethics – A very thorough consideration of what counts as ‘ethical research’ according to the BSA.

Good Resources for Quantitative Data 

Data Science Central – The online resource center for big data practitioners. Big data ‘scientists’ analyse huge data sets to reveal insights into human interactions. The link takes you to ’38 seminal articles about big data’.

YouGov is a great site for finding out results of recent surveys of public opinion on a range of issues. Of special interest at the moment (July 2017 at time of writing this paragraph!) are the election results, which give details of how different ages voted. If you like this sort of thing, you can even sign up to take part in YouGov surveys, which will give you a chance to find out some of the limitations of the survey method, and earn some cash.

The Office for National Statistics – ‘The UK’s largest provider of official statistics – it’s not actually that useful as a ‘search site’ (you’re better off just using Google), but you cant’ not include this!

The Crime Survey for England and Wales (about) – Crime stats are one of the most useful sources for illustrating how statistics are socially constructed – this is a useful Q and A on England and Wale’s massive annual victim survey.

The Crime Survey of England and Wales – The Results… A link to the results of the 2016 crime survey, towards the end is a discussion of methodology.

NB – these research methods resources are not meant as an exhaustive list, nor are they meant as a ‘good sources for A-level students’ list – this is more meant for first year degree students and people with a more general interest in learning about research methods.

As a final note, these are the resources which I have used (in modified form) to write many of the blog posts here on research methods.

Sociology Teaching Resources for Sale

You might be interested in my latest (November 2019) teaching resource pack which contains everything teachers need to deliver 10 hour long ‘introduction to sociology’ lessons.

sociology teaching resourcesIncluded in the bundle is a clearly structured 50 page gapped student work-pack, six PowerPoints* to structure the 10 lessons, 10 detailed lesson plans outlining a range of learning activities you can use with students, a massive list of relevant contemporary resources with links, and numerous lesson activities including introductions, plenaries and links to some Socrative quizzes.

These resources contain all the core sociology knowledge students need for a through introduction sociology, illustrated with numerous up to date contemporary case studies and statistics.

The resources have been designed for A-level sociology and cover the core themes on the AQA’s specification but are suitable for new 16-19 students studying any specification.

You might also like these teaching resources for the sociology of education. They are specifically designed for A-level sociology students and consist of several versions of key concepts definitions (80 concepts in total), gapped summary grids with answers covering the entire sociology of education specification and 7 analysis activities.

If you want to get both of the above resources and receive regular updates of teaching resources then you can subscribe for £9.99 a month. I’ll be producing 10 hour long lessons worth of resources every month throughout 2020 and beyond. The £9.99 subscription means you get the resources for 50% off the usual £19.99 price.

Evaluating the Usefulness of Official Statistics

Official Statistics are numerical data collected by governments and their agencies. This post examines a ranges of official statistics collected by the United Kingdom government and evaluates their usefulness.

Click the image to search 13, 848 official statistics produced by the U.K. government

The aim of this post is to demonstrate one of the main strengths of official statistics – they give us a ‘snap shot’ of life in the U.K. and they enable us to easily identify trends over time.

Of course the validity and thus the usefulness of official statistics data varies enormously between different types of official statistic, and this post also looks at the relative strengths and limitations of these different types of official statistic: some of these statistics are ‘hard statistics’, they are objective, and there is little disagreement over how to measure what is being measured (the number of schools in the U.K. for example), whereas others are ‘softer statistics’ because there is more disagreement over the definitions of the concepts which are being measured (the number of pupils with Special Educational Needs, for example).

If you’re a student working through this, there are two aims accompanied with this post:

  1. Before reading the material below, play this ‘U.K. official statistics matching game’, you can also do it afterwards to check yer knowledge.
  2. After you’ve read through this material, do the ‘U.K. official statistics validity ranking exercise’.

Please click on the images below to explore the data further using the relevant ONS data sets and analysis pages.

Ethnic Identity in the United Kingdom According the U.K. 2011 Census

U.K. Census 2011 data showed us that 86% of people in the United Kingdom identified themselves as ‘white’ in 2011.

How valid are these statistics?

To an extent, ethnic identity is an objective matter – for example, I was kind of ‘born white’ in that both my parents are/ were white, all of my grandparents were white, and all of my great-grandparents were white, so I can’t really claim I belong to any other ethnic group. However, although I ticked ‘white’ box when I did the U.K. Census, this personally means very little to me, whereas to others (probably the kind of people I wouldn’t get along with very well) their ‘whiteness’ is a very important part of their identity, so there’s a whole range of different subjective meanings that go along with whatever ethnic identity box people ticked. Census data tells us nothing about this.

Religion according to the U.K. 2011 Census

In the 2011 Census, 59% of people identified as ‘Christian’ in 2011, the second largest ‘religious group’ was ‘no religion’, which 25% of the U.K. population identified with.

Statistics on religious affiliation may also lack validity – are 59% of people really Christian? And if they really are, then what does this actually mean? Church attendance is significantly lower than 59% of the population, so the ‘Christian’ box covers everything from devout fundamentalists to people that are just covering their bases (‘I’d better tick yes, just in case there is a God, or gods?’)

The British Humanist Society present a nice summary of why statistics on religious belief may lack validity…basically based on the ‘harder’ statistics such as church attendance which show a much lower rate of committed religious practice.

The United Kingdom Employment Rate

The employment rate is the proportion of people aged from 16 to 64 in work.

The lowest employment rate for people was 65.6% in 1983, during the economic downturn of the early 1980s. The employment rates for people, men and women have been generally increasing since early 2012.As of December 2016, the employment rate for all people was 74.6%, the highest since records began in 1971

Critics of the above data point to the existence of an informal or shadow economy in the United Kingdom which is worth an estimated £150 billion a year – people who are working and earning an income, but not declaring it. In reality, the actual paid-employment rate is higher.

Household Income Distribution in the United Kingdom

Household income statistics are broken down into the following three broad categories:

  • original income is income before government intervention (benefits)
  • gross income is income after benefits but before tax
  • disposable income is income after benefits and tax (income tax, National Insurance and council tax).

In the year ending 2016, after cash benefits were taken into account, the richest fifth had an average income that was roughly 6 times the poorest fifth (gross incomes of £87,600 per year compared with £14,800, respectively)

Reasons why household income data may lack validity

While measuring income does appear to be purely objective (you just add and minus the pounds), the income data above may lack validity because some people might not declare some of the income they are earning. Cash in hand work, for example, would not be included in the above statistics, and some money earned via the ‘gig economy’ might not be declared either – how many people actually pay tax on their YouTube revenue for example, or from the goods they sell on Ebay?

The United Kingdom Crime Rate

Below I discuss data from the Crime Survey of England and Wales (CSEW), which is a victim-survey conducted by structured interview with 35 000 households. It seems pointless discussing the crime rate according to police recorded crime because it’s such an obviously invalid measurement of crime (and the police know it), simply because so many crimes go unreported and hence unrecorded by the police.

Latest figures from the Crime Survey for England and Wales (CSEW) show there were an estimated 6.1 million incidents of crime experienced by adults aged 16 and over based on interviews in the survey year ending December 2016.

The green dot shows the figure if we include computer based crimes and online fraud, a new type of crime only recently introduced to the survey (so it wouldn’t be fair to make comparisons over time!) – if we include these the number of incidents of crime experienced jumps up to 11.5 million.

Reasons why even the CSEW might lack validity

Even though its almost certainly more valid than police recorded crime – there are still reasons why the CSEW may not report all crimes – domestic crimes may go under-reported because the perpetrator might be in close proximity to the victim during the survey (it’s a household survey), or people might mis-remember crimes, and there are certain crimes that the CSEW does not ask about – such as whether you’ve been a victim of Corporate Crime.

The U.K. Prison Population


 

 

The average prison population has increased from just over 17,400 in 1900 to just over 85,300 in 2016 (a five-fold increase). Since 2010, the average prison population has again remained relatively stable.

Prison Population Statistics – Probably have Good Validity?

I’ve included this as it’s hard to argue with the validity of prison population stats. Someone is either held in custody or they or not at the time of the population survey (which are done weekly!) – A good example of a truly ‘hard’ statistic! This does of course assume we have open and due process where the law and courts are concerned.

Of course you could argue for the sake of it that they lack validity – what about hidden prisoners, or people under false imprisonment? I’m sure in other countries (North Korea?) – their prison stats are totally invalid, if they keep any!

United Kingdom Population and Migration Data


 

 

Net migration to the U.K. stood at 248 000 in 2016, lower than the previous year, but still historically high compared to the 1980s-1990s.

There are a number of reasons why UK immigration statistics may lack validity

According to this migration statistics methodology document only about 1/30 people are screened (asked detailed questions about whether they are long term migrants or not), on entering the United Kingdom, and only a very small sample of people (around 4000) are subjected to the more detailed International Passenger Survey.

Then of course there is the issue of people who enter Britain legally but lie about their intentions to remain permanently, as well as people who are smuggled in. In short the above statistics are just based on the people the authorities know about, so while I’m one to go all ‘moral panic’ on the issue of immigration, there is sufficient reason to be sceptical about the validity of the official figures!

Ranking Exercise:

You might like to rank the following ‘official statistics’ in terms of validity – which of these statistics is closest to actual reality?

  • Immigration statistics – Net migration in 2016 was 248 000
  • Prison statistics – There are just over 85 000 people in prison
  • Crime statistics – There were around 6 million incidents of crime in 2016
  • The richest 20% of households had an average income of around £85 000 in 2016
  • The U.K. employment rate is 75% in 2016.
  • 59% of the population were Christina in 2011
  • 86% of the population was white in 2011

Related Posts

Official Statistics in Sociology

Education Statistics – 12 things Department for Education data tell us about the state of education in England and Wales today (forthcoming)

Family and Household Statistics – seven interesting statistics about family life in the U.K.

Sources

Please click the pictures above to follow links to sources…

The United Kingdom Census is a survey of every person in the United Kingdom, carried out every 10 years, the last one being in March 2011. It asks a series of ‘basic’ questions about sex, ethnicity, religion and occupation. It is the only survey which is based on a ‘total sample’ of all U.K. households. You might also like this summary – What is a Census?

U.K. Prison Population Statistics – House of Commons Research Briefing

Scientific Quantitative Methodology in Sociology

Positivists prefer to the limit themselves the study of objective ‘social facts’ and use statistical data and the comparative method to find correlations, and multivariate analysis to uncover statistically significant ‘causal’ relationships between variables and thus derive the laws of human behaviour.

This post explores the Positivist approach to social research, defining and explaining all of the above key terms and using some examples from sociology to illustrate them.

Social Facts

The first rule of Positivist methodology is to consider social facts as things which means that the belief systems and customs of the social world should be considered as things in the same way as the objects and events of the natural world.

According to Durkheim, some of the key features of social facts are:

  • they exist over and above individual consciousness
  • they are not chosen by individuals and cannot be changed by will
  • each person is limited (constrained) by social facts

According to Durkheim what effects do social facts make people act in certain ways, in the same way as door limits the means whereby you can enter a room or gravity limits how far you can jump.

Positivists believed that we should only study what can be observed and measured(objective facts), not subjective thoughts and feelings. The role of human consciousness is irrelevant to explaining human behaviour according to Positivists because humans have little or no choice over how they behave.

For a more in-depth account of social facts, have a look at this blog post: What are Social Facts?

Statistical data, Correlation, and Causation

Positivists believed it was possible to classify the social world in an objective way. Using these classifications it was then possible to count sets of observable facts and so produce statistics.

The point of identifying social facts was to look for correlations – a correlation is a tendency for two or more things to be found together, and it may refer to the strength of the relationship between them.

If there is a strong correlation between two ore more types of social phenomena then a positivist sociologist might suspect that one of these phenomena is causing the other to take place. However, this is not necessarily the case and it is important to analyse the data before any conclusion is reach.

Spurious Correlations

Spurious correlations pose a problem for Positivist research. A spurious correlation is when two or more phenomena are found together but have no direct connection to each other: one does not therefor cause the other. For example although more working class people commit crime, this may be because more men are found in the working classes – so the significant relationship might be between gender and crime, not between class and crime.

Multivariate Analysis

Positivists engage in multivariate analysis to overcome the problem of spurious correlations.

Multivariate Analysis involves isolating the effect of a particular independent variable upon a particular dependent variable. This can be done by holding one independent variable constant and changing the other. In the example above this might mean comparing the crime rates of men and women in the working class.

Positivists believe multivariate analysis can establish causal connections between two or more variables and once analysis is checked establish the laws of human behaviour.

Positivism – Establishing the Laws of Human Behaviour

A scientific law is a statement about the relationship between two or more phenomena which is true in all circumstances.

According to Positivists, the laws of human behaviour can be discovered by the collection of objective facts about the world in statistical form and uncovering correlations between them, checked for their significance by multivariate analysis.

Positivism and The Comparative Method

The comparative method involves the use of comparisons between different societies, or different points in time

The purpose of using the comparative method is to establish correlations, and ultimately causal connections, seek laws and test hypotheses.

The comparative method overcomes the following disadvantages of experiments:

  • Moral problems are not as acute
  • The research is less likely to affect the behaviour or those being studied because we are looking at natural settings
  • The comparative method is superior to the experimental method because allows the sociologist to explore large scale social changes and changes over time

However, a fundamental problem with the comparative method is that the data you want may not be available, and you are limited to that data which already exists or which can be collected on a large scale via social surveys.

Related Posts

Positivism and Interpretivism in social research

Social Action Theory – criticises the positivist approach to social research, arguing that human consciousness is too complex to reduce to numbers.

 

 

Experiments in Sociology – Revision Notes

Definitions, key features and the theoretical, practical and ethical strengths and limitations of laboratory and field experiments applied to sociology (and psychology). Also covers key terms related to experiments.

post has been written to help students revising for the research methods aspect of their second year A-level exams.

Experiments – The Basics: Definitions/ Key Features

  • Experiments aim to measure the effect which one or more independent variables have on a dependent variable.
  • The aim is to isolate and measure as precisely as possible the exact effect independent variables have on dependent variables.
  • Experiments typically aim to test a ‘hypothesis’ – a prediction about how one variable will effect another.
  • There are two main types* of experimental method: The Laboratory experiment, the field experiment and the comparative method.
    • Laboratory Experiments take place in an artificial, controlled environment such as a laboratory.
    • Field Experiments – take place in a real world context such as a school or a hospital.

Advantages of Laboratory Experiments

  • Theoretical – The controlled conditions of laboratory experiments allow researchers to isolate variables: you can precisely measure the exact effect of one thing on another.
  • Theoretical – You can establish cause and effect relationships.
  • Theoretical – You can collect ‘objective’ knowledge – about how facts ‘out there’ affect individuals.
  • Theoretical – Good Reliability because it is easy to replicate the exact same conditions.
  • Theoretical – Good Reliability because of the high level of detachment between the researcher and the respondent.
  • Practical – Easy to attract funding because of the prestige of science.
  • Practical – Take place in one setting so researchers can conduct research like any other day-job – no need to chase respondents.
  • Ethical – Most laboratory experiments seek to gain informed consent, often a requirement to get funding.
  • Ethical – Legality – lab experiments rarely ask participants to do anything illegal.
  • Ethical – Findings benefit society – both Milgram and Zimbardo would claim the shocking findings of their research outweigh the harms done to respondents.

Disadvantages of Laboratory Experiments

  • Theoretical – They are reductionist: human behaviour cannot be explained through simple cause and effect relationships (people are not ‘puppets’).
  • Theoretical – Laboratory experiments lack external validity – the artificial environment is so far removed from real-life that the results tell us very little about how respondents would actually act in real life.
  • Theoretical – The Hawthorne Effect may further reduce validity – respondents may act differently just because they know they are part of an experiment.
  • Theoretical – They are small scale and thus unrepresentative.
  • Practical – It is impractical to observe large scale social processes in a laboratory – you cannot get whole towns, let alone countries of people into the small scale setting of a laboratory.
  • Practical – Time – Small samples mean you will need to conduct consecutive experiments on small groups if you want large samples, which will take time
  • Ethical – Deception and lack of informed consent – it is often necessary to deceive subjects as to the true nature of the experiment so that they do not act differently. Links to the Hawthorne Effect.
  • Ethical – Some specific experiments have resulted in harm to respondents – in the Milgram experiment for example.
  • Ethical – Interpretivists may be uncomfortable with the unequal relationships between researcher and respondent – the researcher takes on the role of the expert, who decides what is worth knowing in advance of the experiment.

Advantages of Field Experiments over Laboratory Experiments

  • Theoretical – They generally have better validity than lab experiments because they take place in real life settings
  • Theoretical – Better external validity – because they take place in normally occurring, real-world social settings.
  • Practical – Larger scale settings – you can do field experiments in schools or workplaces, so you can observe large scale social processes, which isn’t possible with laboratory experiments.
  • Practical – a researcher can ‘set up’ a field experiment and let it run for a year, and then come back later.

The relative disadvantages of Field Experiments

  • Theoretical – It is not possible to control variables as closely as with laboratory experiments – because it’s impossible to observe respondents 100% of the time.
  • Theoretical – Reliability is weaker – because it’s more difficult to replicate the exact context of the research again.
  • Theoretical – The Hawthorne Effect (or Experimental Effect) may reduce the validity of results.
  • Practical Problems – access is likely to be more of a problem with lab experiments. Schools and workplaces might be reluctant to allow researchers in.
  • Ethical Problems – As with lab experiments – it is often possible to not inform people that an experiment is taking place in order for them to act naturally, so the issues of deception and lack of informed consent apply here too, as does the issue of harm.

Experiments – Key Terms Summary

Hypothesis – a theory or explanation made on the basis of limited evidence as a starting point for further investigation. A hypothesis will typically take the form of a testable statement about the effect which one or more independent variables will have on the dependent variable.

Dependent Variable – this is the object of the study in the experiment, the variable which will (possibly) be effected by the independent variables.

Independent variables – The variables which are varied in an experiment – the factors which the experimenter changes in order to measure the effect they have on the dependent variable.

Extraneous variables – Variables which are not of interest to the researcher but which may interfere with the results of an experiment

Experimental group – The group under study in the investigation.

Control group – The group which is similar to the study group who are held constant. Following the experiment the experimental group can be compared to the control group to measure the extent of the impact (if any) of the independent variables.

You should also know about natural experiments/ the comparative method –involves comparing two or more societies or groups which are similar in some respects but varied in others, and looking for correlations.  

Signposting

This post has been written to help students revising for the research methods aspect of their second year A-level exams.

These are the more in-depth posts on experiments

Experiments in sociology – an introduction

Laboratory experiments in sociology

Field experiments in sociology

Milgram’s Obedience Experiment – Strengths and Limitations

A laboratory experiment designed to test how obedient people are to authority.

Milgram’s obedience experiment is one of the most useful examples to illustrate the strengths and limitations of laboratory experiments in psychology/ sociology, as well as revealing the punishingly depressing findings that people are remarkably passive in the face of authority…

This post outlines details of the original experiment and two recent, televised repeats by the BBC (2008) and for Darren Brown’s ‘The Heist’ (2014).

danger severe shock: milgram!

The Original Obedience Experiment (1963)

Milgram (1963) was interested in researching how far people would go in obeying an instruction if it involved harming another person. Stanley Milgram was interested in how easily ordinary people could be influenced into committing atrocities for example, Germans in WWII.

The video below is quite long, but you can selectively watch it to get an idea of the procedure (which is outlined below)

Procedure

Volunteers were recruited for a lab experiment investigating “learning” (re: ethics: deception). Participants were 40 males, aged between 20 and 50, whose jobs ranged from unskilled to professional, from the New Haven area. They were paid $4.50 for just turning up.

At the beginning of the experiment they were introduced to another participant, who was actually an associate of the experimenter (Milgram). They drew straws to determine their roles – learner or teacher – although this was fixed and the confederate was always the learner. There was also an “experimenter” dressed in a grey lab coat, played by an actor.

Two rooms in the Yale Interaction Laboratory were used – one for the learner (with an electric chair) and another for the teacher and experimenter with an electric shock generator.

a diagram showing the roles in the milgram experiment
A diagram illustrating the Milgram Experiment

The “learner” was strapped to a chair with electrodes. After he has learned a list of word pairs given him to learn, the “teacher” tests him by naming a word and asking the learner to recall its partner/pair from a list of four possible choices.

The teacher is told to administer an electric shock every time the learner makes a mistake, increasing the level of shock each time. There were 30 switches on the shock generator marked from 15 volts (slight shock) to 450 (danger – severe shock).

The learner gave mainly wrong answers (on purpose) and for each of these the teacher gave him an electric shock. When the teacher refused to administer a shock the experimenter was to give a series of orders / prods to ensure they continued. There were 4 prods and if one was not obeyed then the experimenter read out the next prod, and so on.

  • Prod 1: please continue.
  • Prod 2: the experiment requires you to continue.
  • Prod 3: It is absolutely essential that you continue.
  • Prod 4: you have no other choice but to continue.
a respondent in milgram's obedience experiment.
A respondent administering a shock for a wrong answer

Results

65% (two-thirds) of participants (i.e. teachers) continued to the highest level of 450 volts. All the participants continued to 300 volts.

Milgram did more than one experiment – he carried out 18 variations of his study. All he did was alter the situation (IV) to see how this affected obedience (DV).

Conclusion

Ordinary people are likely to follow orders given by an authority figure, even to the extent of killing an innocent human being. Obedience to authority is ingrained in us all from the way we are brought up.

People tend to obey orders from other people if they recognize their authority as morally right and / or legally based. This response to legitimate authority is learned in a variety of situations, for example in the family, school and workplace.

Despite the many ethical pitfalls of this experiment, some participants still believed the benefits outweighed the costs – below is the view of one participant…“While I was a subject in 1964, though I believed that I was hurting someone, I was totally unaware of why I was doing so. Few people ever realize when they are acting according to their own beliefs and when they are meekly submitting to authority… To permit myself to be drafted with the understanding that I am submitting to authority’s demand to do something very wrong would make me frightened of myself… I am fully prepared to go to jail if I am not granted Conscientious Objector status. Indeed, it is the only course I could take to be faithful to what I believe. My only hope is that members of my board act equally according to their conscience…”

More recent video repeats of the Milgram experiment:

The BBC did a documentary in 2008 in which 12 people were subjected to what seems to be the same experiment, and a similar results found. Vimeo link here.

contemporary version of milgram's obedience experiment.
‘Sorry, that’s the wrong answer, 450 volts’ (giggle)

Darren Brown also did a more recent re-run of the Milgram obedience experiment in order to test people’s responses to authority as part of his 2014 programme ‘The Heist’ – interestingly in this, one participant says they can’t carry on because they’ve heard of the experiment (even though they seem to have started it), while another who hadn’t heard of it comments that they needed more buttons on the shock machine.

Strengths and Limitations of Milgram’s Obedience Experiment

The above experiment illustrates many of the advantages and disadvantages of using laboratory experiments in psychology and sociology.

Some of the obvious advantages include the fact that it’s got excellent reliability, given the similar results gained on the two repeats, and it’s still a useful tool for waking us up to just how quiescent to authority many of us are, challenging theories such as the flight from deference.

It also illustrates many of the limitations of experiments – it is still extremely artificial, not true to real life because authority manifests itself in vastly different ways (as teachers, police and so on, not scientists), and the Hawthorne Effect is very nicely illustrate in the Darren Browne clip above (seriously has not EVERYONE heard of the Milgram experiment by now?!, or is that just my middle class cultural bias?), and then of course, there’s the ethics – Darren Browne actually comments that it took one of the respondents too long to recover from the experiment, so he doesn’t select her for the next stage of ‘The Heist’.

milgram's obedience experiment, a respondent
One of the original respondents showing signs of distress
References

Milgram’s Experiment on Obedience to Authority, which cites Milgram, S. (1974). Obedience to Authority: An Experimental View. New York: Harper and Row. An excellent presentation of Milgram�s work is also found in Brown, R. (1986). Social Forces in Obedience and Rebellion. Social Psychology: The Second Edition. New York: The Free Press.

Signposting

Laboratory Experiments are one of the main methods taught as part of the Research Methods topic within A-level sociology.

You might also like this more general post on the strengths and limitations of laboratory experiments.

Please click here to return to the homepage – ReviseSociology.com

Surveys on Family Life in the UK

Social Surveys are one of the most common methods for routinely collecting data in sociology and the social sciences more generally. There are lots of examples of where we use social surveys throughout the families and households module in the A level sociology syllabus – so what do they tell us about family life in modern Britain, and what are their strengths and limitations….?

This information should be useful for both families and households and for exploring the strengths and limitations of social surveys for research methods

Attitudes to non-traditional families

Findings from British Social Attitudes 37 suggests that the British public is becoming more supportive of non-traditional families.

Headline Fact – in 2018/19 only 12% of the UK population disapproved of people having children while cohabiting, down from 22% in 2006/07.

tables of statistics showing changes in attitudes to non traditional families in the UK 2007-2019.

Disapproval for all types of non-traditional families decreased between 2006/7 and 2018/19.

Further analysis demonstrated this was due to a generational affect. In the previous round of surveys (2006/07) 50% of people born before 1927 disapproved of traditional families. However most of these had died by 2018/19 and so their attitudes did not show up in these later survey results.

Back in 1989, seven people in ten (70%) felt that people should be married if they want to have children, compared with less two in ten (17%) who disagreed.

The number of people who think couples should get married before having children has fallen dramatically in the last 40 years. In 1989 70% of people believed couples should get married before having children. This had fallen to 42% in 2012.

Percentage of the UK population who agree that parents should be married before they have children.

Judging by the low 12% disapproval rate for ‘cohabiting with children’ it seems reasonable to say that even fewer people think couples need to get married before having children in 2023!

What are the strengths of this survey

  • I’m tempted to say the validity is probably quite good, as this isn’t a particularly sensitive topic, and the focus of the questions is the ‘generalised other’, so there should be no social desirability.
  • It’s very useful for making comparisons over time – given that the same questions have been asked in pretty much the same way over different years.
  • Representativeness seems to be OK – NatCen sampled a range of ages, and people with different political views, so we can compare all that too – no surprises here btw – the old and the conservatives are more likely to be in favour of marriage.

What are the limitations of this survey?

The question above is so generalised, it might give us a false impression of how liberal people are. I wonder how much the results would change if you made the questions more personal – would you rather your own son/ daughter should be married before they had children? Or just different – ‘all other things being equal, it’s better for children to be brought up by married parents, rather than by non-married-parents’ – and then likehert scale it. Of course that question itself is maybe just a little leading….

Housework Surveys 

Headline ‘fact’ – women still do 60% more housework than men (based on ONS data from 2014-15)

housework UK

Women carry out an overall average of 60% more unpaid work than men, ONS analysis has shown.

Women put in more than double the proportion of unpaid work when it comes to cooking, childcare and housework and on average men do 16 hours a week of such unpaid work compared to the 26 hours of unpaid work done by women a week.

The only area where men put in more unpaid work hours than women is in the provision of transport – this includes driving themselves and others around, as well as commuting to work.

This data is derived from the The UK Time Diary Study (2014-15) – which used a combination of time-use surveys and interviews to collect data from around 9000 people in 4000 households.

It’s worth noting that even though the respondents were merely filling in a few pages worth of diary, this document contains over 200 pages of technical details, mainly advice on how researchers are supposed to code responses.

What are the strengths of this survey?

  • The usual ease of comparison. You can clearly see the differences in hours between men and women – NB the survey also shows differences by age and social class, but I haven’t included that here (to keep things brief).
  • It’s a relatively simply topic, so there’s unlikely to be any validity errors due to interpretation on the part of people completing the surveys: it’s obvious what ‘washing clothes’ means for example.
  • This seems to suggest the continued relevance of Feminism to helping us understand and combat gender inequality in the private sphere.

What are the limitations of this data? 

  • click on the above link and you’ll find that there is only a 50% response rate…. which makes the representativeness of this data questionable. If we take into account social desirability, then surely those couples with more equal housework patterns will more likely to return then, and also the busier the couple, the less likely they are to do the surveys. NO, really not convinced about the representativeness here!
  • this research tells us nothing about why these inequalities exist – to what extent is this situation freely chosen, and to what extent is it down to an ‘oppressive socialisation into traditional gender norms’ or just straightforward coercion?
  • given all of the coding involved, I’m not even convinced that this is really that practically advantageous…. overall this research seems to have taken quite a long time, which is a problem given the first criticism above!

Surveys on Children’s Media Usage

TikTok, Snapchat and Instagram are the most popular social media apps used by teenagers. Around 40% of teenagers use these three apps.

bar chart showing percentages of children who use social media, UK 2023.

Facebook usage among teens has decreased in recent years.

The data which produced these results comes from three separate tracking studies with a combined sample of over 10 000 children and their parents, data collected between March-November 2022. (OFCOM: Children and Parents: Media Use and Attitude Report).

Strengths of this Survey

  • It makes comparisons over time easy, as the same questions are asked over a number of different years.
  • Other than that, I think there are more problems!

Limitations of this Survey

  • There are no details of how the sample was achieved in the methodology – so I can’t comment on the representativeness.
  • There is so much data here it’s difficult to get an overview. For example there are no longer any easily accessible stats on how much total time children spend with media. The figures are broken down by media type, split into TV, gaming and social media for example.
SIGNPOSTING AND RELATED POSTS.

This material is mainly relevant to the families and households module, usually taught as part of the first year in A-level sociology.