Tag: research methods

The limitations of School Exclusion Statistics

The Department for Education publishes an annual report on exclusions, the latest edition published in August 2018 being ‘Permanent and fixed-period exclusions in England: 2016 to 2017.

The 2018 report shows that the overall rate of permanent exclusions was 0.1 per cent of pupil enrolments in 2016/17. The number of exclusions was 7,720.

exlusion statistics.png

The report also goes into more detail, for example….

  • The vast majority of exclusions were from secondary schools >85% of exclusions.
  • The three main reasons for permanent exclusions (not counting ‘other’) were
    • Persistent disruptive behaviour
    • Physical assault against a pupil
    • Physical assault against an adult.

Certain groups of students are far more likely to be permanently excluded:

  • Free School Meals (FSM) pupils had a permanent exclusion rate four times higher than non-FSM pupils
  • FSM pupils accounted for 40.0% of all permanent exclusions
  • The permanent exclusion rate for boys was over three times higher than that for girls
  • Over half of all permanent exclusions occur in national curriculum year 9 or above. A quarter of all permanent exclusions were for pupils aged 14
  • Black Caribbean pupils had a permanent exclusion rate nearly three times higher than the school population as a whole.
  • Pupils with identified special educational needs (SEN) accounted for around half of all permanent exclusions

The ‘reasons why’ and ‘types of pupil’ data probably hold no surprises, but NB there are quite a few limitations with the above data, and so these stats should be treated with caution!

Limitations of data on permanent exclusions

Validity problems…

According to this Guardian article, the figures do not take into account ‘informal exclusions’ or ‘off-rolling’ – where schools convince parents to withdraw their children without making a formal exclusion order – technically it’s then down to the parents to enrol their child at another institution or home-educate them, but in many cases this doesn’t happen.

According to research conducted by FFT Education Datalab up to 7, 700 students go missing from the school role between year 7 and year 11 when they are  supposed to sit their GCSEs…. Equivalent to a 1.4% drop out rate across from first enrolment at secondary school to GCSEs.

Datalabs took their figures from the annual school census and the DfE’s national pupil database. The cohort’s numbers were traced from year seven, the first year of secondary school, up until taking their GCSEs in 2017.

The entire cohort enrolled in year 7 in state schools in England in 2013 was 550,000 children

However, by time of sitting GCSEs:

  • 8,700 pupils were in alternative provision or pupil referral units,
  • nearly 2,500 had moved to special schools
  • 22,000 had left the state sector (an increase from 20,000 in 2014) Of the 22,000,
    • 3,000 had moved to mainstream private schools
    • Just under 4,000 were enrolled or sat their GCSEs at a variety of other education institutions.
    • 60% of the remaining 15,000 children were likely to have moved away from England, in some case to other parts of the UK such as Wales (used emigration data by age and internal migration data to estimate that around)
    • Leaves between 6,000 to 7,700 former pupils unaccounted for, who appear not to have sat any GCSE or equivalent qualifications or been counted in school data.

Working out the percentages this means that by GCSEs, the following percentages of the original year 7 cohort had been ‘moved on’ to other schools. 

  • 6% or 32, 000 students in all, 10, 00 of which were moved to ‘state funded alternative provision, e.g. Pupil Referral Units.
  • 4%, or 22K left the mainstream state sector altogether (presumably due to exclusion or ‘coerced withdrawal’ (i.e. off rolling), of which
  • 4%, or 7, 700 cannot be found in any educational records!

This Guardian article provides a decent summary of the research.

Further limitations of data on school exclusions

  • There is very little detail on why pupils were excluded, other than the ‘main reason’ formally recorded by the head teacher in all school. There is no information at all about the specific act or the broader context. Labelling theorists might have something to say about this!
  • There is a significant time gap between recording and publication of the data. This data was published in summer 2018 and covers exclusions in the academic year 2016-2017. Given that you might be looking at this in 2019 (data is published annually) and that there is probably a ‘long history’ behind many exclusions (i.e. pupils probably get more than one second chance), this data refers to events that happened 2 or more years ago.

Relevance of this to A-level sociology

This is of obvious relevance to the education module… it might be something of a wake up call that 4% of students leave mainstream secondary education before making it to GCSEs, and than 1.4% seem to end up out of education and not sitting GCSEs!

It’s also a good example of why independent longitudinal studies provide a more valid figure of exclusions (and ‘informal’ exclusions) than the official government statistics on this.

 

I’ll be producing more posts on why students get excluded, and on what happens to them when they do and the consequences for society in coming weeks.

 

This is a topic that interests me, shame it’s not a direct part of the A level sociology education spec!

Advertisements

Methods in Context Questions: A Full Mark Answer from the AQA

An example of a full mark answer to a methods in context question from the AQA.

Methods in Context

Below I provide an example full mark answer to a methods in context question taken from the AQA’s 2016 Specimen A-level sociology paper 7192 (1) and provide some running commentary on this model answer.

NB – I also outline why the AQA has (IMO) miss-marked this exemplar… I don’t think it should get full marks, because IT DOES NOT do what the mark scheme says it should do to get 20/20.

However… it’s still a good answer…

Methods in Context Questions:

Methods in Context questions will ask students to evaluate the strengths and limitations of any of the six main research methods for researching a particular topic within the sociology of education, applying material from the item.

Students often struggle with these questions and so it is useful to have exemplars which demonstrate how to answer them.

Methods in Context

The Question:

Read Item C below and answer the question that follows.

Item C

Investigating the influence of the family on pupils’ education

Families have an important influence on pupils’ education. For example, the family’s income may be able to pay for educational materials and experiences as well as for comfortable conditions in which to study. Similarly, parents’ own education, their child-rearing and socialisation practices, and their speech codes and cultural background can influence children’s’ attitudes to school and their ability to succeed. In all these respects, there are significant class and ethnic differences in family life and they help to explain differences in the educational experiences of different pupils.

One way of studying the influence of the family on pupils’ education is to use structured interviews. These are a good way of gathering basic data quickly. Structured interviews also allow researchers to establish patterns and make comparisons. However, they may be less useful when dealing with sensitive or private issues.

Applying material from Item C and your knowledge of research methods, evaluate the strengths and limitations of using structured interviews to investigate the influence of the family on pupils’ education (20).

Mark Scheme (top band only: 17-20)

Answers in this band will show accurate, conceptually detailed knowledge and sound understanding of a range of relevant material on structured interviews.

Appropriate material will be applied accurately and with sensitivity to the investigation of the specific issue of the influence of the family on pupils’ education.

Students will apply knowledge of a range of relevant strengths and limitations of using structured interviews to research issues and characteristics relating to the influence of the family on pupils’ education. These may include some of the following and/or other relevant concerns, though answers do not need to include all of these, even for full marks:

  • the research characteristics of potential research subjects, eg individual pupils, parents, other relatives, teachers (eg class and ethnic differences among parents; teachers’ professionalism or attitudes towards pupils’ families)
  • the research contexts and settings, eg pupils’ homes, school premises, school gates
  • the sensitivity of researching influence of the family on pupils’ education, eg families’ material circumstances or child-rearing practices; eligibility for free school meals; stigmatisation; policy and resource implications for schools; parental consent).

Evaluation of the usefulness of structured interviews will be explicit and relevant. Analysis will show clear explanation. Appropriate conclusions will be drawn.

Indicative Content for the strengths and limitations of the method

Strengths and limitations of structured interviews, as applied to the particular issue in education, may include: time, cost, access, hypothesis-testing, quantitative data, factual data, correlation, reliability, sample size, representativeness, generalisability, inflexibility, superficiality, lack of validity, interviewer bias, social desirability effect, status differences, misunderstanding, ethical issues.

Student response

KT’s comments in bold and red beneath each paragraph…

Structured interviews are usually closed-ended interviews which produce reliable, quantitative data. They are relatively quick to carry out and require little training. If the school agrees to the research taking place the researcher would be able to get a large sample of pupils. However, these interviews, although preferred by positivists, are limiting because the questions are fixed. The quantitative nature of the interviews means they are ideal for examining cause and effect such as whether parent attending parents’ evening has an impact on the pupils’ education.

This is a good general introductory paragraph about structured interviews, but it’s really only a mark band level 3 response: because you could replace the phrases ‘school’ and ‘pupils’ with (for example) ‘hospitals’ and ‘patients’ and it would be saying the same thing. The same is true with the final sentence. You could say that about ‘eating 5 pieces of fruit a day’ has an impact on ‘patient recovery rates’.

This is a good example of a paragraph where the candidate may think they’ve said something at level 4 or 5, but really it’s down at level 3!

However, when asking parents about how they bring up their children there could be many problems. Most parents will not want to be thought of as bad parents who do not care about their child. These parents will want to show that they are supportive of their child. The formality of a structured interview will increase parents’ fear and this means that parents may give socially desirable answers, especially as they are face-to-face with the interviewer. They may see the interviewer as a teacher in disguise and this will further encourage choosing answers that may not reflect the true situation of their involvement in their child’s education.

This is a solid ‘mark band level 5’ paragraph – the method applied specifically to the topic under investigation.

Another problem with unstructured interviews is they are inflexible. Closed questions with limited responses will only give the options chosen by the researcher and so may miss vital aspects of home life that could have an impact on a child’s achievement such as temporary housing or domestic abuse. This is likely if the parents are working class and the sociologist is middle class and does not have experience of working class life or know the concerns or worries facing working-class families.

Not quite as solid as the first paragraph, but it does pick up on aspects of home life, so should be at least level 4.

Working-class parents may have lower levels of education and speak in restricted speech code. This means they may not understand a question or they may say something the sociologist does not understand. In a structured interview the sociologist cannot ask for clarification of what has been said. The same problem applies if the parent and the sociologist are of a different ethnic background, in this case there may also be a language barrier if the parent does not speak English or it is not their first language.

Seems like a solid level 5 paragraph again.

Many deprived pupils may have a sense of shame or stigma attached to them. Many do not claim free school meals for this reason and if they are asked about this they may not want to tell the truth. They may lie and they are more likely to lie when they do not feel relaxed or comfortable. This is much more likely in a structured interview as there is no chance to gain rapport. Since the interviewer is present there is an increased risk of social desirable answers. There may be an ethical issue of harm linked to the research due to the nature of the topic and the questions that the interviewer may ask about personal circumstances linked to the pupil’s home background.

The link to free school meals at the beginning should just about clarify this a level 5 response.

A problem with structured interviews with pupils is that most of them will be under 18. This means that they are unable to give their consent and this will cause some ethical concerns. Parents will be unlikely to give their consent because they will feel a sense of shame or they just may not want their child to be part of the research which asked them to give personal details about the parent-child relationship.

This should classify as a standard ‘level 4 response’, about pupils in general.

Structured interviews could be used with teachers to assess their views of the impact of home background. Teachers would be more likely to take part in a structured interview as they are less time consuming. As the questions would be related to children’s home backgrounds teachers may not be able to answer all the questions if they did not have all the details of a pupil’s home situation. Teachers may also give answers that suggest that achievement is linked to factors at home rather than in the school as this takes some of the pressure away from their responsibility.

A clear level 5 response… teachers not knowing about home background… one of the clearest level 5 responses in the whole essay.

Examiner commentary

The answer shows a wide range of application. Many of the points are linked explicitly to the issue of the influence of the family on pupils’ education. The answer covers a range of characteristics of research subjects; parents, pupils and teachers. There is some consideration of the school as a research setting. There are a number of points that consider the sensitivity of researching this subject and the problematic nature of the presence of the interviewer when carrying out this research.

20/20 marks awarded

KT’s commentary…

This is a solid answer, HOWEVER… I don’t see how it can get 20/20 because IT DOES NOT DRAW APPROPRIATE CONCLUSIONS. Hence as far as I can see the AQA should have awarded it a maximum of 16/20.

There’s another example of a methods in context essay here! And for more examples of model answers to exam questions, please see the links on my main page on exam advice!

Theory and Methods A Level Sociology Revision Bundle 

If you like this sort of thing, then you might like my Theory and Methods Revision Bundle – specifically designed to get students through the theory and methods sections of  A level sociology papers 1 and 3.

Contents include:

  • 74 pages of revision notes
  • 15 mind maps on various topics within theory and methods
  • Five theory and methods essays
  • ‘How to write methods in context essays’.

How to Answer Methods in Context Questions: A Model Answer from the AQA

‘Methods in Context’ questions appear on A Level Sociology Paper 1 (Education with Theory and Methods) and AS Sociology Paper 1 (Education with Methods in Context).

Methods in Context questions will ask students to evaluate the strengths and limitations of any of the six main research methods for researching a particular topic within the sociology of education, applying material from the item.

Students often struggle with these questions and so it is useful to have exemplars which demonstrate how to answer them. Thankfully the AQA has recently released some of these, with examiner commentary, and below I’ve reproduced a top band 18/20 answer to one particular methods in context question!

NB – I’ve take this directly from the AQA’s feedback to the 2017 AS sociology exam series (specific source below), but I’ve repositioned the comments on each paragraph to make them more accessible (at the end of each paragraph, rather than at the end of the whole essay.

The specific question below appeared on the June 2017 AS Sociology Paper 1 – the whole paper is now publically available from the AQA’s web site.

Methods in Context

The Question:

Investigating working-class educational underachievement

Read Item B below and answer the question that follows.

ITEM B

On average, working-class pupils underachieve in education compared with those from middle-class backgrounds. Some sociologists believe that material deprivation is one factor that causes working-class underachievement. Other sociologists argue that values and attitudes in working-class homes may cause underachievement. School factors may also affect achievement.

Sociologists may use written questionnaires to study working-class educational underachievement. Using written questionnaires enables the researcher to reach a large number of pupils, parents and teachers. Also, those who complete the questionnaire can usually remain anonymous. However, not all those who receive a questionnaire will complete it.

Applying material from Item B and your knowledge of research methods, evaluate the strengths and limitations of using written questionnaires to investigate working-class educational underachievement.

The Mark Scheme (Top Band Only: 17-20)

Answers in this band will show accurate, conceptually detailed knowledge and good understanding of a range of relevant material on written questionnaires.

Appropriate material will be applied accurately to the investigation of the specific issue of working-class educational underachievement.

Students will apply knowledge of a range of relevant strengths and limitations of using written questionnaires to research issues and characteristics relating to working-class educational underachievement. These may include some of the following and/or other relevant concerns, though answers do not need to include all of these, even for full marks:

  • the research characteristics of potential research subjects, eg pupils, teachers, parents, (self-esteem; literacy skills; attitude to school)
  • the research contexts and settings (eg school; classroom; home environment).
  • the sensitivity of researching working-class underachievement (eg schools’ market position; negative publicity; vulnerability of participants; parental consent; teacher reluctance).

Evaluation of the usefulness of written questionnaires will be explicit and relevant. Analysis will show clear explanation and may draw appropriate conclusions

Student Answer – Awarded 18/20 (AS standard!)

Picture version:

Page 1

Page 2

Text Version:

Paragraphs as in actual student response, numbers added for clarity.

Examiner comments appear in red after each paragraph.

ONE – Written questionnaires are a type of survey where questions are standardised and distributed to large numbers of people. This is useful in an educational setting because it means they can be given to numerous students in numerous schools, something which is very important when investigating working class pupils as there are many regions which are predominantly working class.

First paragraph – general advantages of written questionnaires – standardised and large distribution. Attempt to link to topic

TWO – One major advantage of using questionnaires is that they pose relatively few practical issues. They are fairly cheap to create and distribute and they quick to fill out, especially if all questions are closed ended. This means that access is not usually an issue for the researcher as they will not disrupt lessons as much as other methods such as structured interviews, meaning that the researcher is more likely to received permission from the gatekeeper. Furhtermore, working class pupils are more likely to need to take on paid work and so the quick-nature of questinnaires which are not very time consuming means that they are useful for investigating working class underachievement.

Para 2 – advantage of Wc related to context of research in schools (gatekeepers).

THREE – However, when investigating working class pupils there may be the issue of cultural deprivation, particularly language issues. Berciler and Englemann argue that the language spoken by the working class is deficient, a particular issue when trying to interpret the questions on a written question questionnaire. When coupled with the fact that questionnaires are written in the elaborated code but working class pupils (and parents) tend to speak in the restricted code this can be a major problem in gaining accurate results; unlike with other methods, questions cannot be clarified

Para 3 – good link to topic and WQ re language and speech codes.

FOUR – As well as posing few practical issues, written questionnaires do not pose many ethical issues. This is because the respondent can remain anonymous if they so wish and they can also leave any intrusive or sensitive issues blank. When studying working class underachievement this is a particular advantage because some pupils may be embarrassed to discuss their home lives, particularly if they live in poverty.

Para 4 – ethical issues discussed – anonymity developed with reference to topic

FIVE – Even though there are relatively few ethical uses, the researcher must be aware of harm to respondents. For working class children there may be a stigma attached, and for sensitive issues such as home life, the use of questionnaires can still cause distress. Nevertheless, the fact that respondents are not obligated to respond means this ethical problem is easily overcome.

Para 5 – further developed with reference to topic

SIX – From the perspective of a positivist, written questionnaires are a useful way to investigate working class underachievement because the data produced when using standardised questions is quantitative and high in reliability. This makes questionnaires useful for investigating working class underachievement because it allows cause and effect relationships to be established, for example whether or the not the structure of the education system reproduces working class underachievement, or whether there is a correlation between family background and achievement. However, the nature of written questionnaires can be an issue if the researcher’s meaning is imposed onto the questionnaire so it is another  fact that must be taken into account

Para 6 – various positivist concepts – good on usefulness of WC – but not unique to topic

SEVEN – From the point of view of an interpretivist, written questionnaires are not useful when investigating working class underachievement because the data lacks validity. While questionnaires may be able to identify that factors such as material deprivation may influence the achievement of working class pupils, it does not get to the heart of the matter. Written questionnaires do not investigate the meanings that pupils may attach to the reasons they may underachieve, and do not let the respondent communicate their ideas freely. Because of this lack of validity interpretivists do not favour the use of written questionnaires to investigate working class underachievement.

Para 7 – interpretivism and validity – not related to topic specifically (generic)

EIGHT – Ultimately, written questionnaires can be useful to investigate working class underachievement because the data is easy to analyse and compare, which may be useful as the data could be used over time to look at whether government policies put in place to reduce working class underachievement really work. Not only that but they are representative, so generalisations about the wider population can be made in a way that methods favoured by interpretivists cannot.

Para 8 – attempt to relate strengths of WQs to topic

Overall COMMENT – very strong on method with some (2/3) clear links to topic

MARK: 18/20

For more examples of model answers to exam questions, please see the links on my main page on exam advice! 

Theory and Methods A Level Sociology Revision Bundle 

If you like this sort of thing, then you might like my Theory and Methods Revision Bundle – specifically designed to get students through the theory and methods sections of  A level sociology papers 1 and 3.

Contents include:

  • 74 pages of revision notes
  • 15 mind maps on various topics within theory and methods
  • Five theory and methods essays
  • ‘How to write methods in context essays’.T

Sources:
AS
SOCIOLOGY
Paper 1 Education with Methods in Context
Tuesday 16 May 2017
AS
Sociology
7191/1 Education with Methods in Context
Final Mark scheme
7191
June 2017
Version/Stage: v1.0
AS
SOCIOLOGY
Feedback on the exam(s)
Student responses and commentaries: Paper 1 Education with Methods in Context
Published: Autumn 2017

Research Methods Practice Questions for A-level sociology

AQA A-level sociology Papers 1 and 3 will both contain an ‘outline and explain’ 10 mark (no item) question on sociological theories, and/ or methods.

One possible format for this question is what I like to think of as the ‘pure research methods’ format (‘classic’ might be a better word than ‘pure’) in which students are asked to outline and explain two theoretical, practical or ethical advantages or problems of using one of the main research methods.

For example (taken from the AQA’s June 2017 Education with Theory and Methods paper): ‘Outline and explain two problems of using documents in social research’

There are actually 36 possible variations of such ‘pure’ or ‘classic’ research methods questions, as outlined in the flow chart below.

Outline and Explain 10 mark research methods questions

Students may be asked to give two advantages or problems of any of the above methods, or more specific methods (field experiments for example), or they may be asked to give two advantages of using overt compared to covert participant observation, or asked to simply give two ethical problems which you may encounter when doing research more generally.

Then of course, students may be asked to relate methods to theories, or just asked about a pure ‘theoretical’/ perspectives question.

While there is no guarantee that this particular format of question will actually come up on either paper 1 or 3, it’s still good practice for students to work through a number of such questions as revision practice.

Outline and explain two practical problems of using documents in social research (10)

There are a lot of documents available and it can be time consuming to analyse them qualitatively

Taking news for example, there are thousands of news items published every day.

You also need to distinguish between ‘real and ‘fake news’.

Also, in the postmodern age where fewer people get their news from mainstream news it is necessary to analyse a wide range of media content to get representatives, which makes this more difficult.

Because there are so many documents available today, it is necessary to use computer assisted qualitative analysis, which effectively quantifies the qualitative data, meaning that some of depth and insight are lost in the process.

With personal documents, gaining access might be a problem

Personal diaries are one of the most authentic sources of information because people write them with no intention of them being seen.

However, they may not be willing to show researchers the content because they say negative feelings about people close to them, which could harm them.

Blogs would be easier to access but  the problem is people will edit out much of what they feel because these are published.

Outline and explain two practical advantages of using official statistics

practical advantages official statistics

Official Statistics are a quick and cheap means of accessing data relevant to an entire population in a country.

They are cheap for researchers to use because they are collected by governments, who often make them available online for free—for example, the UK Census.

Marxists might point out that the fact they are free enables marginalised groups to ‘keep a check on government’.

More generally, they are useful for making quick evaluations of government policy, to see if tax payers’ money is being spent effectively–

Official statistics are a very convenient way of making cross national comparisons without visiting other countries.

Most governments in the developed world today collect official statistics which are made available for free.

More and more governments collect data around the world, so there is more and more data available every year.

The United Nations Development Programme collects the same data in the same way, so it’s easy to assess the relationship between economic and social development in a global age.

Theory and Methods A Level Sociology Revision Bundle 

If you like this sort of thing, then you might like my Theory and Methods Revision Bundle – specifically designed to get students through the theory and methods sections of  A level sociology papers 1 and 3.

Contents include:

  • 74 pages of revision notes
  • 15 mind maps on various topics within theory and methods
  • Five theory and methods essays
  • ‘How to write methods in context essays’.

Outline and explain two practical problems which may affect social research (10)

practical problems social research

One practical problem may be gaining access

Analysis/ development – Deviant and criminal groups may be unwilling to allow researchers to gain access because they may fear prosecution if the authorities find out about them.

Analysis/ development – some groups may be unwilling to take part in research because of social stigma.

Analysis/ development – the characteristics of the researcher may exacerbate all of this.

Analysis/ development – A further problem, is that if all of the above are problems, the research is very unlikely to get funding!

A second practical problem is that some studies can be very time consuming

Analysis/ development – gaining access can take a long time, especially with covert research.

Analysis/ development – even with overt research, gaining trust, getting respondents to feel comfortable with you can take months.

Analysis/ development  – unexpected findings in PO may further lengthen the research process

Analysis/ development – Some Participant Observation studies have taken so long that the findings may no longer be relevant—e.g. Gang Leader for a Day.

Theory and Methods A Level Sociology Revision Bundle 

If you like this sort of thing, then you might like my Theory and Methods Revision Bundle – specifically designed to get students through the theory and methods sections of  A level sociology papers 1 and 3.

Contents include:

  • 74 pages of revision notes
  • 15 mind maps on various topics within theory and methods
  • Five theory and methods essays
  • ‘How to write methods in context essays’.

Outline and Explain Two Reasons Why Interpretivists Prefer to Use Qualitative Research Methods (10)

A model answer to a possible 10 mark question which could appear on the AQA’s A-level papers 1 or 3.

If you’re a bit ‘all at sea’ with Intrepretivism, you might like to review your understanding of it first of all by reading this post: social action theory: a summary.

Interpretivism research methods.png

A developed model answer…

NB Warning – this is total overkill and probably completely unrepresentative of what 95% of actual A-level students are capable of producing.

The first reason is that Interpretivists believe that social realities are complex, and that individual’s identities are the results of 1000s of unique micro-interactions.

For example, labelling theory believes that students fail because of low teacher expectations, and these expectations are communicated to students in subtle ways over many months or years, until a student ends up with a self-concept of themselves as ‘thick’.

There is simply no way that quantitative methods such as structured questionnaires can capture these complex (‘inter-subjective’) micro interactions. In order to assess whether labelling has taken place, and whether it’s had an effect, you would need to go into a school and ideally observe it happening over a long period, and talk to students about how their self-perceptions have changed, which would require qualitative methods such as unstructured interviews. Alternatively you could use diaries in which students document their changing self concept.

A further reason why qualitative methods would be good in the above example is that you could, as a researcher, check whether teachers do actually have negative perceptions of certain students (rather than it being all in the student’s minds) – again qualitative methods are vital here – you would have to probe them, ask them testing questions, and look for body-language clues and observe them interacting to really assess whether labelling is taking place.

It would be all too easy for a teacher to lie about ‘not labelling’ if they were just filling out a self-completion questionnaire.

A second reason Interpretivists prefer qualitative methods stems from Goffman’s Dramaturgical Theory – People are actors on a ‘social stage’ who actively create an impression of themselves.

Goffman distinguished between ‘front stage’ performances of social roles and the ‘back stage’ aspects of life (at home) where we are more ‘true to ourselves’.

Goffman argued that some people put on ‘genuine performances’ – e.g. one teacher might really believe in teaching, and genuinely care about their students – their professional role is who they ‘really are’. Others, however, put on what he calls ‘cynical performances’ – another teacher, for example, might act like they care, because their school tells them to, but behind the scenes they hate the job and want to do something else.

A Qualitative method such as participant observation would be pretty much the only way to uncover whether someone is genuinely or cynically acting our their social roles – because the flexibility of following the respondent from front stage to back stage would allow the researcher to see ‘the mask coming off’.

If you just used a questionnaire, even a cynical teacher would know what boxes to tick to ‘carry on the performance’, and thus would not give you valid results.

Related Posts 

A brief overview of the difference between Positivism and Interpretivsm

Theory and Methods A Level Sociology Revision Bundle 

If you like this sort of thing, then you might like my Theory and Methods Revision Bundle – specifically designed to get students through the theory and methods sections of  A level sociology papers 1 and 3.

Contents include:

  • 74 pages of revision notes
  • 15 mind maps on various topics within theory and methods
  • Five theory and methods essays
  • ‘How to write methods in context essays’.

A few thoughts on revising research methods in context/ applied research methods

The ‘applied methods*’ question appears in paper 1 of the AQA’s Education with Theory and Methods exam (paper 7192/1). This is out of 20 marks, and students are expected to apply their understanding of any of the six main research method covered in the A-level sociology specification to any conceivable topic within education.

An example of an ‘applied methods*’ question is as follows:

‘Applying material from item B and elsewhere, evaluate the strengths and limitation of using participant observation to investigate truancy from school’ (20)

Here’s how I revise these questions with my students… NB I don’t introduce the item until later…

Warm up with the method

Firstly, I get students to talk through the theoretical practical and ethical strengths and limitations just of the method. I do this because students need to know they method anyway, and they can get 10/20 just for writing a decent methods essay (without applying it) – see the mark scheme here.

Methods in Context

Warm up with the method generally applied to the topic

Students brainstorm the general ethical, practical and theoretical issues you may encounter when researching this topic with this method… I think it’s good to be as open-minded as possible early on… It’s easiest just to get them to do this on paper. 

Sociology applied methods

Do a plan applying the method to the specific details in the item

I use an A3 sheet for this, with the item and question in the middle, students now read the item. 

Methods in Context

Write a detailed flow-chart

Here I get students to add in analysis and evaluation points to each original lead-point, showing a chain of reasoning (side 2 of A3 sheet).

Applied Research Methods

Repeat stage two with a different topic, to emphasise the difference in answers for the same method applied to a different topic

DO NOT go over the whole process again, once is enough!

Research Methods

Issues with Revising Applied Research Methods 

There’s a very real possibility that students will just not ‘get it’, because they have to be so nit-pickingly overt about relating the method to the specific topic. Drilling this into students is a painful and thankless task, induced solely by the demands of this specific form of the assessment.

There is also the possibility that students may lose the will to live, especially when some past papers have examples that even I find intolerably dull, and I’m actually interested in this stuff!

*These are sometimes referred to as ‘Methods in Context’ questions. This was the term originally used by the AQA for many years, but (much like this question format itself as a means of assessing application skills) it’s pretty clumsy, so the new ‘applied methods’ phrase is IMO much better.  

Validity in Social Research

Validity refers to the extent to which an indicator (or set of indicators) really measure the concept under investigation. This post outlines five ways in which sociologists and psychologists might determine how valid their indicators are: face validity, concurrent validity, convergent validity, construct validity, and predictive validity. 

Validity refers to the extent to which an indicator (or set of indicators) really measure the concept under investigation. This post outlines five ways in which sociologists and psychologists might determine how valid their indicators are: face validity, concurrent validity, convergent validity, construct validity, and predictive validity.

As with many things in sociology, it makes sense to start with an example to illustrate the general meaning of the concept of validity:

When universities question whether or not BTECs really provide a measure of academic intelligence, they are questioning the validity of BTECs to accurately measure the concept of ‘academic intelligence’.

When academics question the validity of BTECs in this way, they might be suspicious that that BTECs are actually measuring something other than a student’s academic intelligence; rather BTECs might instead actually be measuring a student’s ability to cut and paste and modify just enough to avoid being caught out by plagiarism software.

If this is the case, then we can say that BTECs are not a valid measurement of a student’s academic intelligence.

How can sociologists assess the validity of measures and indicators?

what is validity.png

There are number of ways testing measurement validity in social research:

  • Face validity – on the face of it, does the measure fit the concept? Face validity is simply achieved by asking others with experience in the field whether they think the measure seems to be measuring the concept. This is essentially an intuitive process.
  • Concurrent validity – to establish the concurrent validity of a measure, the researchers simply compare the results of one measure to another which is known to be valid (known as a ‘criterion measure). For example with gamblers, betting accounts give us a valid indication of how much they actually win or lose, but wording of questions designed to measure ‘how much they win or lose in a given period’ can yield vastly different results. Some questions provide results which are closer to the hard-financial statistics, and these can be said to have the highest degree of concurrent validity.
  • Predictive validity – here a researcher uses a future criterion measure to assess the validity of existing measures. For example we might assess the validity of BTECs as measurement of academic intelligence by looking at how well BTEC students do at university compared to A-level students with equivalent grades.
  • Construct validity – here the researcher is encouraged to deduce hypotheses from a theory that is relevant to the concept. However, there are problems with this approach as the theory and the process of deduction might be misguided!
  • Convergent validity – here the researcher compares her measures to measures of the same concept developed through other methods. Probably the most obvious example of this is the British Crime Survey as a test of the ‘validity’ of Police Crime Statistics’. The BCS shows us that different crimes, as measured by PCR have different levels of construct validity – Vehicle Theft is relatively high, vandalism is relatively low, for example.

Source 

Bryman (2016) Social Research Methods