What single question does any check on reliability ask about a measure?

It asks whether the measure gives consistent results, producing the same outcome when the same thing is measured again, when it is scored by someone else, or when one half of the test is compared with the other.

Define inter-rater reliability.

It is the extent to which two or more independent observers or raters, recording the same behaviour, produce the same scores.

Two observers coding playground aggression correlate at +0.35. What should be done before real data are collected?

The behavioural categories should be returned to, the operational definitions sharpened so each names an observable act, and the observers retrained together on the same recorded material until they agree.

Why must the two observers record independently rather than sitting together?

Because if each can see or hear the other's decisions they will influence one another, so their agreement would reflect that influence rather than the clarity of the coding scheme.

WJEC A-Level Psychology 601-5719-7

Psychology Past to Present — The Five Approaches

Topic overview The Biological Approach: assumptions of the approach and applying the assumptions to the formation of relationships The Biological Approach: love chemicals, strengths and weaknesses Biological Therapy: Drug Therapy or Psychosurgery — how the approach is used in therapy Biological Therapy: Drug Therapy or Psychosurgery — effectiveness of the therapy Classic Evidence (Biological): Raine, Buchsbaum and LaCasse (1997) — methodology and findings Classic Evidence (Biological): Raine, Buchsbaum and LaCasse (1997) — conclusions The Psychodynamic Approach: assumptions of the approach The Psychodynamic Approach: personality, defence mechanisms and the formation of relationships The Psychodynamic Approach: strengths and weaknesses of the approach Psychodynamic Therapy: Dream Analysis or Group Analysis Psychotherapy — how the approach is used Psychodynamic Therapy: Dream Analysis or Group Analysis Psychotherapy — effectiveness of the therapy Classic Evidence (Psychodynamic): Bowlby (1944) — methodology, procedures and findings Classic Evidence (Psychodynamic): Bowlby (1944) — conclusions, ethical issues and social implications The Behaviourist Approach: assumptions of the approach The Behaviourist Approach: applying the assumptions to relationships, strengths and weaknesses Behaviourist Therapy: Aversion Therapy or Systematic Desensitisation — how the approach is used Behaviourist Therapy: Aversion Therapy or Systematic Desensitisation — effectiveness of the therapy Classic Evidence (Behaviourist): Watson and Rayner (1920) — methodology, procedures and findings Classic Evidence (Behaviourist): Watson and Rayner (1920) — conclusions The Cognitive Approach: assumptions of the approach and applying the assumptions to the formation of relationships The Cognitive Approach: strengths and weaknesses of the approach Cognitive Therapy: Cognitive Behavioural Therapy or Rational Emotive Behaviour Therapy Cognitive Therapy: Cognitive Behavioural Therapy or Rational Emotive Behaviour Therapy (2)Classic Evidence (Cognitive): Loftus and Palmer (1974) — methodology, procedures and findings Classic Evidence (Cognitive): Loftus and Palmer (1974) — conclusions The Positive Approach: assumptions of the approach The Positive Approach: applying the assumptions to the formation of relationships The Positive Approach: strengths and weaknesses of the approach Positive Therapy: Mindfulness or Quality of Life Therapy — how the approach is used in therapy Positive Therapy: Mindfulness or Quality of Life Therapy — assumptions in practice, effectiveness and ethics Classic Evidence (Positive): Myers and Diener (1995) — methodology, procedures and findings Classic Evidence (Positive): Myers and Diener (1995) — conclusions Comparison of the Five Approaches: biological approach and psychodynamic approach Comparison of the Five Approaches: behaviourist approach, cognitive approach and positive approach

Contemporary Debates

Topic overview How to Explore a Contemporary Debate Debate: The Ethics of Neuroscience — what is at the core of the debate Debate: The Ethics of Neuroscience — arguments on each side of it Debate: The Mother as Primary Care-Giver of an Infant — what is at the core of the debate Debate: The Mother as Primary Care-Giver of an Infant — arguments on each side of it Debate: Using Conditioning Techniques to Control the Behaviour of Children Debate: Using Conditioning Techniques to Control the Behaviour of Children — arguments on each side Debate: Reliability of Eye-Witness Testimony (Including Children) — what is at the core of the debate Debate: Reliability of Eye-Witness Testimony (Including Children) — arguments on each side of it Debate: Relevance of Positive Psychology in Today's Society — what is at the core of the debate Debate: Relevance of Positive Psychology in Today's Society — arguments on each side of it

Principles of Research and Application of Research Methods

Topic overview Social Psychology Context Study: Milgram (1963) — methodology and procedures Social Psychology Context Study: Milgram (1963) — findings, ethical issues and social implications Developmental Psychology Context Study: Kohlberg (1968) — methodology, procedures and findings Developmental Psychology Context Study: Kohlberg (1968) — conclusions Deciding on a Research Question: aim of the research and null hypotheses Deciding on a Research Question: variables, operationalisation and extraneous variables Methodologies: experiments, quasi-experiments and participant observations Methodologies: non-participant observation, content analysis and interviews Methodologies: correlational studies, case studies and self-reports Location of Research: conducting research in a laboratory and in the field Location of Research: conducting research on-line Participants and Sampling: target populations, sampling frames and opportunity sampling Participants and Sampling: systematic sampling, stratified sampling and quota sampling Participants and Sampling: self-selected sampling and observational sampling techniques Experimental Design: independent groups and repeated measures Experimental Design: matched pairs Levels of Measurement: nominal data and ordinal data Levels of Measurement: interval data and ratio data Graphical Representation: bar charts and histograms Graphical Representation: scatter diagrams and choosing a display for the level of measurement Descriptive Statistics: the mean, the median and the mode Descriptive Statistics: the range, the standard deviation and choosing a measure Reliability Validity: internal validity and external validity Validity: specific validity issues and ways of dealing with issues of validity Ethics in Psychological Research: confidentiality, deception, protection from harm and risk to values Ethics in Psychological Research: valid consent, working with vulnerable individuals and ways of dealing with ethical issues Application of Research Methods to a Novel Scenario (AS): identifying the method and the variables Application of Research Methods to a Novel Scenario (AS): judging the reliability, validity and ethics

Mathematical Requirements for Psychology (Appendix A: AS Unit 2 and A2 Unit 4)

Topic overview Arithmetic and Numerical Computation: standard form and significant figures Arithmetic and Numerical Computation: estimating and checking a result Handling Data: means, medians, modes and ranges, percentages and percentage change Handling Data: reading a table of data and orders of magnitude Algebra Graphs: plotting and labelling a graph, gradients and intercepts Graphs: reading a value off a curve and choosing the right form of graph

Addictive BehavioursAddictive

Topic overview Addictive Behaviours: characteristics, biological explanations and the illusion of control Addictive Behaviours: individual differences explanations and social psychological explanations Addictive Behaviours: evaluating those explanations and evaluating those methods

Autistic Spectrum BehavioursAutistic spectrum

Topic overview Autistic Spectrum Behaviours: characteristics, biological and individual differences explanations Autistic Spectrum Behaviours: social psychological explanations and evaluating those explanations Autistic Spectrum Behaviours: methods of modifying the behaviour and evaluating those methods

Bullying BehavioursBullying

Topic overview Bullying Behaviours: characteristics, biological and individual differences explanations Bullying Behaviours: social psychological explanations, evaluation and CAPSLE Bullying Behaviours: methods of modifying the behaviour and evaluating those methods

Criminal BehavioursCriminal

Topic overview Criminal Behaviours: characteristics, biological explanations and Eysenck's theory Criminal Behaviours: intelligence, psychopathy and social psychological explanations Criminal Behaviours: methods of modifying the behaviour and evaluating those methods

SchizophreniaSchizophrenia

Topic overview Schizophrenia: characteristics of the behaviour and individual differences explanations Schizophrenia: social psychological explanations and evaluating those methods

StressStress

Topic overview Stress: characteristics of the behaviour and individual differences explanations Stress: social psychological explanations and evaluating those methods

Controversies in Psychology

Topic overview Controversy: Cultural Bias — issue, and why it is controversial Controversy: Cultural Bias — applying psychological knowledge to it Controversy: Cultural Bias — judgements and conclusions Controversy: Ethical Costs of Conducting Research — issue, and why it is controversial Controversy: Ethical Costs of Conducting Research — applying psychological knowledge to it Controversy: Ethical Costs of Conducting Research — judgements and conclusions Controversy: Non-Human Animals — issue, and why it is controversial Controversy: Non-Human Animals — applying psychological knowledge to it Controversy: Non-Human Animals — judgements and conclusions Controversy: Scientific Status — issue, and why it is controversial Controversy: Scientific Status — applying psychological knowledge to it Controversy: Scientific Status — judgements and conclusions Controversy: Sexism — issue, and why it is controversial Controversy: Sexism — applying psychological knowledge to it Controversy: Sexism — judgements and conclusions

Applied Research Methods

Topic overview Personal Investigations: Research Methods Skills — planning an investigation Personal Investigations: Research Methods Skills — carrying it out ethically and analysing the data Additional Methodologies (Unit 4): brain scans Additional Methodologies (Unit 4): longitudinal studies and cross-sectional studies Assessing Reliability: inter-rater reliability and test-retest reliability Assessing Reliability: split-half reliability Assessing Validity: predictive validity, face validity and content validity Assessing Validity: concurrent validity and construct validity Graphical Representation: Distribution Curves — normal distribution and its properties Graphical Representation: Distribution Curves — what a distribution shows about a data set Inferential Statistics: choosing a statistical test, parametric and non-parametric tests Inferential Statistics: calculating test values and choosing a significance level Application of Research Methods to Novel Scenarios (A2): identifying the method and the variables Application of Research Methods to Novel Scenarios (A2): judging the reliability, validity and ethics

Applied Research Methods

Assessing Reliability: inter-rater reliability and test-retest reliability

3 things to know
A2 Unit 4

Overview

Recall questions on inter-rater reliability and test-retest reliability.

What you need to know

Answer each one before you reveal it.

Your recallNot started

Key term

In test-retest reliability, why must the interval between the two administrations be neither too short nor too long?

Evaluation

How is inter-rater reliability assessed in practice?

Key term

What correlation coefficient is conventionally taken as showing that a measure is acceptably reliable?

Questions from this subtopic

Each one with the model answer underneath.

1
What single question does any check on reliability ask about a measure?
Model answer
It asks whether the measure gives consistent results, producing the same outcome when the same thing is measured again, when it is scored by someone else, or when one half of the test is compared with the other.
2
Define inter-rater reliability.
Model answer
It is the extent to which two or more independent observers or raters, recording the same behaviour, produce the same scores.
3
How is inter-rater reliability assessed in practice?
Model answer
The two observers record the same behaviour independently and their two sets of scores are then correlated; a strong positive correlation shows that they are applying the categories in the same way.
4
What correlation coefficient is conventionally taken as showing that a measure is acceptably reliable?
Model answer
A correlation of +0.80 or above is conventionally accepted as showing acceptable reliability.
5
Two observers coding playground aggression correlate at +0.35. What should be done before real data are collected?
Model answer
The behavioural categories should be returned to, the operational definitions sharpened so each names an observable act, and the observers retrained together on the same recorded material until they agree.
6
Why must the two observers record independently rather than sitting together?
Model answer
Because if each can see or hear the other's decisions they will influence one another, so their agreement would reflect that influence rather than the clarity of the coding scheme.

See the rest and revise

Other ways to work this

The same content, four other ways.

What is inside Levo

Six ways to work the same material.

1Closed book

2Open book

3Closed book

The 3-step method, run for you

Answer cold, learn it, then prove it stuck. Levo tracks the jump between your first attempt and your last.

Psychology Past to Present — The Five Approaches

Contemporary Debates

Principles of Research and Application of Research Methods

Mathematical Requirements for Psychology (Appendix A: AS Unit 2 and A2 Unit 4)

Cram a whole paper in one sitting

Sort every topic into what you know and what you do not, then drill only the weak ones.

Memory is .

reconstructivereproductivepermanent

Blank Blitz makes facts automatic

Rapid timed gap-fills on the terms and numbers you need to recall without thinking.

AParticipants volunteer and are already motivated.

BSamples are self-selecting.

CNo convincing placebo version exists.

Build It gets the exam shape right

Assemble a full-mark answer from its marking points, in the order an examiner wants them.

An MRI scan images structure only.

TrueFalse

Test It catches misconceptions

Spot the fault in a statement. The traps are the mistakes students actually make.

721941163128510

Brain Breaks between sessions

Short focus games to reset attention, so the next set lands better than the last.

Every question in Applied Research Methods, on a schedule.

Attempt a question from memory, write the correct version, then attempt it again. Levo records the jump between your first attempt and your last, and brings each question back on the day you are due to forget it.

Start revising, £5 a month See how the method works

Or £46 a year, about £3.83 a month. Cancel anytime.