Reliability and Validity

How would you define reliability?

• The consistency of data

• The accuracy of data

• The levels of data

• The validity of data

Organize these options into the right categories. You must get the correct definitions and what studies lack this type of validity, and what studies have high levels of this type of validity.

Groups:

(a) Internal Validity

,

(b) Temporal Validity

,

(c) Population Validity

,

(d) Ecological Validity

• Moscovici used all female ppts- this is an example of beta bias and reduces __ validity

• Asch's results can be said to be due to America being very conformist in the 1950s

• Asch and Zimbardo only used while, male ppts. This is androcentric and alpha bias,

• Bowlbys, Milgrams and Ainsworth study have been replicated today and still apply

• Freud generally lacks this validity due to androcentric views

• Van IJzendoorn and Kroonenberg did a meta-analysis looking at 32 studies across 8 countries

• Do the results and conclusions apply to everyday life?

• When it measures what is intended. Know the IV is the cause.

• Studies should be valid despite progressions with time

• Demand characteristics reduce this type of validity, like in Zimbardos study

• Lab studies like Asch, should have a high level of this type of validity

• Observes natural infant-caregiver behaviours in a structured but realistic setting- Ainsworth

• Baddeley and Godden artificial task of reading word lists under the sea and on land

• The extent to which the sample can be generalised to similar and wider populations

One way to assess reliability is by _. This involves re-administering the same test/questionnaire to the same people, under the same conditions, but on separate occasions.

Different researchers may interpret the same situation in a different way to another researcher, and this is called subjectivity bias. _____ must be established to ensure that more than one researcher interprets a situation in the same way. Behaviour categorises can be assignments, and a pilot study can take place to help test this.

• Inter-rater reliability

• Content Analysis

• Interviews

• +.80 correlation co-efficient

You can improve reliability of experiments by

• Standardising procedures

• Establishing cause and effect

• Changing the temperature to help suit the ppts

• Train the ppts to be more reliable

​ Observations can be improved by ​ (a)   behaviour categories. This means to make variable more​ (b)   . These categories should not overlap (e.g., hugging and cuddling).

• Operationalising
• measurable
• reliable 
• accurate 

Match the definitions for ways of assessing validity.

Groups:

(a) Face validity

,

(b) Concurrent Validity

,

(c) Predictive Validity

• E.g., observing high IQ scores, score higher in exams

• E.g., Using your GCSE grades to get into college

• Measure of whether it look subjectively promising that a tool measure what it's supposed too

• This refers to the ability of a test or other measurement to predict a future outcome

• E.g., Asking the same sample of employees to fill in both an existing survey, and your new one

• It compares two assessments - one that has already been tested, and one that needs to be valid

You can improve the validity of experiments by...

• Using a control group to see if IV does influence the DV

• Standardising methods and procedures

• Using Single-blind, or double blind studies.

• All options are correct.

Improving Validity of...

• Interpretations must match ppts reality

• Behaviour categories for observations

• Should be clear and operationalised

• Observations

• Using multiple sources - triangulation

• Questionnaires

• Using Covert method

• Qualitative methods

• A lie scale and anonymity

• Qualitative Method sources

What is one way to increase inter-rater reliability in observational studies?

• Providing clear and detailed coding schemes

• Changing the research question

• Reducing the number of observers

• Allowing observers to use their own judgment