Human Generated Data

Title

Background photo, family of Negro FSA client, Caruthersville, Missouri

Date

1938

People

Artist: Russell Lee, American 1903 - 1986

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2983

Human Generated Data

Title

Background photo, family of Negro FSA client, Caruthersville, Missouri

People

Artist: Russell Lee, American 1903 - 1986

Date

1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2983

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.5
Human 99.5
Classroom 99.4
Room 99.4
School 99.4
Indoors 99.4
Person 99.2
Person 99.1
Person 97.4
Person 97.4
Person 97
Person 90.3
Bird 65.4
Animal 65.4
Person 48.7

Clarifai
created on 2023-10-26

people 100
group 99.7
group together 99.5
adult 99.4
child 98.6
man 97.8
furniture 96.3
woman 96.3
five 96.1
administration 95.6
several 94.9
many 94.6
medical practitioner 93.9
war 93.7
boy 93.5
military 91.3
vehicle 91.2
transportation system 89.7
three 89.6
sit 89.5

Imagga
created on 2022-01-22

classroom 39.3
man 34.2
people 32.3
room 32.3
male 31.9
kin 29.4
person 27.5
home 23.9
adult 22.3
family 22.2
happy 21.3
sitting 20.6
couple 20
indoors 19.3
lifestyle 18.8
nurse 18.5
smiling 18.1
happiness 18
cheerful 17.9
senior 17.8
marimba 17.7
together 17.5
percussion instrument 16
smile 15.7
portrait 15.5
men 15.4
mother 15
mature 14.9
old 14.6
child 14.5
teacher 14.5
group 14.5
women 14.2
love 13.4
musical instrument 13.3
business 12.7
casual 12.7
day 12.5
table 12.4
businessman 12.4
school 11.9
grandfather 11.9
retired 11.6
elderly 11.5
face 11.4
father 10.9
30s 10.6
retirement 10.6
education 10.4
parent 10
horizontal 10
bench 9.8
colleagues 9.7
four 9.6
talking 9.5
friends 9.4
indoor 9.1
aged 9
pensioner 9
professional 9
kid 8.9
interior 8.8
boy 8.7
married 8.6
student 8.6
husband 8.6
meeting 8.5
color 8.3
20s 8.2
relaxing 8.2
office 8
handsome 8
to 8
discussion 7.8
older 7.8
mid adult 7.7
daughter 7.6
two 7.6
businesspeople 7.6
wife 7.6
enjoying 7.6
joy 7.5
clothing 7.5
outdoors 7.5
blackboard 7.4
team 7.2
working 7.1
desk 7.1
patient 7

Google
created on 2022-01-22

Vintage clothing 73.2
Room 70.2
Class 68.9
Child 65.9
History 63.8
Stock photography 62.8
Monochrome 62.6
Sitting 61.2
Crew 60.3
Toddler 55.9
Team 54.6
Cooking 53.5
School 50.7

Microsoft
created on 2022-01-22

text 95.5
person 94
clothing 93.3
window 87.2
child 78.2
old 68.9
boy 56.3
people 56.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-14
Gender Male, 99.9%
Calm 99.8%
Confused 0.1%
Sad 0.1%
Angry 0%
Surprised 0%
Happy 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 6-14
Gender Male, 93.3%
Confused 85%
Fear 13.2%
Surprised 1%
Calm 0.4%
Sad 0.2%
Disgusted 0.1%
Angry 0%
Happy 0%

AWS Rekognition

Age 18-24
Gender Male, 59%
Calm 98%
Sad 0.7%
Angry 0.4%
Confused 0.3%
Disgusted 0.2%
Fear 0.2%
Surprised 0.1%
Happy 0.1%

AWS Rekognition

Age 42-50
Gender Female, 95.1%
Disgusted 52.6%
Happy 11.3%
Calm 10.9%
Surprised 6.8%
Angry 6.7%
Fear 6%
Sad 3.8%
Confused 2%

AWS Rekognition

Age 23-33
Gender Female, 99.9%
Confused 82.1%
Calm 16.5%
Sad 0.6%
Fear 0.3%
Angry 0.2%
Surprised 0.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 10-18
Gender Male, 99%
Surprised 66.3%
Calm 27.4%
Confused 4.3%
Fear 1.2%
Disgusted 0.3%
Angry 0.3%
Sad 0.2%
Happy 0.1%

AWS Rekognition

Age 7-17
Gender Male, 98.1%
Confused 41.5%
Calm 37.1%
Fear 11%
Sad 3.7%
Surprised 2.6%
Disgusted 2.2%
Angry 1.4%
Happy 0.6%

AWS Rekognition

Age 12-20
Gender Male, 59.6%
Happy 26.7%
Angry 22.8%
Calm 19.7%
Sad 12.6%
Disgusted 8%
Surprised 5.3%
Confused 3.1%
Fear 1.8%

Microsoft Cognitive Services

Age 7
Gender Male

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 1
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Bird 65.4%

Categories