Human Generated Data

Title

Untitled (sharecropper family, near Little Rock, Arkansas)

Date

October 1935, printed later

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3455

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (sharecropper family, near Little Rock, Arkansas)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3455

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Person 99.1
Person 99
Boy 99
Child 99
Male 99
Person 99
Male 99
Adult 99
Man 99
Person 98.9
Male 98.9
Adult 98.9
Man 98.9
Person 98.6
Boy 98.6
Child 98.6
Male 98.6
Person 98.4
Male 98.4
Adult 98.4
Man 98.4
Person 98
Person 97
Person 97
Male 97
Adult 97
Man 97
Person 96.8
Boy 96.8
Child 96.8
Male 96.8
Clothing 93
Architecture 88.1
Building 88.1
Classroom 88.1
Indoors 88.1
Room 88.1
School 88.1
Footwear 87.5
Shoe 87.5
Furniture 82.1
Shoe 82.1
Face 81
Head 81
Table 79.5
Outdoors 79.1
Barbershop 70.1
Hospital 64.7
Shoe 63.5
Hat 58.1
Shelter 57.4
Chair 57.4
Pants 57.3
Hairdresser 57.2
Wood 57
Shoe 57
Sitting 56.8
People 56.8
Hat 56.2
Bench 56.2
Dining Table 55.6
Reading 55.5
House 55.2
Housing 55.2
Porch 55.2
Nature 55.1
Clinic 55.1

Clarifai
created on 2018-05-10

people 100
group 99.7
child 99.1
group together 98.8
adult 96.3
boy 95.2
woman 93.3
many 93.3
several 92.4
man 91.2
furniture 91.1
four 90.5
three 89.6
room 89.1
home 89.1
education 88.5
war 88.3
five 88
administration 86.7
wear 86.6

Imagga
created on 2023-10-05

barbershop 49.5
shop 42.6
kin 33.4
mercantile establishment 30.8
man 28.9
male 28.5
people 26.8
adult 24.8
home 23.9
family 22.2
couple 20.9
place of business 20.5
person 20.4
hairdresser 20.3
old 20.2
smiling 18.1
happy 17.5
lifestyle 17.3
sitting 17.2
room 16.9
mother 16.4
indoors 15.8
senior 15
together 14
chair 13.7
women 13.4
portrait 12.9
child 12.4
fashion 12.1
men 12
two 11.9
happiness 11.7
elderly 11.5
cheerful 11.4
casual 11
aged 10.9
interior 10.6
husband 10.5
establishment 10.3
mature 10.2
smile 10
classroom 9.8
outdoors 9.7
30s 9.6
boy 9.6
daughter 9.5
father 9.5
table 9.5
indoor 9.1
human 9
group 8.9
love 8.7
education 8.7
day 8.6
wife 8.5
face 8.5
house 8.4
holding 8.3
parent 8.2
standing 7.8
musical instrument 7.7
drinking 7.7
horizontal 7.5
care 7.4
lady 7.3
children 7.3
color 7.2
dress 7.2
clothing 7.2
looking 7.2
holiday 7.2

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

outdoor 92.3
person 88.7
black 76.2
white 61.2
store 41.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-16
Gender Female, 98.8%
Sad 100%
Fear 14.4%
Surprised 6.5%
Confused 1.2%
Calm 0.5%
Angry 0.4%
Disgusted 0.4%
Happy 0.3%

AWS Rekognition

Age 13-21
Gender Female, 100%
Calm 69.4%
Sad 56%
Surprised 6.4%
Fear 6.2%
Confused 0.4%
Angry 0.3%
Disgusted 0.3%
Happy 0.1%

AWS Rekognition

Age 20-28
Gender Male, 99.8%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0%
Disgusted 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 48-54
Gender Male, 99.8%
Calm 99.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.1%
Confused 0%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 12-20
Gender Male, 97.2%
Confused 78.5%
Sad 9.2%
Fear 7.5%
Surprised 7.1%
Calm 3.4%
Disgusted 0.7%
Angry 0.6%
Happy 0.6%

AWS Rekognition

Age 30-40
Gender Male, 81.7%
Happy 76%
Calm 11.8%
Surprised 8.1%
Fear 6.1%
Angry 3.6%
Sad 2.7%
Disgusted 2.5%
Confused 0.7%

AWS Rekognition

Age 30-40
Gender Male, 94.4%
Happy 99.5%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Calm 0.1%
Disgusted 0%
Confused 0%
Angry 0%

AWS Rekognition

Age 9-17
Gender Male, 98.5%
Calm 93.9%
Surprised 6.3%
Fear 5.9%
Sad 4.4%
Confused 0.3%
Happy 0.1%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 16-24
Gender Female, 75.2%
Calm 98%
Surprised 6.3%
Fear 5.9%
Sad 2.7%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Happy 0%

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 40
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 14
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Boy 99%
Child 99%
Male 99%
Adult 99%
Man 99%
Shoe 87.5%
Hat 58.1%
Chair 57.4%

Categories