Human Generated Data

Title

Untitled (Red House, West Virginia)

Date

October 1935, printed later

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3293

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Red House, West Virginia)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3293

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Face 99.9
Head 99.9
Photography 99.9
Portrait 99.9
Person 98.9
Child 98.9
Female 98.9
Girl 98.9
Person 97.5
Child 97.5
Female 97.5
Girl 97.5
Person 97.4
People 97.2
Bench 97
Furniture 97
Person 97
Baby 97
Person 95.9
Adult 95.9
Male 95.9
Man 95.9
Person 94.9
Baby 94.9
Body Part 91.5
Finger 91.5
Hand 91.5
Person 87.9
Person 79.6
Adult 79.6
Male 79.6
Man 79.6
Person 79
Person 72.1
Person 63
Person 62.2
Accessories 59.1
Bag 59.1
Handbag 59.1
Person 58.2
Adult 58.2
Male 58.2
Man 58.2
Reading 57.8
Clothing 56
Hat 56
Couch 55.4
Architecture 55
Building 55
Classroom 55
Indoors 55
Room 55
School 55

Clarifai
created on 2018-05-10

people 99.8
group 99.3
group together 96.1
woman 95.1
many 95
adult 94.7
facial expression 94.4
man 93.1
child 93
furniture 92.2
several 91.5
actress 91.5
portrait 91
outfit 89.5
wear 89.3
music 87.7
musician 86.2
administration 86
singer 85.5
actor 83.4

Imagga
created on 2023-10-07

happy 39.5
child 33.2
family 32
mother 31.2
people 29
male 27.9
home 27.9
adult 27.5
man 26.2
couple 26.1
kin 25.1
together 23.6
happiness 23.5
sitting 23.2
couch 23.2
smiling 23.1
love 22.9
parent 20.8
portrait 20.7
smile 20.7
casual 20.3
lifestyle 20.2
fun 20.2
cute 20.1
person 20.1
cheerful 19.5
daughter 19.1
boy 17.4
kid 16.8
loving 16.2
father 16
indoors 15.8
chair 15.6
children 15.5
husband 15.3
two 15.2
furniture 14.4
women 14.2
room 14
attractive 14
house 13.4
sibling 12.6
togetherness 12.3
rocking chair 12.1
adorable 12
outdoors 11.9
indoor 11.9
wife 11.4
classroom 11.4
laughing 11.3
kids 11.3
device 11.1
seat 10.9
playing 10.9
joy 10.9
face 10.7
interior 10.6
little 10.6
looking 10.4
youth 10.2
day 10.2
son 10.2
living 9.5
pair 9.4
senior 9.4
20s 9.2
girls 9.1
holding 9.1
childhood 9
lady 8.9
school 8.8
hug 8.7
30s 8.7
play 8.6
armchair 8.6
jeans 8.6
friends 8.4
relationship 8.4
group 8.1
bench 8
sofa 8
posing 8
caring 7.9
grandma 7.8
dad 7.8
brunette 7.8
living room 7.8
parenthood 7.8
40s 7.8
boys 7.8
affectionate 7.7
affection 7.7
washboard 7.7
expression 7.7
enjoying 7.6
horizontal 7.5
relaxed 7.5
care 7.4
relaxing 7.3
handsome 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 99.5
posing 39
crowd 0.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-14
Gender Female, 100%
Confused 62.3%
Angry 16.2%
Calm 14.2%
Surprised 6.5%
Fear 6.1%
Sad 4.4%
Disgusted 0.7%
Happy 0.4%

AWS Rekognition

Age 6-14
Gender Female, 98.7%
Happy 98.1%
Surprised 6.3%
Fear 6%
Sad 2.2%
Calm 1%
Confused 0.1%
Disgusted 0.1%
Angry 0%

AWS Rekognition

Age 13-21
Gender Female, 70.6%
Calm 99.1%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Disgusted 0.2%
Angry 0.2%
Confused 0.1%
Happy 0.1%

AWS Rekognition

Age 23-31
Gender Female, 99.6%
Sad 98.8%
Confused 40.1%
Surprised 6.3%
Fear 5.9%
Calm 1.6%
Disgusted 0.2%
Angry 0.1%
Happy 0.1%

AWS Rekognition

Age 13-21
Gender Male, 100%
Calm 96.6%
Surprised 7.1%
Fear 6%
Sad 2.3%
Confused 0.7%
Angry 0.3%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 29-39
Gender Female, 100%
Calm 99.1%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Angry 0.1%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 23-33
Gender Female, 99.3%
Fear 98%
Surprised 6.3%
Sad 2.2%
Calm 0.2%
Confused 0.1%
Angry 0%
Disgusted 0%
Happy 0%

Microsoft Cognitive Services

Age 36
Gender Female

Microsoft Cognitive Services

Age 12
Gender Female

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 36
Gender Female

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Child 98.9%
Female 98.9%
Girl 98.9%
Baby 97%
Adult 95.9%
Male 95.9%
Man 95.9%
Handbag 59.1%

Text analysis

Amazon

SON
ERS
TALE