Human Generated Data

Title

Waiting outside relief station, Urbana, Ohio
Date

1938
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3031

Human Generated Data

Title

Waiting outside relief station, Urbana, Ohio

People

Artist: Ben Shahn, American 1898 - 1969

Date

1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Apparel 99.8
Clothing 99.8
Person 99.7
Human 99.7
Person 99
Person 98.1
Hat 80.3
Bonnet 79.5
Home Decor 62.7
Female 62.3
Cap 61.3

Imagga
created on 2021-12-15

groom 75.6
bride 59.5
wedding 53.4
dress 38.9
love 37.1
couple 34.9
happiness 32.9
married 30.7
people 29
happy 28.9
portrait 28.5
bouquet 27.7
adult 25.9
marriage 25.7
veil 25.5
bridal 24.3
smile 24.3
person 23.9
gown 23.5
smiling 21.7
man 20.9
male 20.8
child 20.5
two 20.3
celebration 20
mother 19.6
flowers 19.1
romantic 18.7
romance 17
day 16.5
lady 16.2
wed 15.7
outdoors 15.7
ceremony 15.5
pretty 15.4
attractive 15.4
flower 15.4
family 15.1
women 14.2
together 14
life 13.6
wife 13.3
park 13.2
relationship 13.1
cheerful 13
outdoor 13
fashion 12.8
husband 12.8
parent 12.5
lifestyle 12.3
nurse 12.1
sexy 12.1
newly 11.9
kiss 11.7
summer 11.6
human 11.3
looking 11.2
event 11.1
engaged 10.9
innocent 10.8
holding 10.7
clothing 10.7
engagement 10.6
model 10.1
joy 10
traditional 10
wedded 9.9
tender 9.6
sibling 9.4
elegance 9.2
face 9.2
religion 9
decision 8.8
hair 8.7
cute 8.6
men 8.6
outside 8.6
pair 8.5
future 8.4
new 8.1
daughter 8.1
contestant 7.9
elation 7.9
getting 7.9
embrace 7.8
necklace 7.8
eyes 7.8
occasion 7.7
ready 7.7
prepared 7.6
one 7.5
pure 7.4
joyful 7.4
world 7.3
sensuality 7.3
suit 7.2
hairdresser 7.1

Google
created on 2021-12-15

Black-and-white 85.4
Gesture 85.3
Style 83.9
Adaptation 79.4
Monochrome 75.3
Monochrome photography 74.8
Snapshot 74.3
Happy 71.5
Vintage clothing 70.5
Cap 67.8
Event 66.7
Stock photography 63.1
History 59.6
Photographic paper 59.5
Room 57.6
Photo caption 55.9
Paper product 53.6
Plant 53.1
Retro style 52.3
Necklace 52

Microsoft
created on 2021-12-15

person 99.8
text 98.8
human face 97.8
clothing 96.3
woman 88.1
smile 83.2
black and white 78.4
fashion accessory 74.2

Face analysis

Amazon

Google

AWS Rekognition

Age 22-34
Gender Female, 87.3%
Calm 38.8%
Sad 30.5%
Fear 20.6%
Confused 3.5%
Angry 2.9%
Surprised 2.8%
Happy 0.5%
Disgusted 0.5%

AWS Rekognition

Age 11-21
Gender Female, 63%
Calm 75.8%
Sad 22.9%
Happy 1%
Confused 0.2%
Angry 0.1%
Disgusted 0%
Fear 0%
Surprised 0%

AWS Rekognition

Age 51-69
Gender Male, 87.4%
Calm 60.4%
Sad 38.4%
Confused 0.6%
Happy 0.3%
Angry 0.1%
Fear 0.1%
Surprised 0.1%
Disgusted 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a person standing in front of a window 84.8%
a person sitting in front of a window 78.9%
a man and a woman looking at the camera 66.9%