Human Generated Data

Title

Untitled (relief station, Urbana, Ohio)
Date

August 1938
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.65
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (relief station, Urbana, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

August 1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Person 99.7
Human 99.7
Clothing 99.3
Apparel 99.3
Person 99.2
Person 98.3
Hat 75.5
Bonnet 74.7
Face 71.9
Finger 59.6
Dating 59.4
People 59.3
Food 59.2
Meal 59.2
Female 58.9
Home Decor 58.9
Linen 58.9
Dish 55.6

Clarifai
created on 2018-03-23

people 99.6
adult 98.4
woman 97
portrait 95.5
two 95.4
group 95.2
street 95.1
man 94.8
one 93.8
wear 92.5
child 92.3
monochrome 92.1
administration 87.1
three 83.7
facial expression 82.8
leader 81.5
veil 79.8
group together 78.6
war 77.9
religion 77.8

Imagga
created on 2018-03-23

parasol 46.8
bride 41.3
umbrella 37.1
wedding 36.8
dress 35.2
love 29.2
groom 27
portrait 25.9
person 24.2
canopy 23.7
people 23.4
happiness 21.2
married 21.1
veil 20.6
adult 20.1
celebration 19.9
bouquet 19.4
shelter 18.7
clothing 18.5
marriage 18
gown 17.6
happy 17.6
flowers 17.4
fashion 16.6
bridal 16.5
couple 15.7
face 15.6
model 15.6
women 15
smile 15
hair 14.3
life 13.8
lifestyle 13.7
day 13.3
pretty 13.3
attractive 13.3
human 12.8
protective covering 12.5
romance 12.5
posing 12.4
smiling 12.3
looking 12
outside 12
head 11.8
ceremony 11.6
holding 11.6
cute 11.5
lady 11.4
sexy 11.2
one 11.2
old 11.2
summer 10.9
traditional 10.8
child 10.7
outdoor 10.7
romantic 10.7
hat 10.4
wife 10.4
two 10.2
man 10.1
flower 10
male 10
wed 9.8
cheerful 9.8
fun 9.7
outdoors 9.7
covering 9.7
youth 9.4
girls 9.1
engaged 8.9
blond 8.8
together 8.8
engagement 8.7
men 8.6
skin 8.5
future 8.4
joy 8.4
church 8.3
event 8.3
park 8.2
healthy 8.2
family 8
holiday 7.9
bonnet 7.8
necklace 7.8
eyes 7.7
females 7.6
elegance 7.6
senior 7.5
clothes 7.5
style 7.4
emotion 7.4
makeup 7.3
body 7.2
costume 7.2
world 7.2

Google
created on 2018-03-23

photograph 96
black 95.1
woman 94.4
black and white 91.7
lady 86.3
monochrome photography 85.4
girl 84.1
snapshot 81.8
photography 80.5
vintage clothing 72.2
monochrome 69.4
portrait photography 53.7
human behavior 53.6
family 53.5
portrait 51.4
retro style 50.4

Microsoft
created on 2018-03-23

person 99.9
outdoor 98.5
crowd 0.8

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 26-43
Gender Male, 81.8%
Happy 0.2%
Disgusted 1.9%
Confused 5.7%
Calm 12%
Sad 75.4%
Angry 3.5%
Surprised 1.2%

AWS Rekognition

Age 27-44
Gender Male, 55%
Surprised 4.2%
Confused 4.6%
Calm 55.7%
Sad 15.8%
Happy 8.5%
Disgusted 3%
Angry 8.2%

AWS Rekognition

Age 57-77
Gender Male, 98.8%
Happy 1.3%
Disgusted 0.7%
Confused 1.3%
Calm 87.2%
Sad 6.3%
Angry 2.1%
Surprised 1.1%

Microsoft Cognitive Services

Age 30
Gender Male

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a man and a woman taking a selfie 59.1%
a man and a woman looking at the camera 59%
a man and woman taking a selfie 49.7%