Human Generated Data

Title

Untitled (relief station, Urbana, Ohio)

Date

August 1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1127

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (relief station, Urbana, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

August 1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Hat 99.9
Clothing 99.9
Apparel 99.9
Person 99.4
Human 99.4
Person 99.4
Person 98.3
Accessories 93.2
Glasses 93.2
Accessory 93.2
Hat 84.4
Chef 79.6
Person 77.5
Face 76
Helmet 73.3
Cushion 67.5
Headband 66.7
Icing 65.2
Dessert 65.2
Creme 65.2
Food 65.2
Cake 65.2
Cream 65.2
Turban 62.2
Crowd 59.7

Imagga
created on 2021-12-15

senior 42.2
man 37.6
person 35.4
elderly 33.5
old 28.6
people 28.4
male 27.7
couple 23.5
mature 23.2
portrait 22.6
happy 22.5
grandma 21.4
grandfather 21.3
groom 20.3
adult 19.1
love 18.9
face 18.5
retired 18.4
hat 17.9
retirement 14.4
home 14.4
husband 14.3
smile 14.2
men 13.7
lifestyle 13.7
nurse 13.6
looking 13.6
married 13.4
happiness 13.3
together 13.1
smiling 13
hair 12.7
wife 12.3
look 12.3
women 11.9
aged 11.8
head 11.8
glasses 11.1
grandmother 10.8
older 10.7
hand 10.6
pensioner 10
mother 9.5
marriage 9.5
fan 9.5
sitting 9.4
casual 9.3
health 9
clothing 9
lady 8.9
romantic 8.9
family 8.9
medical 8.8
bonnet 8.7
age 8.6
laughing 8.5
worker 8.4
joy 8.4
camera 8.3
life 8.3
professional 8.2
dress 8.1
closeup 8.1
handsome 8
indoors 7.9
costume 7.9
seniors 7.9
beard 7.8
affection 7.7
pretty 7.7
follower 7.7
patient 7.6
enjoying 7.6
togetherness 7.5
human 7.5
fun 7.5
one 7.5
outdoors 7.5
cheerful 7.3
suit 7.2
to 7.1
work 7.1
day 7.1

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-63
Gender Female, 98.5%
Calm 53%
Happy 39.8%
Confused 2.5%
Sad 1.8%
Surprised 1.4%
Disgusted 1%
Angry 0.3%
Fear 0.2%

AWS Rekognition

Age 35-51
Gender Male, 87.2%
Sad 87.2%
Calm 12%
Happy 0.3%
Angry 0.2%
Confused 0.1%
Fear 0.1%
Surprised 0.1%
Disgusted 0%

Microsoft Cognitive Services

Age 68
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Hat 99.9%
Person 99.4%
Glasses 93.2%
Helmet 73.3%

Captions

Microsoft

a group of people around each other 75.3%
a group of people posing for the camera 75.2%
a group of people sitting on a bus 28.4%