Human Generated Data

Title

Untitled (Judith Shahn, New York City)

Date

1934-1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.194

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Judith Shahn, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1934-1935

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Clothing 100
Apparel 100
Person 99.7
Human 99.7
Hat 97.6
Bonnet 92.8
Wood 73.6
Cap 72.6
Coat 65.4
Beanie 65.3
Face 64.3
Sun Hat 56.4
Overcoat 56.1

Imagga
created on 2021-12-15

person 27.8
portrait 25.9
man 23.5
people 23.4
black 19.8
adult 19.4
male 18.2
child 17.8
hat 17.5
wall 17.1
face 14.9
world 14.8
attractive 14
fashion 13.6
human 13.5
one 13.4
youth 12.8
casual 12.7
hair 12.7
pretty 12.6
brick 12.4
clothing 11.4
uniform 11.3
happy 11.3
sexy 11.2
cute 10.8
device 10.3
sitting 10.3
culture 10.2
lifestyle 10.1
teen 10.1
performer 9.8
urban 9.6
comedian 9.6
model 9.3
alone 9.1
looking 8.8
happiness 8.6
men 8.6
headdress 8.6
hand 8.4
city 8.3
street 8.3
teenager 8.2
danger 8.2
style 8.2
posing 8
musical instrument 7.9
boy 7.8
eyes 7.7
mask 7.7
outdoor 7.6
serious 7.6
wind instrument 7.5
leisure 7.5
dirty 7.2
smile 7.1
women 7.1
love 7.1
modern 7

Google
created on 2021-12-15

Smile 93.5
Hat 90.2
Style 83.8
Black-and-white 83.4
Headgear 82.5
Sun hat 79.1
Tints and shades 77.4
Vintage clothing 76.2
Child 74.5
Cap 74.2
Monochrome photography 74.1
Wood 73.1
Monochrome 72.4
Art 71.5
Fedora 70.4
Happy 68.5
Room 66.9
Toddler 65.4
Rectangle 64.3
Sitting 64.1

Microsoft
created on 2021-12-15

building 99.8
outdoor 99.5
person 97.3
human face 95.7
clothing 95.6
text 90.5
black and white 72.1
smile 57.2
hat 50.8
old 48.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 5-15
Gender Male, 84.9%
Happy 98.1%
Calm 1.2%
Surprised 0.2%
Sad 0.2%
Angry 0.1%
Fear 0.1%
Confused 0.1%
Disgusted 0%

Microsoft Cognitive Services

Age 7
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Hat 97.6%

Captions

Microsoft

a person wearing a hat and sunglasses sitting on a bench 57.1%
a person wearing a hat sitting on a bench 57%
a person sitting on a bench wearing a hat 56.9%