Human Generated Data

Title

Untitled (man with hats, Barclay and Stylepart: Philadelphia, Pennsylvania)
Date

1939, printed later
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.246
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man with hats, Barclay and Stylepart: Philadelphia, Pennsylvania)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1939, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Apparel 100
Clothing 100
Hat 99.6
Hat 98.6
Human 93.9
Person 93.9
Sun Hat 93.9
Person 93.8
Accessory 83.4
Accessories 83.4
Tie 83.4
Cowboy Hat 73.5
Overcoat 72.8
Coat 72.8
Suit 67.5
Hat 64.7

Imagga
created on 2022-01-08

salon 43.3
person 25.5
adult 24.7
sexy 23.3
attractive 23.1
people 21.8
clothing 21.5
home 20.7
portrait 20.7
black 19.2
man 18.8
happy 17.5
women 17.4
hat 16.9
pretty 16.8
couple 16.6
fashion 15.8
two 15.2
male 15.2
interior 15
face 14.2
style 14.1
cheerful 13.8
lady 13.8
hair 13.5
love 13.4
model 13.2
lifestyle 13
room 12.8
cowboy hat 12.8
sensual 12.7
kitchen 12.5
brassiere 12.5
romantic 12.5
indoors 12.3
standing 12.2
smile 12.1
body 12
one 11.9
youth 11.9
happiness 11.8
consumer goods 11.6
smiling 11.6
covering 11.5
sitting 11.2
indoor 11
hugging 10.7
holding 10.7
20s 10.1
blond 9.9
handsome 9.8
business 9.7
sexual 9.6
brunette 9.6
relationship 9.4
woman's clothing 9.2
undergarment 9.2
retro 9
headdress 8.8
together 8.8
bedroom 8.7
bride 8.6
cute 8.6
casual 8.5
vintage 8.4
lingerie 8.2
sensuality 8.2
pose 8.2
dress 8.1
posing 8
garment 7.9
intimacy 7.9
look 7.9
professional 7.8
men 7.7
mother 7.6
wife 7.6
elegance 7.6
drink 7.5
leisure 7.5
waiter 7.3
make 7.3
gorgeous 7.3
looking 7.2
domestic 7.1

Google
created on 2022-01-08

Hat 92.8
Fedora 84.7
Black-and-white 84.3
Style 84
Sun hat 81.2
Monochrome photography 74.9
Monochrome 74
Vintage clothing 66.8
Room 65
Event 64.6
Stock photography 63.3
Fashion accessory 61.9
Still life photography 59.3
Art 58.4
Sitting 57.3
Movie 53.2
Conversation 51.5
Cowboy hat 51.2
Music 51.1

Microsoft
created on 2022-01-08

hat 99.1
fashion accessory 97.2
person 95.8
fedora 93.8
clothing 93.4
cowboy hat 87.4
text 87.3
man 76.9
black and white 69.9
sun hat 60.1
old 49.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-46
Gender Male, 99.9%
Calm 98.1%
Confused 0.5%
Happy 0.3%
Surprised 0.2%
Angry 0.2%
Disgusted 0.2%
Sad 0.2%
Fear 0.2%

AWS Rekognition

Age 45-53
Gender Male, 99.8%
Angry 57.1%
Calm 25.9%
Sad 7.7%
Confused 3.2%
Fear 2.2%
Surprised 1.9%
Happy 1%
Disgusted 1%

Microsoft Cognitive Services

Age 49
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Hat 99.6%
Person 93.9%
Tie 83.4%
Suit 67.5%

Captions

Microsoft

an old photo of a person 83.5%
a person wearing a hat 78%
old photo of a person 77.9%

Text analysis

Amazon

HATS
EPARK HATS
EPARK

Google

LEPARK HATS
HATS
LEPARK