Human Generated Data

Title

Untitled (Zinc, Arkansas)

Date

October 1935, printed later

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3457

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Zinc, Arkansas)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Clothing 100
Apparel 100
Person 99.6
Human 99.6
Person 99.4
Person 99
Person 92
Hat 91.2
Sun Hat 87.3
Sunglasses 86.9
Accessories 86.9
Accessory 86.9
Cowboy Hat 75.2
Pants 56.5

Imagga
created on 2021-12-15

barbershop 38
shop 32.2
man 24.8
mercantile establishment 24
kin 23.9
people 23.4
military uniform 20.9
adult 20
person 19.1
clothing 18.7
male 17.8
uniform 17
portrait 16.8
place of business 16
love 15
black 13.8
happiness 13.3
happy 13.2
couple 13.1
face 12.8
human 12.7
men 12
looking 12
one 11.9
sepia 11.7
vintage 11.6
lifestyle 11.6
bride 11.5
parent 11.3
hair 11.1
casual 11
world 10.9
smile 10.7
family 10.7
old 10.4
father 9.4
covering 9.4
dad 9.3
head 9.2
consumer goods 9.2
girls 9.1
pretty 9.1
mother 9
dress 9
sexy 8.8
home 8.8
smiling 8.7
child 8.7
statue 8.6
business 8.5
passenger 8.3
fashion 8.3
wedding 8.3
outdoors 8.2
lady 8.1
establishment 8
model 7.8
two 7.6
bouquet 7.5
joy 7.5
city 7.5
retro 7.4
history 7.2
art 7.2
posing 7.1
summer 7.1
day 7.1

Microsoft
created on 2021-12-15

clothing 98.2
outdoor 97.6
text 97.3
man 93.8
person 91.3
window 88.7
store 52.8
hat 51.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 39-57
Gender Male, 97.8%
Angry 91.2%
Calm 7.7%
Confused 0.3%
Surprised 0.3%
Disgusted 0.2%
Sad 0.2%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 38-56
Gender Male, 96.8%
Calm 99.2%
Surprised 0.2%
Angry 0.2%
Sad 0.2%
Disgusted 0.1%
Happy 0.1%
Confused 0%
Fear 0%

AWS Rekognition

Age 36-52
Gender Male, 99.9%
Calm 98.6%
Angry 0.4%
Confused 0.3%
Sad 0.2%
Disgusted 0.2%
Happy 0.2%
Surprised 0.1%
Fear 0%

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 51
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Hat 91.2%
Sunglasses 86.9%

Captions

Microsoft

a group of people standing in front of a store window 86.4%
a group of people in front of a store window 85.7%
a group of people sitting in front of a store window 79.3%

Text analysis

Amazon

STORE
STAR
GENERAL

Google

GENERAL
STAR
GENERAL STAR STORE
STORE