Human Generated Data

Title

Untitled (Zinc, Arkansas)

Date

October 1935, printed later

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3457

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Zinc, Arkansas)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3457

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Apparel 100
Clothing 100
Person 99.6
Human 99.6
Person 99.4
Person 99
Person 92
Hat 91.2
Sun Hat 87.3
Sunglasses 86.9
Accessory 86.9
Accessories 86.9
Cowboy Hat 75.2
Pants 56.5

Clarifai
created on 2023-10-25

people 99.9
group together 98.2
adult 97.6
man 96.7
group 95.1
soldier 95
portrait 94.8
military 94.2
lid 93.5
war 93
street 92.7
uniform 92.6
wear 92.4
three 91.8
outfit 91.5
administration 90.2
two 89.9
veil 89.7
monochrome 86.8
boy 85.1

Imagga
created on 2021-12-15

barbershop 38
shop 32.2
man 24.8
mercantile establishment 24
kin 23.9
people 23.4
military uniform 20.9
adult 20
person 19.1
clothing 18.7
male 17.8
uniform 17
portrait 16.8
place of business 16
love 15
black 13.8
happiness 13.3
happy 13.2
couple 13.1
face 12.8
human 12.7
men 12
looking 12
one 11.9
sepia 11.7
vintage 11.6
lifestyle 11.6
bride 11.5
parent 11.3
hair 11.1
casual 11
world 10.9
smile 10.7
family 10.7
old 10.4
father 9.4
covering 9.4
dad 9.3
head 9.2
consumer goods 9.2
girls 9.1
pretty 9.1
mother 9
dress 9
sexy 8.8
home 8.8
smiling 8.7
child 8.7
statue 8.6
business 8.5
passenger 8.3
fashion 8.3
wedding 8.3
outdoors 8.2
lady 8.1
establishment 8
model 7.8
two 7.6
bouquet 7.5
joy 7.5
city 7.5
retro 7.4
history 7.2
art 7.2
posing 7.1
summer 7.1
day 7.1

Microsoft
created on 2021-12-15

clothing 98.2
outdoor 97.6
text 97.3
man 93.8
person 91.3
window 88.7
store 52.8
hat 51.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 39-57
Gender Male, 97.8%
Angry 91.2%
Calm 7.7%
Confused 0.3%
Surprised 0.3%
Disgusted 0.2%
Sad 0.2%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 38-56
Gender Male, 96.8%
Calm 99.2%
Surprised 0.2%
Angry 0.2%
Sad 0.2%
Disgusted 0.1%
Happy 0.1%
Confused 0%
Fear 0%

AWS Rekognition

Age 36-52
Gender Male, 99.9%
Calm 98.6%
Angry 0.4%
Confused 0.3%
Sad 0.2%
Disgusted 0.2%
Happy 0.2%
Surprised 0.1%
Fear 0%

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 51
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Hat 91.2%
Sunglasses 86.9%

Categories

Text analysis

Amazon

STORE
STAR
GENERAL

Google

GENERAL STAR STORE
STAR
GENERAL
STORE