Human Generated Data

Title

Citizens of Zinc, Arkansas, a deserted mining town
Date

1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2985

Human Generated Data

Title

Citizens of Zinc, Arkansas, a deserted mining town

People

Artist: Ben Shahn, American 1898 - 1969

Date

1935

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Apparel 100
Clothing 100
Person 99.8
Human 99.8
Hat 99.8
Person 99.7
Sun Hat 91
Hat 83.6
Cowboy Hat 76.1
Face 57.7

Imagga
created on 2021-12-15

hat 100
cowboy hat 91.3
headdress 81.3
clothing 58.6
sombrero 45.3
person 33.4
people 30.7
portrait 30.4
happy 27.6
man 27.6
consumer goods 27.3
covering 27.2
cowboy 27.2
male 25.5
outdoors 25.4
adult 24.6
face 22.7
senior 22.5
smile 20
smiling 18.1
shirt 17.8
happiness 15.7
western 15.5
straw 15.4
two 15.3
hair 15.1
model 14.8
elderly 14.4
fashion 14.3
human 14.3
attractive 14
couple 13.9
black 13.8
outside 13.7
hand 13.7
pretty 13.3
old 13.2
mature 13
child 13
looking 12.8
horse 12.3
farmer 12.1
fun 12
guy 12
casual 11.9
farm 11.6
summer 11.6
lifestyle 11.6
boy 11.3
one 11.2
style 11.1
beach 11
field 10.9
cowgirl 10.9
cute 10.8
posing 10.7
together 10.5
wearing 10.5
sexy 10.4
men 10.3
expression 10.2
hold 10.2
outdoor 9.9
lady 9.7
rural 9.7
enjoy 9.4
joy 9.2
leisure 9.1
cheerful 8.9
handsome 8.9
kid 8.9
country 8.8
agriculture 8.8
look 8.8
standing 8.7
love 8.7
play 8.6
enjoying 8.5
pair 8.5
dark 8.4
park 8.2
make 8.2
oriental 8.1
brown 8.1
romantic 8
brunette 7.8
sea 7.8
husband 7.6
head 7.6
traditional 7.5
grow 7.5
emotion 7.4
water 7.3
children 7.3
pose 7.3
gorgeous 7.3
fall 7.2
aged 7.2
childhood 7.2
women 7.1

Google
created on 2021-12-15

Photograph 94.2
White 92.2
Hat 90.7
Cap 87.4
Headgear 81.9
Sun hat 81.7
Adaptation 79.5
Tree 75.8
Plant 75.5
Monochrome photography 74.7
Snapshot 74.3
Vintage clothing 72.8
Landscape 72.7
Monochrome 71.8
Collar 68.1
Stock photography 63.6
Photo caption 62.5
Art 60.4
History 60.2
Moustache 59.5

Microsoft
created on 2021-12-15

person 99.2
hat 99.1
text 98.9
fashion accessory 96.5
outdoor 96.3
cowboy hat 92.5
clothing 92.4
fedora 90.7
man 90.6
sun hat 88.5
human face 87.9
black and white 86.1
monochrome 70.9
old 54.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-63
Gender Male, 91.7%
Calm 84.6%
Angry 11.9%
Sad 2.9%
Confused 0.3%
Surprised 0.2%
Happy 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 36-54
Gender Female, 94.3%
Sad 74.1%
Calm 17.9%
Angry 5.5%
Happy 0.6%
Fear 0.6%
Confused 0.5%
Disgusted 0.4%
Surprised 0.3%

Microsoft Cognitive Services

Age 58
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Hat 99.8%

Captions

Microsoft

an old photo of a man 94.7%
a man wearing a hat 92.2%
old photo of a man 92.1%