Human Generated Data

Title

Spectator at county fair in central Ohio
Date

1938
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3036

Human Generated Data

Title

Spectator at county fair in central Ohio

People

Artist: Ben Shahn, American 1898 - 1969

Date

1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Apparel 100
Clothing 100
Hat 99.8
Person 99.7
Human 99.7
Hat 99.6
Person 99.5
Accessories 95.7
Accessory 95.7
Glasses 95.7
Sun Hat 95.1
Face 82.3
Undershirt 75.1
Cowboy Hat 65.1
Finger 60.6
Beard 57.1

Imagga
created on 2021-12-15

man 32.3
male 28.6
grandfather 28.5
people 23.4
statue 21
portrait 20.7
hat 18.5
person 18.3
old 18.1
sculpture 16.5
adult 16.2
outdoors 15.7
face 15.6
uniform 15.3
men 14.6
happy 14.4
father 14.3
dad 14.3
clothing 13.6
day 13.3
parent 12.9
head 12.6
child 12.2
black 12
human 12
art 11.8
smiling 11.6
helmet 11.3
lifestyle 10.8
outdoor 10.7
smile 10.7
one 10.5
gun 10.3
happiness 10.2
weapon 10
sky 9.6
ancient 9.5
world 9.4
hand 9.1
summer 9
history 8.9
military uniform 8.8
soldier 8.8
architecture 8.6
casual 8.5
sport 8.5
senior 8.4
pretty 8.4
covering 8.4
leisure 8.3
headdress 8.2
cowboy hat 8.1
building 8
grass 7.9
guard 7.8
marble 7.7
war 7.7
stone 7.6
two 7.6
vintage 7.4
cheerful 7.3
religion 7.2
family 7.1
love 7.1
look 7

Google
created on 2021-12-15

Photograph 94.1
Hat 93.2
Sun hat 88.3
Gesture 85.3
Style 84
Black-and-white 83.8
Fedora 83.8
Cool 81.6
Happy 80.2
Eyewear 79.8
Adaptation 79.2
Vintage clothing 76.3
Monochrome photography 72.6
Tree 72.2
Monochrome 71.7
Photo caption 71.1
Moustache 67.2
Fashion accessory 66.7
Cap 65.7
Event 65.4

Microsoft
created on 2021-12-15

person 99.9
fashion accessory 99
man 97.8
outdoor 97.7
fedora 96.5
sun hat 96.5
human face 95.4
cowboy hat 95
clothing 90.7
black and white 83.8
military uniform 83
text 80.1
hat 72.1
glasses 66
monochrome 60.2
smile 51.2
helmet 20.5
crowd 0.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-66
Gender Male, 92.7%
Calm 60.7%
Happy 38.1%
Disgusted 0.5%
Sad 0.4%
Angry 0.1%
Confused 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 39-57
Gender Male, 99.4%
Calm 78.7%
Happy 19.3%
Surprised 1.2%
Angry 0.2%
Sad 0.2%
Confused 0.2%
Disgusted 0.1%
Fear 0.1%

Microsoft Cognitive Services

Age 69
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Hat 99.8%
Person 99.7%
Glasses 95.7%

Captions

Microsoft

a man wearing a hat 97.2%
an old photo of a man wearing a hat 95.8%
a man wearing a uniform and a hat 95.7%