Human Generated Data

Title

Dwellers in Circleville's "Hooverville," central Ohio

Date

1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3010

Human Generated Data

Title

Dwellers in Circleville's "Hooverville," central Ohio

People

Artist: Ben Shahn, American 1898 - 1969

Date

1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Apparel 99.8
Clothing 99.8
Hat 99.8
Person 99.7
Human 99.7
Person 99.6
Person 92.5
Face 89.7
Sleeve 69.6
Home Decor 60.2
Finger 60.1
Photography 59.2
Photo 59.2
Sphere 55.2

Imagga
created on 2021-12-15

beach 49.2
hat 42.9
sand 40.3
vacation 38.5
sea 35.2
man 33.6
summer 30.9
person 27.1
people 26.2
ocean 25.8
water 25.4
male 24.8
child 23.6
headdress 22.5
sky 21
cowboy hat 21
happy 19.4
outdoors 19.4
holiday 19.3
travel 19
coast 18.9
sun 18.5
clothing 18.4
lifestyle 18.1
outdoor 17.6
happiness 16.5
relax 16
sombrero 15.8
couple 15.7
fun 15
shore 14.9
adult 14.2
coastline 14.1
rustic 13.7
tropical 13.6
love 13.4
walking 13.3
portrait 12.9
smiling 12.3
two 11.9
relaxation 11.7
leisure 11.6
paradise 11.3
play 11.2
joy 10.9
tourist 10.8
active 10.8
sandy 10.7
landscape 10.4
senior 10.3
sitting 10.3
healthy 10.1
alone 10
smile 10
tourism 9.9
together 9.6
sexy 9.6
sunny 9.5
day 9.4
outside 9.4
resort 9.4
covering 9.3
island 9.2
playing 9.1
attractive 9.1
family 8.9
oriental 8.9
kid 8.9
farmer 8.8
consumer goods 8.8
wave 8.6
peaceful 8.2
girls 8.2
horizon 8.1
looking 8
hair 7.9
women 7.9
cute 7.9
men 7.7
pretty 7.7
hiking 7.7
father 7.7
youth 7.7
walk 7.6
hot 7.5
enjoy 7.5
sensual 7.3
childhood 7.2
sunlight 7.1
little 7.1
season 7

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

person 98.7
ground 98.1
outdoor 97.7
human face 97.7
clothing 96.8
text 95.2
hat 91.4
fashion accessory 83.3
smile 72.9
old 70.3
man 63.8
sun hat 57.3
photograph 54.8
cowboy hat 54.6
boy 52.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 8-18
Gender Male, 75.6%
Calm 35.5%
Sad 32.2%
Angry 22.6%
Fear 5%
Confused 3.3%
Happy 0.7%
Surprised 0.4%
Disgusted 0.3%

AWS Rekognition

Age 7-17
Gender Female, 73.9%
Angry 52.2%
Calm 18.2%
Disgusted 17.4%
Sad 6.3%
Happy 2%
Confused 1.7%
Fear 1.6%
Surprised 0.7%

Microsoft Cognitive Services

Age 25
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Feature analysis

Amazon

Hat 99.8%
Person 99.7%

Captions

Microsoft

an old photo of a person 87.2%
a person posing for the camera 87.1%
a person standing posing for the camera 87%