Human Generated Data

Title

Waiting for relief commodities, Urbana, Ohio

Date

1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3032

Human Generated Data

Title

Waiting for relief commodities, Urbana, Ohio

People

Artist: Ben Shahn, American 1898 - 1969

Date

1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Clothing 100
Apparel 100
Hat 100
Hat 99.8
Human 99.4
Person 99.4
Hat 99.1
Hat 98.9
Person 98.9
Sun Hat 98.6
Hat 97.3
Person 93.4
Hat 93
Hat 83.6
Cap 58.8
Cowboy Hat 55.2

Imagga
created on 2021-12-15

hat 45.3
child 30.2
headdress 28.9
clothing 28.8
cowboy hat 25
happy 23.8
love 23.7
people 21.7
happiness 19.6
adult 18.8
dress 18.1
smiling 17.4
covering 17.3
cute 17.2
person 17.2
wedding 16.5
bride 16.3
smile 15.7
portrait 15.5
consumer goods 15.2
male 15.1
outdoors 14.9
couple 14.8
two 14.4
family 14.2
day 14.1
pretty 14
groom 13.7
childhood 13.4
romance 13.4
romantic 13.4
kid 13.3
attractive 13.3
together 13.1
man 12.9
marriage 12.3
boy 12.2
home 12
celebration 12
women 11.9
blond 11.8
mother 11.8
summer 11.6
outdoor 11.5
face 11.4
fun 11.2
girls 10.9
lifestyle 10.8
holiday 10.7
park 10.7
children 10
bonnet 9.9
cheerful 9.8
lady 9.7
bouquet 9.6
married 9.6
sitting 9.4
old 9.1
religion 9
little 8.8
flowers 8.7
baby 8.6
parent 8.6
gift 8.6
youth 8.5
flower 8.5
life 8.4
joy 8.4
fashion 8.3
decoration 8.3
hair 7.9
colorful 7.9
outside 7.7
father 7.7
adults 7.6
house 7.5
religious 7.5
traditional 7.5
container 7.4
closeup 7.4
brassiere 7.3
playing 7.3
grass 7.1
daughter 7.1

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

hat 99.6
fashion accessory 98.6
person 97.4
text 95.4
clothing 93.9
sun hat 89.8
fedora 89.6
black and white 84.3
cowboy hat 77.2
man 62.5
human face 62.1

Face analysis

Amazon

Google

AWS Rekognition

Age 29-45
Gender Male, 85.9%
Calm 98.1%
Sad 0.8%
Angry 0.6%
Fear 0.2%
Happy 0.1%
Surprised 0.1%
Disgusted 0%
Confused 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Hat 100%
Person 99.4%

Captions

Microsoft

a group of people looking at a teddy bear 53.3%
a group of people standing next to a teddy bear 53.2%
a group of people sitting next to a teddy bear 53.1%