Human Generated Data

Title

Family on relief, Lancaster, Ohio

Date

1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3020

Human Generated Data

Title

Family on relief, Lancaster, Ohio

People

Artist: Ben Shahn, American 1898 - 1969

Date

1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Human 98.6
Person 98.6
Face 90.5
Banister 90.1
Handrail 90.1
Baby 86
Female 79.5
Girl 67.7
Clothing 66.9
Apparel 66.9
Shorts 66.9
Portrait 62.9
Photography 62.9
Photo 62.9
Railing 62.1
Child 60.8
Kid 60.8
Sitting 58.6
Brick 58.3
Woman 57.6
Teen 55.2

Imagga
created on 2021-12-15

parent 35.9
mother 33.9
portrait 24.6
people 23.4
man 22.2
adult 21.5
male 19.8
sexy 18.5
love 18.2
fashion 18.1
child 17.7
father 17.7
dad 17.4
happy 16.9
black 16.8
couple 16.6
person 16.2
pretty 16.1
attractive 16.1
happiness 15.7
model 15.6
park bench 15.1
one 14.9
lifestyle 14.5
bench 14.1
world 13.7
dress 13.6
face 13.5
hair 13.5
joy 13.4
sibling 13.1
outdoor 13
lady 13
swing 12.9
sitting 12.9
body 12.8
youth 12.8
human 12.8
fun 12
outdoors 11.9
smile 11.4
looking 11.2
women 11.1
seat 11
kin 11
sensuality 10.9
family 10.7
plaything 10.6
cheerful 10.6
mechanical device 10.5
stringed instrument 10.4
smiling 10.1
holding 9.9
romance 9.8
romantic 9.8
posing 9.8
scholar 9.7
bride 9.6
married 9.6
musical instrument 9.4
cute 9.3
park 9.1
summer 9
boy 8.7
day 8.6
two 8.5
enjoy 8.5
skin 8.5
wedding 8.3
makeup 8.2
gorgeous 8.2
furniture 7.8
mechanism 7.8
sepia 7.8
intellectual 7.7
casual 7.6
marriage 7.6
relax 7.6
head 7.6
relaxation 7.5
passion 7.5
traditional 7.5
sport 7.4
banjo 7.4
joyful 7.4
teenager 7.3
sensual 7.3
art 7.2
together 7

Microsoft
created on 2021-12-15

text 99.5
person 98.7
sitting 97.9
clothing 95.9
human face 92.3
window 80.2
black and white 66.4
child 65
smile 61.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Female, 60.4%
Calm 54.9%
Happy 33.7%
Disgusted 2.8%
Angry 2.5%
Surprised 2.5%
Sad 2.2%
Confused 0.7%
Fear 0.6%

AWS Rekognition

Age 0-3
Gender Female, 68.5%
Surprised 74%
Fear 14.5%
Calm 9.9%
Disgusted 0.7%
Confused 0.3%
Angry 0.3%
Happy 0.2%
Sad 0.1%

Microsoft Cognitive Services

Age 40
Gender Female

Microsoft Cognitive Services

Age 0
Gender Male

Google Vision

Surprise Unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%

Captions

Microsoft

a person sitting on a bench in front of a window 83.5%
a person sitting on a bench 83.4%
a person sitting on a bench in front of a window 83.3%

Text analysis

Amazon

PL