Human Generated Data

Title

Untitled (woman in plaid suit, holding infant, seated)

Date

c. 1940

People

Artist: Michael Disfarmer, American 1884 - 1959

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Susan and Neal Yanofsky, 2007.285

Human Generated Data

Title

Untitled (woman in plaid suit, holding infant, seated)

People

Artist: Michael Disfarmer, American 1884 - 1959

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Human 98.6
Newborn 98.6
Baby 98.6
Person 98
Person 91.1
Face 84.9
Female 77.6
Photo 74.3
Portrait 74.3
Photography 74.3
Apparel 67.5
Clothing 67.5
People 67.1
Woman 60.2
Sitting 58.7

Imagga
created on 2022-03-05

mother 55.6
child 44.7
parent 43.8
home 31.9
family 30.3
people 30.1
daughter 29.5
happy 27.6
adult 26.6
male 26.1
grandma 25
portrait 24.6
smiling 23.2
person 21.4
happiness 20.4
indoors 20.2
baby 19.9
man 19.5
kid 18.6
love 18.2
casual 17.8
smile 17.1
face 16.3
interior 15.9
room 15.8
cute 15.8
couple 15.7
son 15.6
lifestyle 15.2
father 14.6
children 14.6
dress 14.5
clothing 14.3
old 13.9
sitting 13.7
childhood 13.4
together 13.1
senior 13.1
fun 12.7
brother 12.3
cheerful 12.2
mature 12.1
looking 12
domestic 12
blond 11.9
women 11.9
house 11.7
boy 11.3
one 11.2
attractive 11.2
color 11.1
indoor 11
leisure 10.8
holding 10.7
retired 10.7
couch 10.6
alone 10
joy 10
pretty 9.8
dad 9.8
two people 9.7
little 9.7
life 9.7
groom 9.6
husband 9.5
day 9.4
playing 9.1
girls 9.1
care 9.1
aged 9.1
human 9
grandmother 8.8
vertical 8.7
infant 8.7
bride 8.6
married 8.6
elderly 8.6
sofa 8.6
loving 8.6
nurse 8.4
studio 8.4
hand 8.4
camera 8.3
wedding 8.3
lady 8.1
black 7.9
brunette 7.8
model 7.8
expression 7.7
teenage 7.7
health 7.6
wife 7.6
living 7.6
fashion 7.5
pink 7.5
teen 7.4
offspring 7.3
relaxing 7.3
sexy 7.2
computer 7.2
patient 7

Google
created on 2022-03-05

Smile 88.5
Baby 79.2
Art 77.7
Toddler 76.5
Vintage clothing 75.4
Sitting 66.8
Lap 59.9
Child 59.7
Retro style 57.6
Room 54.9
Portrait 52.8
Family 50.5

Microsoft
created on 2022-03-05

human face 99.3
clothing 98.9
person 98.6
baby 98.5
text 98
wall 97.5
smile 96.9
toddler 95.1
old 93.4
black 74.4
woman 71.5
vintage 65.2
picture frame 6.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-14
Gender Female, 96.8%
Happy 88.6%
Confused 5.3%
Disgusted 3.5%
Angry 0.7%
Sad 0.6%
Surprised 0.5%
Calm 0.5%
Fear 0.3%

AWS Rekognition

Age 0-3
Gender Female, 61.8%
Surprised 96.1%
Confused 1.9%
Fear 0.8%
Calm 0.5%
Disgusted 0.3%
Angry 0.2%
Happy 0.1%
Sad 0.1%

Microsoft Cognitive Services

Age 22
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98%

Captions

Microsoft

a vintage photo of a person 85.7%
a vintage photo of a person sitting in front of a window 69.8%
a vintage photo of an old woman sitting in front of a window 69.7%