Human Generated Data

Title

Untitled (woman with two children)
Date

c. 1920
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.690

Human Generated Data

Title

Untitled (woman with two children)

People

Artist: Martin Schweig, American 20th century

Date

c. 1920

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 98.6
Human 98.6
Person 97.6
Clothing 95.9
Apparel 95.9
Person 93.3
Door 86.7
Baby 85.4
Face 83.8
People 77.3
Female 74.9
Flooring 70.1
Portrait 67.6
Photography 67.6
Photo 67.6
Kid 61.9
Child 61.9
Woman 60
Pants 58.3
Cabinet 56.5
Furniture 56.5
Hair 56.2

Imagga
created on 2022-01-08

kin 51.3
mother 45.5
family 45.4
parent 39.6
home 39.1
happy 37.6
father 35.4
child 35.1
male 35
people 34.6
man 33.6
couple 31.4
love 30.8
grandma 27.7
happiness 26.7
smiling 24.6
together 24.5
adult 23.3
portrait 23.3
daughter 22.5
kid 22.2
husband 22
smile 21.4
son 20.6
dad 20.6
person 19.4
indoors 19.3
casual 18.6
joy 18.4
boy 18.3
wife 17.1
two 16.9
baby 16.5
married 16.3
childhood 16.1
lifestyle 15.9
couch 15.5
looking 15.2
senior 15
old 14.6
grandfather 14.6
children 14.6
lady 13.8
room 13.8
sitting 13.7
dress 13.6
face 13.5
fun 13.5
house 13.4
cheerful 13
cute 12.9
interior 12.4
brother 12.1
human 12
blond 12
groom 11.9
attractive 11.9
holding 11.6
elderly 11.5
loving 11.5
bed 11.4
relationship 11.2
day 11
retired 10.7
little 10.6
bride 10.6
sofa 10.5
standing 10.4
togetherness 10.4
women 10.3
playing 10
two people 9.7
clothing 9.5
laughing 9.5
wedding 9.2
leisure 9.1
indoor 9.1
girls 9.1
domestic 9.1
relaxing 9.1
grandmother 8.8
parents 8.8
life 8.7
men 8.6
expression 8.5
relaxed 8.5
pretty 8.4
camera 8.3
joyful 8.3
care 8.2
aged 8.2
handsome 8
romantic 8
holiday 7.9
affectionate 7.7
30s 7.7
youth 7.7
studio 7.6
bouquet 7.6
mature 7.4
sibling 7.4
color 7.2
celebration 7.2

Google
created on 2022-01-08

Picture frame 82.2
Baby 78.9
People 78.4
Art 77.5
Tints and shades 74.7
Vintage clothing 72.2
Toddler 71.6
Monochrome photography 67.7
Room 67.3
Monochrome 66.8
Event 64.9
Stock photography 63.9
Visual arts 62.5
Sitting 60.7
Door 58.8
Painting 56.2
Child 55.6
Portrait 53.5
Classic 52.3
Family 51

Microsoft
created on 2022-01-08

wall 99.7
baby 99.3
human face 98.3
toddler 98.2
text 98.2
clothing 97.5
indoor 97.4
person 97.3
smile 91.9
child 83.8
standing 79.4
posing 75.1
boy 60.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-6
Gender Male, 73.8%
Calm 89.7%
Confused 5.3%
Disgusted 2.3%
Surprised 1.5%
Angry 0.4%
Sad 0.4%
Fear 0.2%
Happy 0.2%

AWS Rekognition

Age 0-3
Gender Female, 79.8%
Calm 99.8%
Angry 0%
Sad 0%
Surprised 0%
Confused 0%
Disgusted 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 22-30
Gender Female, 100%
Calm 98.5%
Confused 0.7%
Angry 0.4%
Sad 0.1%
Disgusted 0.1%
Happy 0.1%
Surprised 0.1%
Fear 0.1%

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 1
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%

Captions

Microsoft

a person standing in front of a mirror posing for the camera 89.8%
a person that is standing in front of a mirror posing for the camera 85%
a man and woman standing in front of a mirror posing for the camera 75.9%

Text analysis

Google

St.
St.