Human Generated Data

Title

Untitled (father and children)
Date

1910s
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2200

Human Generated Data

Title

Untitled (father and children)

People

Artist: Unidentified Artist,

Date

1910s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Baby 99.1
Human 99.1
Newborn 99.1
Person 99
Person 97.5
Painting 71
Art 71
People 61.9
Photo 61.3
Photography 61.3
Portrait 60.7
Face 60.7
Blanket 57.5

Imagga
created on 2021-12-15

parent 61.2
mother 54.7
child 53.8
father 51.3
family 46.3
dad 44.7
happy 38.9
male 38.6
home 37.5
love 37.1
couple 34
people 33.5
happiness 31.4
baby 31.1
together 30.7
man 30.3
smiling 29.7
son 27.6
daughter 27
grandma 26
kid 24.9
husband 24.4
adult 24
darling 22.2
lifestyle 21
wife 20.9
indoors 20.2
boy 20
senior 19.7
casual 19.5
little 19.5
smile 19.3
loving 19.1
fun 18.7
portrait 18.1
two 17.8
children 17.3
care 17.3
elderly 17.3
holding 16.5
cute 16.5
person 16.3
relationship 15.9
joy 15.9
mature 15.8
face 15.6
sitting 15.5
married 15.4
cheerful 14.7
hug 14.5
groom 14.4
relaxed 14.1
old 14
newborn 13.6
retired 13.6
couch 13.5
brother 13.2
kin 13.1
playing 12.8
mom 12.6
affectionate 12.6
affection 12.6
infant 12.6
bed 12.4
adorable 12
women 11.9
day 11.8
parenthood 11.7
bonding 11.7
childhood 11.7
30s 11.6
kids 11.3
looking 11.2
blond 11.1
caring 10.8
parents 10.8
grandfather 10.6
retirement 10.6
cuddling 9.9
attractive 9.8
embracing 9.8
sofa 9.6
toddler 9.6
play 9.5
enjoying 9.5
expression 9.4
offspring 9.3
domestic 9.3
indoor 9.1
relaxing 9.1
aged 9.1
dress 9
sibling 8.9
hospital 8.9
interior 8.9
medical 8.8
nurse 8.8
living room 8.8
mum 8.8
grandmother 8.8
motherhood 8.8
bride 8.6
life 8.6
youth 8.5
laughing 8.5
pretty 8.4
health 8.3
leisure 8.3
wedding 8.3
joyful 8.3
generations 7.9
pensioner 7.8
40s 7.8
thirties 7.8
two people 7.8
older 7.8
mid adult 7.7
illness 7.6
studio 7.6
marriage 7.6
living 7.6
healthy 7.6
pair 7.6
togetherness 7.6
horizontal 7.5
house 7.5
friends 7.5
room 7.3
color 7.2
patient 7.2
romance 7.2

Google
created on 2021-12-15

Hair 98.4
Photograph 94.2
Tie 87.9
Gesture 85.3
Adaptation 79.2
Snapshot 74.3
Vintage clothing 73.1
Formal wear 72.4
Child 71
Classic 70.4
Suit 70.3
Sitting 68.3
Event 67.2
Room 65.8
Stock photography 63.8
Art 63.3
Baby 62.6
Photo caption 59.4
Lap 58.9
Happy 57.6

Microsoft
created on 2021-12-15

person 99.8
baby 98.1
human face 97.2
toddler 94.3
clothing 90.4
text 77.1
child 50.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 1-7
Gender Female, 83.8%
Calm 58.7%
Sad 39.9%
Angry 0.4%
Confused 0.3%
Surprised 0.3%
Disgusted 0.1%
Happy 0.1%
Fear 0.1%

AWS Rekognition

Age 43-61
Gender Male, 93.8%
Calm 90.4%
Sad 4.2%
Happy 2.1%
Surprised 1.4%
Confused 0.9%
Angry 0.5%
Fear 0.3%
Disgusted 0.2%

Microsoft Cognitive Services

Age 6
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Painting 71%

Captions

Microsoft

an old photo of a boy 79.6%
old photo of a boy 73%
an old photo of a person 72.9%