Human Generated Data

Title

Untitled (father playing with baby, girl looks on)

Date

c. 1950, printed later

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.166

Human Generated Data

Title

Untitled (father playing with baby, girl looks on)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.6
Person 99.6
Person 99.5
Person 97
Baby 93.6
Newborn 93.6
Furniture 76.7
Face 75.3
Female 64.6
Finger 61.6
People 61.3
Bed 59.2
Portrait 56.9
Photo 56.9
Photography 56.9
Couch 55.1

Imagga
created on 2022-01-23

nurse 43.7
man 37.6
person 31.2
people 30.7
home 30.3
male 28.9
adult 28.4
happy 26.3
couple 26.1
child 23.9
patient 21.9
family 21.4
happiness 21.2
portrait 20.1
mother 19
love 18.9
smiling 18.1
father 17
indoors 16.7
room 16.1
smile 15.7
couch 15.5
hospital 14.8
lifestyle 13.7
house 13.4
together 13.1
sitting 12.9
kid 12.4
loving 12.4
face 12.1
men 12
pretty 11.9
indoor 11.9
groom 11.7
husband 11.6
care 11.5
medical 11.5
cheerful 11.4
kin 11.4
boy 11.3
dad 11.2
health 11.1
daughter 11.1
holding 10.7
clothing 10.6
interior 10.6
parent 10.5
bed 10.4
adults 10.4
senior 10.3
grandfather 10.3
relationship 10.3
women 10.3
mature 10.2
two 10.2
20s 10.1
children 10
attractive 9.8
bathrobe 9.8
two people 9.7
brunette 9.6
females 9.5
case 9.3
aged 9.1
lady 8.9
son 8.9
sexy 8.8
looking 8.8
affectionate 8.7
30s 8.7
bride 8.6
elderly 8.6
casual 8.5
doctor 8.5
sick person 8.4
grandma 8.4
wedding 8.3
fun 8.2
stethoscope 8.2
caring 7.9
professional 7.8
standing 7.8
half length 7.8
sick 7.7
sofa 7.7
old 7.7
comfortable 7.6
wife 7.6
enjoying 7.6
relaxation 7.5
occupation 7.3
life 7.3
relaxing 7.3
cup 7.2
brother 7.2
handsome 7.1
romantic 7.1
to 7.1

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

wall 98.5
person 97.1
baby 95.4
human face 95.1
clothing 94.2
smile 85.1
text 79.8
toddler 78.1
woman 70
black and white 58.6
posing 55.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-3
Gender Female, 97.8%
Calm 42%
Surprised 30.6%
Happy 19.3%
Angry 3.7%
Disgusted 2%
Confused 1%
Sad 0.7%
Fear 0.6%

AWS Rekognition

Age 2-10
Gender Male, 89.6%
Sad 75.2%
Calm 12.6%
Fear 9%
Surprised 0.8%
Confused 0.7%
Disgusted 0.7%
Happy 0.5%
Angry 0.4%

AWS Rekognition

Age 6-16
Gender Male, 50.3%
Calm 84.4%
Fear 8.1%
Sad 4.2%
Disgusted 1.1%
Confused 0.9%
Angry 0.5%
Surprised 0.5%
Happy 0.4%

Microsoft Cognitive Services

Age 6
Gender Male

Microsoft Cognitive Services

Age 0
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a group of people posing for a photo 90.4%
a group of people posing for the camera 90.3%
a group of people posing for a picture 90.2%