Human Generated Data

Title

Untitled (father playing with baby, girl looks on)

Date

c. 1950, printed later

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.166

Human Generated Data

Title

Untitled (father playing with baby, girl looks on)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.166

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.6
Person 99.6
Person 99.5
Person 97
Newborn 93.6
Baby 93.6
Furniture 76.7
Face 75.3
Female 64.6
Finger 61.6
People 61.3
Bed 59.2
Portrait 56.9
Photography 56.9
Photo 56.9
Couch 55.1

Clarifai
created on 2023-10-26

people 99.8
son 99.3
portrait 99.2
family 99.1
child 99
man 98.3
group 98.2
collage 97.8
two 97.8
three 97.3
woman 97.2
couple 96.5
affection 95.4
monochrome 95.1
baby 95.1
adult 94.9
girl 94.7
offspring 94.5
sepia 93.3
four 92.3

Imagga
created on 2022-01-23

nurse 43.7
man 37.6
person 31.2
people 30.7
home 30.3
male 28.9
adult 28.4
happy 26.3
couple 26.1
child 23.9
patient 21.9
family 21.4
happiness 21.2
portrait 20.1
mother 19
love 18.9
smiling 18.1
father 17
indoors 16.7
room 16.1
smile 15.7
couch 15.5
hospital 14.8
lifestyle 13.7
house 13.4
together 13.1
sitting 12.9
kid 12.4
loving 12.4
face 12.1
men 12
pretty 11.9
indoor 11.9
groom 11.7
husband 11.6
care 11.5
medical 11.5
cheerful 11.4
kin 11.4
boy 11.3
dad 11.2
health 11.1
daughter 11.1
holding 10.7
clothing 10.6
interior 10.6
parent 10.5
bed 10.4
adults 10.4
senior 10.3
grandfather 10.3
relationship 10.3
women 10.3
mature 10.2
two 10.2
20s 10.1
children 10
attractive 9.8
bathrobe 9.8
two people 9.7
brunette 9.6
females 9.5
case 9.3
aged 9.1
lady 8.9
son 8.9
sexy 8.8
looking 8.8
affectionate 8.7
30s 8.7
bride 8.6
elderly 8.6
casual 8.5
doctor 8.5
sick person 8.4
grandma 8.4
wedding 8.3
fun 8.2
stethoscope 8.2
caring 7.9
professional 7.8
standing 7.8
half length 7.8
sick 7.7
sofa 7.7
old 7.7
comfortable 7.6
wife 7.6
enjoying 7.6
relaxation 7.5
occupation 7.3
life 7.3
relaxing 7.3
cup 7.2
brother 7.2
handsome 7.1
romantic 7.1
to 7.1

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

wall 98.5
person 97.1
baby 95.4
human face 95.1
clothing 94.2
smile 85.1
text 79.8
toddler 78.1
woman 70
black and white 58.6
posing 55.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-3
Gender Female, 97.8%
Calm 42%
Surprised 30.6%
Happy 19.3%
Angry 3.7%
Disgusted 2%
Confused 1%
Sad 0.7%
Fear 0.6%

AWS Rekognition

Age 2-10
Gender Male, 89.6%
Sad 75.2%
Calm 12.6%
Fear 9%
Surprised 0.8%
Confused 0.7%
Disgusted 0.7%
Happy 0.5%
Angry 0.4%

AWS Rekognition

Age 6-16
Gender Male, 50.3%
Calm 84.4%
Fear 8.1%
Sad 4.2%
Disgusted 1.1%
Confused 0.9%
Angry 0.5%
Surprised 0.5%
Happy 0.4%

Microsoft Cognitive Services

Age 6
Gender Male

Microsoft Cognitive Services

Age 0
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Categories

Imagga

people portraits 82.8%
pets animals 12.8%
paintings art 2.9%