Human Generated Data

Title

Untitled (portrait of one standing boy and two seated toddlers)

Date

c. 1950

People

Artist: Jack Rodden Studio, American 1914 - 2016

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.13797

Human Generated Data

Title

Untitled (portrait of one standing boy and two seated toddlers)

People

Artist: Jack Rodden Studio, American 1914 - 2016

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.2
Person 99.2
Person 96.7
Person 94.6
Apparel 78.6
Clothing 78.6
Furniture 74.2
Chair 74.2
Finger 73.3
Sitting 69.2
Wood 62.8
Photo 58.6
Portrait 58.6
Photography 58.6
Face 58.6
Baby 57.4

Imagga
created on 2022-01-23

father 70.3
parent 67.4
dad 63
child 62.4
family 56.1
mother 47.2
happy 42
kid 38.1
male 37.8
kin 36.7
home 32.7
daughter 32.5
childhood 31.4
children 30.1
baby 30
fun 30
happiness 29.8
boy 29.6
son 29.3
people 29
together 27.2
man 26.9
smiling 25.3
cheerful 25.2
smile 25
little 24.8
cute 24.4
portrait 24
casual 23.7
love 23.7
toddler 21
adult 20.1
joy 20.1
husband 20.1
couple 20.1
lifestyle 19.5
grandma 18.9
playing 18.3
adorable 17.6
togetherness 17
kids 17
wife 16.1
indoors 15.8
sibling 15.8
old 15.3
leisure 15
girls 14.6
mom 14.5
youth 13.6
face 13.5
grandfather 13.2
senior 13.1
sitting 12.9
two 12.7
women 12.7
joyful 12
room 11.9
parents 11.7
life 11.7
brother 11.6
infant 11.6
holding 11.6
living 11.4
laughing 11.4
play 11.2
parenthood 10.8
couch 10.6
interior 10.6
expression 10.2
mature 10.2
offspring 10.2
clothing 10.1
domestic 10.1
indoor 10.1
retired 9.7
looking 9.6
color 9.5
toy 9.2
care 9.1
blond 9
sister 8.8
men 8.6
enjoying 8.5
sit 8.5
enjoy 8.5
three 8.4
studio 8.4
one 8.2
relaxing 8.2
generations 7.9
grandmother 7.8
newborn 7.8
boys 7.8
games 7.8
30s 7.7
married 7.7
elderly 7.7
loving 7.6
healthy 7.6
pink 7.5
enjoyment 7.5
park 7.4
person 7.3
active 7.2
game 7.1
innocent 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

baby 99.7
toddler 99.3
human face 98.8
wall 98.8
person 98.5
clothing 98.1
child 97.8
indoor 96.8
text 89.5
boy 89.3
smile 89.1
posing 48.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-3
Gender Male, 99.9%
Calm 48%
Happy 45.7%
Confused 2.9%
Angry 0.9%
Disgusted 0.8%
Sad 0.7%
Surprised 0.6%
Fear 0.5%

AWS Rekognition

Age 0-3
Gender Male, 97.4%
Surprised 97.6%
Calm 1.2%
Fear 0.4%
Disgusted 0.3%
Happy 0.2%
Sad 0.1%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 0-3
Gender Female, 64.8%
Calm 49.6%
Surprised 37.9%
Fear 3.5%
Disgusted 3.4%
Confused 2.1%
Sad 1.7%
Happy 1.3%
Angry 0.5%

Microsoft Cognitive Services

Age 0
Gender Male

Microsoft Cognitive Services

Age 0
Gender Male

Microsoft Cognitive Services

Age 5
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a vintage photo of a baby 82.2%
a vintage photo of a person holding a baby 74.2%
a vintage photo of a person holding a baby 68.2%