Human Generated Data

Title

Untitled (children dressed up as king and queen; children in leotards)

Date

c. 1950

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15553

Human Generated Data

Title

Untitled (children dressed up as king and queen; children in leotards)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-19

Clothing 99.9
Apparel 99.9
Bonnet 99.6
Person 92.7
Human 92.7
Person 92.1
Painting 68.1
Art 68.1
Accessory 59
Accessories 59
Hat 53.3

Imagga
created on 2022-03-19

child 99.9
sibling 50.9
kid 40.8
family 39.2
childhood 38.5
baby 38.4
mother 36.9
little 36.2
cute 35.2
happy 32.6
son 32.1
parent 32
fun 30.7
happiness 29
boy 28.7
portrait 28.5
daughter 28.3
male 27.5
people 25.1
smile 25
toddler 24.8
father 24.5
face 24.2
cheerful 23.6
person 22.2
children 21.9
love 21.3
smiling 20.3
adorable 19.4
brother 19.1
girls 18.2
joy 17.5
doll 17.4
youth 17
human 16.5
hat 15.9
holding 15.7
infant 15.4
kids 15.1
home 14.4
dad 14
plaything 13.9
sweet 13.4
care 13.2
man 12.8
innocent 12.7
newborn 12.6
adult 12.3
sitting 12
playing 11.9
studio 11.4
together 11.4
laughing 11.3
play 11.2
expression 11.1
casual 11
pretty 10.5
lifestyle 10.1
joyful 10.1
offspring 9.6
eyes 9.5
life 9.4
holiday 9.3
dress 9
color 8.9
looking 8.8
mom 8.7
gift 8.6
outside 8.6
playful 8.5
two 8.5
pink 8.4
toy 8.3
juvenile 8.3
one 8.2
blond 8
vertical 7.9
black 7.8
tiny 7.8
antique 7.8
boys 7.8
hug 7.7
men 7.7
husband 7.6
hand 7.6
leisure 7.5
funny 7.3
year 7.3
new 7.3
clothing 7.3
women 7.1

Google
created on 2022-03-19

Microsoft
created on 2022-03-19

toddler 97.2
human face 96.9
baby 96.2
clothing 95.5
window 93.4
person 88.2
text 86.5
posing 83.7
child 79.2
black 72.2
smile 68
fashion accessory 65.9
dress 59.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-3
Gender Male, 99%
Confused 82.9%
Calm 7.7%
Happy 4.5%
Fear 1.9%
Surprised 1.2%
Sad 0.7%
Angry 0.6%
Disgusted 0.5%

AWS Rekognition

Age 0-4
Gender Male, 54.5%
Calm 97.3%
Surprised 0.9%
Fear 0.6%
Angry 0.4%
Disgusted 0.4%
Sad 0.3%
Happy 0.1%
Confused 0.1%

Microsoft Cognitive Services

Age 1
Gender Male

Microsoft Cognitive Services

Age 4
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 92.7%
Painting 68.1%
Hat 53.3%

Captions

Microsoft

a little girl posing for a photo 91.4%
a little girl posing for a photo in front of a window 87.4%
a little girl posing for a picture 87.3%