Human Generated Data

Title

Untitled (mother and daughter)

Date

1950s

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2608

Human Generated Data

Title

Untitled (mother and daughter)

People

Artist: Unidentified Artist,

Date

1950s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99
Human 99
Person 98.7
Clothing 92.3
Apparel 92.3
Female 84.9
Accessories 83.7
Accessory 83.7
Jewelry 81.5
Girl 76.7
Evening Dress 76.1
Fashion 76.1
Gown 76.1
Robe 76.1
People 75.7
Teen 66.2
Kid 61.3
Child 61.3
Woman 58.3
Necklace 55.1

Imagga
created on 2021-12-15

kin 91.8
mother 45.9
happy 42
family 41.9
love 41.1
man 38.5
together 37.7
people 37.4
male 37.2
child 35.8
couple 35.8
smiling 34
portrait 33.7
parent 30.8
adult 28.5
happiness 28.2
father 27.4
daughter 26.1
smile 22.1
person 21.1
loving 21
dad 20.7
lifestyle 20.3
casual 19.5
two 19.5
sibling 19.4
boy 19.1
relationship 18.8
outdoors 18.7
cute 18
cheerful 17.9
fun 16.5
girlfriend 16.4
sitting 16.3
group 16.1
attractive 16.1
park 15.7
hug 15.5
boyfriend 15.4
husband 15.4
wife 15.2
home 15.2
face 14.9
children 14.6
joy 14.2
holding 14
son 13.8
youth 13.6
affectionate 13.6
romance 13.4
studio 12.9
generation 12.5
handsome 12.5
laughing 12.3
togetherness 12.3
senior 12.2
girls 11.9
relaxing 11.8
horizontal 11.7
hugging 11.7
kid 11.5
outside 11.1
women 11.1
brother 11.1
20s 11
mom 10.7
world 10.6
indoors 10.6
pretty 10.5
looking 10.4
friends 10.3
relaxed 10.3
hair 10.3
clothing 10
childhood 9.9
lady 9.7
married 9.6
brunette 9.6
kids 9.4
mature 9.3
camera 9.2
adorable 9.2
countryside 9.1
fashion 9.1
black 9
romantic 8.9
grandmother 8.8
embrace 8.8
affection 8.7
30s 8.7
adults 8.5
life 8.5
friendship 8.4
outdoor 8.4
dark 8.4
human 8.3
little 8
autumn 7.9
granddaughter 7.9
cuddling 7.9
mum 7.8
parents 7.8
bonding 7.8
men 7.7
summer 7.7
expression 7.7
laugh 7.7
enjoying 7.6
three 7.5
teen 7.4
dress 7.2
day 7.1
look 7

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

human face 98.8
person 98.3
clothing 98
text 96.9
smile 96.3
woman 93.4
dress 90.9
portrait 75.8
fashion accessory 67.4
posing 35.7
crowd 0.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-42
Gender Female, 99.7%
Happy 93.4%
Calm 1.8%
Confused 1.4%
Disgusted 1.4%
Surprised 0.7%
Fear 0.6%
Angry 0.4%
Sad 0.3%

AWS Rekognition

Age 13-25
Gender Female, 98.7%
Calm 70.9%
Happy 22.2%
Confused 2.4%
Sad 1.4%
Angry 1.1%
Disgusted 0.8%
Surprised 0.6%
Fear 0.5%

Microsoft Cognitive Services

Age 47
Gender Female

Microsoft Cognitive Services

Age 16
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%

Captions

Microsoft

a person sitting on a bench posing for the camera 87%
a person posing for a photo 86.9%
a man and a woman sitting on a bench posing for the camera 63.6%