Human Generated Data

Title

Untitled (portrait of two girls, Derry, New Hampshire)

Date

1953, printed later

People

Artist: Francis J. Sullivan, American 1916 - 1996

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.404

Human Generated Data

Title

Untitled (portrait of two girls, Derry, New Hampshire)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

1953, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 98.9
Human 98.9
Person 97.3
Clothing 96.1
Apparel 96.1
Female 94.3
Dress 91.1
People 89.6
Face 87.4
Teen 84.1
Glasses 83.1
Accessory 83.1
Accessories 83.1
Girl 81.3
Child 76.4
Kid 76.4
Smile 74.9
Woman 74.2
Art 71.2
Painting 71.2
Photo 66.8
Photography 66.8
Evening Dress 66.4
Gown 66.4
Robe 66.4
Fashion 66.4
Portrait 66.2
Finger 63.9
Family 56.9

Imagga
created on 2022-01-08

mother 61.3
parent 56.1
daughter 48.3
family 34.7
people 34.6
love 31.6
child 30.2
kin 29.4
male 28.9
happy 28.2
adult 27.8
portrait 26.6
man 26.2
nurse 25.9
couple 24.4
father 23.6
happiness 23.5
home 23.2
together 21
smiling 21
dad 18.5
joy 17.6
husband 17.2
person 17.2
attractive 16.8
cute 16.5
smile 16.4
face 16.3
baby 15.6
two 15.3
relationship 15
holding 14.9
dress 14.5
women 14.2
wife 14.2
fun 14.2
casual 13.6
kid 13.3
boy 13.1
mature 13
lifestyle 13
room 12.8
married 12.5
indoors 12.3
expression 11.9
lady 11.4
human 11.3
senior 11.3
one 11.2
clothing 11.1
hair 11.1
son 11.1
girls 10.9
blond 10.8
fashion 10.6
pretty 10.5
old 10.5
females 10.4
romance 9.8
cheerful 9.8
hug 9.7
grandma 9.6
elderly 9.6
laughing 9.5
sitting 9.5
bride 8.6
day 8.6
loving 8.6
youth 8.5
black 8.4
health 8.3
care 8.2
playing 8.2
childhood 8.1
romantic 8
body 8
interior 8
hands 7.8
model 7.8
eyes 7.8
couch 7.7
boyfriend 7.7
illness 7.6
studio 7.6
enjoying 7.6
pair 7.6
relaxation 7.5
patient 7.4
wedding 7.4
aged 7.3
sexy 7.2
life 7.2
looking 7.2
handsome 7.1
posing 7.1
medical 7.1

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

wall 99.9
person 99.7
human face 98.4
clothing 96.4
smile 96.3
baby 94
indoor 93.9
text 91.1
woman 75.9
toddler 75.1
gallery 56.2
dress 55.4
picture frame 18.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-14
Gender Male, 62.5%
Happy 98.5%
Calm 0.4%
Sad 0.3%
Surprised 0.2%
Angry 0.2%
Confused 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 6-14
Gender Female, 100%
Happy 97.8%
Confused 0.5%
Angry 0.4%
Sad 0.4%
Disgusted 0.3%
Fear 0.3%
Surprised 0.2%
Calm 0.1%

Microsoft Cognitive Services

Age 10
Gender Female

Microsoft Cognitive Services

Age 44
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Glasses 83.1%
Painting 71.2%

Captions

Microsoft

a person standing in front of a mirror posing for the camera 79.1%
a man and woman standing in front of a mirror posing for the camera 47.9%
a man and a woman posing for a photo 47.8%