Human Generated Data

Title

Untitled (bride applying lipstick in compact mirror)

Date

1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.432.23

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (bride applying lipstick in compact mirror)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-25

Clothing 100
Apparel 100
Human 95.7
Veil 94.7
Person 91.2
Robe 90.7
Fashion 90.7
Gown 90.6
Person 90.3
Phone 88.7
Mobile Phone 88.7
Electronics 88.7
Cell Phone 88.7
Wedding 84
Wedding Gown 76.7
Female 76
Bride 68.7
Face 61.7
Bridegroom 61.6
Photo 61.2
Photography 61.2
Portrait 61.2
Woman 60.3
Person 41.6

Clarifai
created on 2019-03-25

wedding 99.9
bride 99.6
veil 99.5
people 98.9
groom 97.8
woman 97.3
dress 95.7
love 95.3
monochrome 94.9
adult 94.9
ceremony 94.4
wear 94.2
bridal 94.1
two 93.3
marriage 93.1
man 92.7
portrait 92.2
fashion 92
girl 89
romance 86.7

Imagga
created on 2019-03-25

groom 100
person 42.5
portrait 37.6
adult 31.1
face 28.5
bride 27
hair 26.2
fashion 25.7
wedding 23.9
pretty 23.8
attractive 23.1
love 22.9
dress 22.6
model 21.8
people 21.8
veil 20.6
smile 18.6
happy 18.2
women 16.6
lady 16.3
clothing 15.8
couple 15.7
one 15.7
sexy 15.3
looking 15.2
smiling 15.2
lifestyle 15.2
feather boa 15.1
cute 15.1
happiness 14.9
eyes 14.7
married 14.4
bridal 13.6
human 13.5
posing 13.3
blond 13
scarf 13
hand 12.9
youth 12.8
head 12.6
expression 12
brunette 11.3
skin 11.1
man 10.8
wife 10.4
two 10.2
healthy 10.1
sensuality 10
gorgeous 10
husband 9.9
studio 9.9
gown 9.8
garment 9.7
females 9.5
casual 9.3
elegance 9.3
phone 9.2
emotion 9.2
close 9.1
black 9
cheerful 9
closeup 8.8
hands 8.7
sad 8.7
day 8.6
marriage 8.6
male 8.5
bouquet 8.5
mature 8.4
life 8.3
teenager 8.2
girls 8.2
sensual 8.2
style 8.2
family 8
lovely 8
home 8
sadness 7.8
pain 7.7
holding 7.4
lips 7.4
20s 7.3
alone 7.3
pose 7.3
eye 7.2
indoors 7
look 7

Google
created on 2019-03-25

Microsoft
created on 2019-03-25

wedding 98.6
person 98.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-38
Gender Female, 98.9%
Happy 25.2%
Angry 10.5%
Sad 4%
Confused 4.4%
Disgusted 19%
Calm 4.3%
Surprised 32.6%

AWS Rekognition

Age 26-43
Gender Male, 94.9%
Sad 24%
Disgusted 5.7%
Angry 12.6%
Calm 40.7%
Surprised 4.9%
Confused 10.5%
Happy 1.6%

AWS Rekognition

Age 27-44
Gender Male, 53.7%
Confused 45.1%
Happy 45%
Sad 50.9%
Surprised 45.1%
Angry 45.3%
Disgusted 45%
Calm 48.6%

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 91.2%
Mobile Phone 88.7%

Captions

Microsoft

a person talking on a cell phone 38.7%
a person is talking on the cell phone 35.9%
a person is talking on a cell phone 35.8%