Human Generated Data

Title

Untitled (bride looking at silver urn)

Date

1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.432.38

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (bride looking at silver urn)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-25

Clothing 99.9
Apparel 99.9
Person 99.1
Human 99.1
Person 97.9
Accessory 96.1
Accessories 96.1
Tie 96.1
Person 94.8
Person 91.8
Person 90.3
Gown 88.2
Fashion 88.2
Coat 87.5
Overcoat 87.5
Suit 87.5
Robe 85.4
Wedding 83.1
Wedding Gown 75.9
Suit 73.3
People 68.7
Tuxedo 67.8
Pottery 66
Bride 61.9
Meal 60.9
Food 60.9
Person 50.3

Clarifai
created on 2019-03-25

people 99.9
group 98.9
two 98.7
adult 98.7
several 97.7
leader 96.8
four 96.6
three 96.6
wedding 96.2
group together 96.1
dinner jacket 95.7
wear 95.1
administration 94.8
man 94.8
flower arrangement 94.7
five 94.3
ceremony 93.9
outfit 93.6
actress 93.5
woman 92.5

Imagga
created on 2019-03-25

groom 100
couple 50.6
bride 50.1
love 49
wedding 46.9
dress 36.2
happiness 32.9
married 32.6
man 31.6
bouquet 30.5
happy 30.1
male 27.7
adult 27.2
marriage 26.6
people 25.7
two 25.4
together 25.4
person 25.1
portrait 23.3
women 22.9
attractive 21
flowers 20.9
celebration 20.8
husband 20.5
romance 19.7
veil 19.6
gown 19.5
wife 19
smiling 18.8
smile 17.1
pretty 16.1
men 15.5
flower 15.4
sexy 15.3
bridal 14.6
romantic 14.3
family 14.2
outdoors 14.2
lady 13.8
wed 13.8
ceremony 13.6
relationship 13.1
brunette 13.1
fashion 12.8
handsome 12.5
pair 12.3
face 12.1
event 12
day 11.8
engagement 11.6
rose 11.2
kin 11.1
tuxedo 10.9
suit 10.8
human 10.5
togetherness 10.4
summer 10.3
elegance 10.1
joy 10
holding 9.9
cheerful 9.8
roses 9.7
hands 9.6
tie 9.5
adults 9.5
party 9.5
youth 9.4
church 9.3
fun 9
newly 8.9
tenderness 8.8
affectionate 8.7
boyfriend 8.7
cute 8.6
holiday 8.6
loving 8.6
outside 8.6
future 8.4
bow tie 8.3
joyful 8.3
girls 8.2
newlywed 8.1
home 8
lifestyle 8
look 7.9
commitment 7.9
mother 7.8
kiss 7.8
rings 7.8
life 7.7
girlfriend 7.7
enjoying 7.6
looking 7.2
religion 7.2
hair 7.1

Google
created on 2019-03-25

Microsoft
created on 2019-03-25

person 99.8
posing 83.1
old 70.5
black 67.1
people 67
wedding 63.7
group 63.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 61.6%
Happy 1.4%
Disgusted 2.1%
Sad 9.8%
Angry 2.8%
Confused 2.7%
Surprised 3.3%
Calm 77.9%

AWS Rekognition

Age 26-43
Gender Male, 99.7%
Happy 1.1%
Sad 13.4%
Confused 3.4%
Angry 2.7%
Disgusted 0.3%
Calm 78.5%
Surprised 0.6%

AWS Rekognition

Age 12-22
Gender Female, 94.7%
Surprised 2.5%
Angry 2.6%
Sad 3.2%
Calm 88.5%
Happy 0.6%
Confused 2.2%
Disgusted 0.3%

AWS Rekognition

Age 48-68
Gender Male, 79.8%
Happy 1.1%
Sad 11.7%
Calm 10.8%
Angry 72.6%
Confused 1.4%
Disgusted 1.2%
Surprised 1.2%

AWS Rekognition

Age 20-38
Gender Female, 93.9%
Disgusted 2.1%
Confused 1.4%
Sad 82.8%
Happy 1%
Surprised 1.9%
Calm 3.4%
Angry 7.3%

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 41
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 33
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Tie 96.1%
Suit 87.5%

Captions

Microsoft

Alberto Marvelli et al. posing for a photo 98.7%
Alberto Marvelli et al. posing for the camera 98.6%
an old photo of Alberto Marvelli et al. posing for the camera 98.2%