Human Generated Data

Title

Untitled (wedding guests standing with drinks in hand at dinner table)

Date

1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.432.34

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (wedding guests standing with drinks in hand at dinner table)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-25

Clothing 99.8
Apparel 99.8
Person 99.4
Human 99.4
Person 98.9
Person 98.8
Person 97.4
Person 97.2
Coat 95.7
Overcoat 95.7
Tie 94.8
Accessory 94.8
Accessories 94.8
Suit 92.1
Fashion 91.7
Robe 91.7
Gown 88.3
Wedding 85.6
Tuxedo 81.6
Candle 81.4
Wedding Gown 75.5
Plant 74.8
People 74.8
Flower 69.8
Blossom 69.8
Person 68.6
Tie 66.5
Suit 64.8
Bride 63.4
Flower Arrangement 56.6
Dessert 55.6
Food 55.6
Cake 55.4

Clarifai
created on 2019-03-25

people 99.8
group 99.4
group together 98.1
adult 98
four 97.1
several 96.8
administration 95.1
woman 95.1
three 95
man 94.5
actress 93.7
leader 93.5
ceremony 92.4
five 91.1
facial expression 90.9
wedding 90
two 87.5
dinner jacket 86
many 84.8
outfit 84.5

Imagga
created on 2019-03-25

groom 100
bride 64.3
couple 61.1
wedding 59.9
love 47.4
marriage 45.6
dress 43.4
happiness 38.4
bouquet 37.1
man 37
married 36.5
people 31.8
happy 30.7
male 30.5
two 28
together 26.3
flowers 26.1
husband 24.8
celebration 24.8
wife 24.7
adult 24.6
person 24.5
veil 22.6
gown 22.5
romance 22.4
smiling 21.7
smile 20
attractive 19.6
family 19.6
bridal 19.5
men 18.9
portrait 18.8
ceremony 17.5
day 17.3
outdoors 17.2
romantic 16.9
wed 16.7
engagement 16.4
suit 16.2
pretty 16.1
cheerful 15.5
women 15
handsome 14.3
pair 14.2
event 13.9
tuxedo 13.8
relationship 13.1
brunette 13.1
fashion 12.1
home 12
elegance 11.8
holding 11.6
flower 11.6
rose 11.3
20s 11
lifestyle 10.9
affectionate 10.7
loving 10.5
sexy 10.5
church 10.2
emotion 10.2
joy 10
bridegroom 9.9
romanticism 9.9
newly 9.9
matrimony 9.9
roses 9.7
pose 9.1
human 9
lady 8.9
newlyweds 8.9
standing 8.7
hope 8.7
occasion 8.7
future 8.4
summer 8.4
gorgeous 8.2
religion 8.1
posing 8
interior 8
wedded 7.9
newlywed 7.9
tenderness 7.8
outside 7.7
old 7.7
tie 7.6
adults 7.6
park 7.4
joyful 7.4
new 7.3

Google
created on 2019-03-25

Microsoft
created on 2019-03-25

person 99.9
wall 97.6
indoor 94.9
wedding 84.8
people 79.2
cut 62.8
group 55.5
old 49.7
posing 46.5
formal 4.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 10-15
Gender Female, 99.9%
Sad 6.6%
Disgusted 4.8%
Calm 8.1%
Happy 16.5%
Confused 13.3%
Surprised 13.3%
Angry 37.4%

AWS Rekognition

Age 26-44
Gender Male, 99.8%
Happy 45.4%
Disgusted 9.6%
Confused 16.2%
Surprised 13.6%
Calm 1.6%
Sad 2.1%
Angry 11.4%

AWS Rekognition

Age 26-43
Gender Male, 99.7%
Surprised 5.6%
Angry 9%
Disgusted 3.6%
Calm 39.8%
Sad 13.8%
Confused 24.7%
Happy 3.6%

AWS Rekognition

Age 14-25
Gender Female, 86.9%
Surprised 5.3%
Confused 3.3%
Calm 1%
Disgusted 1.4%
Angry 2%
Happy 85%
Sad 2%

AWS Rekognition

Age 26-43
Gender Female, 99.8%
Sad 75.6%
Happy 11%
Confused 3.4%
Surprised 1.8%
Disgusted 1.5%
Calm 3.8%
Angry 2.8%

AWS Rekognition

Age 23-38
Gender Male, 50%
Happy 47.3%
Surprised 45.6%
Disgusted 45.5%
Calm 45.5%
Sad 49.2%
Confused 45.3%
Angry 46.6%

Microsoft Cognitive Services

Age 35
Gender Male

Microsoft Cognitive Services

Age 34
Gender Female

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Tie 94.8%
Suit 92.1%
Candle 81.4%

Captions

Microsoft

Tony Puryear et al. posing for a photo in front of a wedding cake 91.9%
Tony Puryear et al. posing for a photo 91.8%
Tony Puryear et al. cutting a wedding cake 90.3%