Human Generated Data

Title

Untitled (groom giving a toast at wedding reception)

Date

1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.432.26

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (groom giving a toast at wedding reception)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-25

Apparel 99.2
Clothing 99.2
Person 99.2
Human 99.2
Person 97.5
Plant 85.2
Accessory 85.1
Accessories 85.1
Tie 85.1
Suit 80.5
Overcoat 80.5
Coat 80.5
Food 80.4
Meal 80.4
Flower 75.7
Blossom 75.7
People 75.3
Fashion 69.5
Robe 69.5
Gown 68.9
Dish 68.1
Evening Dress 63.8
Flower Arrangement 60.1
Wedding 59.6
Furniture 59
Couch 58.9
Finger 58.4
Flower Bouquet 56.7
Wedding Gown 56.6

Clarifai
created on 2019-03-25

people 99.9
adult 98.7
two 98.2
one 96.9
woman 96.4
man 95.8
portrait 93.7
administration 92.9
actress 92.3
music 91.4
wear 91.4
group 91.2
furniture 89.5
facial expression 86.7
monochrome 85
three 85
home 84.2
leader 83.1
actor 83
outfit 82.6

Imagga
created on 2019-03-25

groom 100
couple 47.9
bride 47.8
wedding 42.3
man 39
love 38.7
dress 34.4
bouquet 33.5
happiness 30.6
marriage 28.5
two 28
male 27.5
people 27.4
portrait 26.6
happy 26.3
adult 25.9
flowers 24.4
person 23.4
smiling 23.2
married 23
romance 19.7
together 19.3
smile 19.3
veil 18.6
attractive 18.2
family 16
celebration 16
gown 15.6
suit 15.5
romantic 15.2
pretty 14.7
bridal 14.6
engagement 14.5
cheerful 13.8
kin 13.8
husband 13.7
bow tie 13.5
women 13.5
handsome 13.4
brunette 13.1
sexy 12.9
tuxedo 12.8
outdoors 12.7
holding 12.4
wife 12.3
flower 12.3
relationship 12.2
fashion 12.1
business 11.5
businessman 11.5
parent 11.4
tie 11.4
mother 11.3
men 11.2
day 11
rose 10.3
youth 10.2
elegance 10.1
joy 10
wed 9.8
pair 9.5
pose 9.1
bridegroom 8.9
father 8.9
dad 8.8
looking 8.8
ceremony 8.7
standing 8.7
lifestyle 8.7
necktie 8.6
professional 8.5
old 8.4
child 8.3
event 8.3
adolescent 8.3
20s 8.2
park 8.2
confident 8.2
lady 8.1
interior 8
romanticism 7.9
boy 7.8
their 7.8
hugging 7.8
lovers 7.7
hope 7.7
loving 7.6
studio 7.6
passion 7.5
fun 7.5
emotion 7.4
executive 7.4
life 7.3
indoor 7.3
home 7.2

Google
created on 2019-03-25

Microsoft
created on 2019-03-25

person 99.6
suit 71.7
black 65.6
white 64.7
dressed 41.5
clothes 15.3
wedding 9.4
black and white 2.5
fashion 2.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 83%
Calm 6.7%
Happy 40.3%
Sad 18.7%
Angry 7.8%
Disgusted 6%
Confused 10.6%
Surprised 10%

AWS Rekognition

Age 26-43
Gender Female, 99.7%
Surprised 2.8%
Calm 7.4%
Disgusted 2.9%
Happy 76.7%
Angry 2.9%
Sad 2.4%
Confused 4.9%

Microsoft Cognitive Services

Age 30
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Tie 85.1%
Suit 80.5%

Captions

Microsoft

a man and a woman posing for a photo 85.9%
a man and woman posing for a photo 82.3%
a black and white photo of a person 82.2%