Human Generated Data

Title

Untitled (wedding guests dancing)

Date

1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.432.21

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (wedding guests dancing)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-25

Clothing 99.9
Apparel 99.9
Human 99.6
Person 99.6
Person 98.9
Suit 93.1
Coat 93.1
Overcoat 93.1
Face 82.3
Tuxedo 73.4
People 73.3
Hat 72.7
Bonnet 56.8

Clarifai
created on 2019-03-25

people 100
two 99.5
adult 99.3
group 98.6
leader 97.8
three 97.8
actress 97.2
portrait 97
man 96.5
wear 95.7
facial expression 95.2
administration 94.5
four 93.8
veil 93.5
group together 93.2
outfit 93.1
wedding 93.1
woman 92.9
ceremony 92.4
actor 92.2

Imagga
created on 2019-03-25

bow tie 100
necktie 100
garment 60.8
man 39
family 38.3
male 34.9
happy 34.5
couple 34
love 33.9
clothing 33.2
people 26.8
portrait 25.9
happiness 25.1
child 24.1
adult 23.9
smile 23.5
smiling 23.2
person 22.1
mother 21.6
married 21.1
father 20.4
together 20.2
boy 17.4
husband 16.3
son 15.7
men 15.5
kid 15.1
senior 15
face 14.9
attractive 14.7
home 14.4
handsome 14.3
wife 14.2
group 13.7
daughter 13.6
dress 13.6
cheerful 13
wedding 12.9
holding 12.4
sitting 12
looking 12
fun 12
casual 11.9
suit 11.8
bride 11.5
cute 11.5
black 11.4
old 11.1
women 11.1
parent 11
lifestyle 10.8
childhood 10.7
businessman 10.6
marriage 10.4
pair 10.4
celebration 10.4
relationship 10.3
two 10.2
children 10
little 9.7
elderly 9.6
loving 9.5
life 9.5
expression 9.4
mature 9.3
groom 9.3
sibling 9.2
joy 9.2
business 9.1
romance 8.9
grandmother 8.8
hair 8.7
standing 8.7
sofa 8.6
toddler 8.6
tie 8.5
hand 8.4
human 8.2
grandfather 8
affectionate 7.7
pretty 7.7
30s 7.7
baby 7.7
studio 7.6
enjoying 7.6
fashion 7.5
brother 7.5
friends 7.5
look 7

Google
created on 2019-03-25

Microsoft
created on 2019-03-25

person 99.7
indoor 92.5
black 68.3
old 47.4
posing 40.8
retro 8.5
wedding 7.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Female, 99.2%
Angry 0.2%
Disgusted 0.2%
Sad 0.1%
Surprised 0.4%
Happy 98.6%
Calm 0.2%
Confused 0.3%

AWS Rekognition

Age 26-43
Gender Male, 88.7%
Happy 66.9%
Surprised 3.5%
Sad 7.6%
Confused 4.2%
Angry 3.2%
Disgusted 2.6%
Calm 12%

AWS Rekognition

Age 38-59
Gender Male, 54.3%
Confused 45.3%
Angry 45.6%
Surprised 45.4%
Disgusted 47%
Calm 51.2%
Happy 45.2%
Sad 45.3%

Microsoft Cognitive Services

Age 26
Gender Female

Microsoft Cognitive Services

Age 46
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Suit 93.1%

Captions

Microsoft

a man and a woman posing for a photo 76.1%
a man and woman posing for a photo 70.5%
a black and white photo of a person 70.4%