Human Generated Data

Title

Untitled (wedding guests smiling for picture)

Date

1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.432.20

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (wedding guests smiling for picture)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-25

Apparel 99.8
Clothing 99.8
Person 99.5
Human 99.5
Person 99.1
Person 97.9
Person 96.8
Face 96.8
Suit 92.7
Overcoat 92.7
Coat 92.7
Hat 90.6
Accessory 88.1
Tie 88.1
Accessories 88.1
Hat 86.5
People 85.8
Female 83.5
Woman 66.9
Photography 62.9
Photo 62.9
Portrait 62.9
Girl 62.5
Jacket 58.2
Smile 58.1
Dress 57.7
Tuxedo 56.4
Family 56.3
Couch 56.1
Furniture 56.1
Indoors 55.2

Clarifai
created on 2019-03-25

people 100
group 99.2
two 99.2
adult 99.1
three 96.9
man 96.7
administration 96.2
facial expression 95.9
offspring 95.7
actress 95.6
wear 95.3
four 94.2
woman 94.1
portrait 93.8
leader 93.7
group together 88.7
sibling 88.1
several 87.9
furniture 85.6
five 85.6

Imagga
created on 2019-03-25

man 43.7
people 33.5
male 32.6
couple 29.6
person 28.3
happy 28.2
adult 27.3
smiling 26
groom 23
love 22.9
business 22.5
office 21.2
businessman 21.2
sitting 20.6
together 20.2
portrait 20.1
men 19.8
happiness 19.6
suit 19.1
family 18.7
smile 18.5
computer 18.4
meeting 17.9
indoors 17.6
women 16.6
mother 16.3
cheerful 16.3
laptop 15.5
corporate 15.5
home 15.2
executive 15
attractive 14.7
group 14.5
two 14.4
parent 13.8
businesswoman 13.6
tie 13.3
working 13.3
professional 13
husband 12.8
handsome 12.5
relationship 12.2
child 12.1
casual 11.9
work 11.8
lifestyle 11.6
married 11.5
black 11.4
desk 11.3
team 10.8
holding 10.7
face 10.7
brunette 10.5
wife 10.4
father 10.4
looking 10.4
togetherness 10.4
manager 10.2
teamwork 10.2
pretty 9.8
fun 9.7
colleagues 9.7
success 9.7
boss 9.6
businesspeople 9.5
color 9.5
brother 9
lady 8.9
romantic 8.9
kin 8.8
discussion 8.8
boy 8.7
girlfriend 8.7
table 8.7
expression 8.5
adults 8.5
buddy 8.5
fashion 8.3
indoor 8.2
dress 8.1
dad 8.1
romance 8
job 8
interior 8
two people 7.8
couch 7.7
partner 7.7
boyfriend 7.7
30s 7.7
serious 7.6
employee 7.6
enjoying 7.6
life 7.6
communication 7.6
technology 7.4
occupation 7.3
guy 7.3
clothing 7.2
cute 7.2
secretary 7.2
hair 7.1

Google
created on 2019-03-25

Microsoft
created on 2019-03-25

person 99.5
indoor 93
old 41.6
black and white 5.6
retro 4.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 99.2%
Happy 45.5%
Calm 3.3%
Confused 9.2%
Sad 3.1%
Disgusted 9.1%
Surprised 17.5%
Angry 12.2%

AWS Rekognition

Age 20-38
Gender Female, 99.9%
Sad 0%
Calm 0.1%
Happy 98.3%
Surprised 0.5%
Disgusted 0.2%
Confused 0.6%
Angry 0.3%

AWS Rekognition

Age 19-36
Gender Female, 99.7%
Surprised 5.5%
Angry 15.1%
Sad 9.2%
Confused 3.7%
Calm 41.1%
Happy 23.1%
Disgusted 2.3%

Microsoft Cognitive Services

Age 35
Gender Male

Microsoft Cognitive Services

Age 43
Gender Female

Microsoft Cognitive Services

Age 29
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Suit 92.7%
Hat 90.6%
Tie 88.1%

Captions

Microsoft

a man and a woman sitting on a table 60.3%
a man and woman sitting next to a window 51.6%
a group of people sitting at a table 51.5%