Human Generated Data

Title

Untitled (guests at wedding reception)

Date

1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.432.45

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (guests at wedding reception)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-25

Person 99.7
Human 99.7
Person 99.6
Person 98.3
Overcoat 97.6
Apparel 97.6
Clothing 97.6
Coat 97.6
Suit 97.6
Tie 92.2
Accessories 92.2
Accessory 92.2
Tuxedo 90
Person 88
Person 86.6
Pub 76
Bar Counter 76
Sitting 75.6
Drink 75.1
Beverage 75.1
Meal 72.2
Food 72.2
Glass 67.4
Leisure Activities 67.3
Plant 66.2
Alcohol 61.4
People 61.3
Flower 58.2
Blossom 58.2
Musician 58.1
Musical Instrument 58.1
Dating 56.9
Finger 56.4

Clarifai
created on 2019-03-25

people 99.9
group 99.3
adult 98.4
administration 98.4
man 97.9
leader 96.4
several 96
group together 94.8
woman 92.3
three 91.9
outfit 91.4
four 90.9
two 90.9
music 90.3
dinner jacket 90.1
five 88
many 87.8
wedding 87.7
wear 87.3
ceremony 86.4

Imagga
created on 2019-03-25

groom 100
man 49.8
male 44
business 38.9
businessman 38.9
meeting 37.7
suit 37.4
person 36.6
office 36.2
people 35.2
corporate 33.6
team 33.2
executive 32
group 30.7
happy 30.1
men 29.2
businesswoman 28.2
professional 26.7
teamwork 26
businesspeople 24.7
couple 24.4
confident 23.7
work 23.6
smile 22.8
adult 22.1
together 21.9
smiling 21
businessmen 20.5
partner 20.3
successful 19.2
partnership 19.2
love 19
colleagues 18.5
happiness 18
portrait 17.5
success 16.9
diversity 16.4
desk 16.1
handsome 16.1
job 15.9
building 15.9
women 15.8
worker 15.7
wedding 15.7
bow tie 15.6
entrepreneur 15.5
sitting 15.5
cheerful 15.5
attractive 15.4
workplace 15.3
company 14.9
corporation 14.5
bride 14.4
staff 14.4
marriage 14.3
manager 14
table 13.9
leadership 13.5
married 13.4
formal 13.4
tie 13.3
working 13.3
necktie 12.8
communication 12.6
standing 12.2
mature 12.1
coworkers 11.8
discussion 11.7
partners 11.7
boss 11.5
celebration 11.2
two 11
discussing 10.8
diverse 10.8
conference 10.8
modern 10.5
employee 10
holding 9.9
businesswomen 9.8
husband 9.7
indoors 9.7
busy 9.7
planning 9.6
talking 9.5
indoor 9.1
dress 9
colleague 8.8
home 8.8
30s 8.7
elderly 8.6
expression 8.5
career 8.5
pair 8.5
bouquet 8.5
friendly 8.2
laptop 8.2
lady 8.1
romantic 8
computer 8
looking 8
black 7.8
businessperson 7.8
jacket 7.7
ethnic 7.6
wife 7.6
adults 7.6
senior 7.5
outdoors 7.5
garment 7.4
positive 7.4
occupation 7.3
lifestyle 7.2
paper 7.1
pretty 7

Google
created on 2019-03-25

Microsoft
created on 2019-03-25

person 100
suit 96.4
man 96.2
indoor 95
wedding 90.7
standing 75.4
necktie 34

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-38
Gender Male, 92.4%
Angry 3.4%
Calm 65.3%
Happy 1%
Surprised 2.8%
Sad 15.5%
Disgusted 1.2%
Confused 10.8%

AWS Rekognition

Age 20-38
Gender Female, 58.1%
Confused 6.5%
Angry 9.7%
Surprised 5.8%
Disgusted 2.5%
Calm 32.3%
Happy 6.2%
Sad 37%

Microsoft Cognitive Services

Age 27
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Suit 97.6%
Tie 92.2%

Captions

Microsoft

a person in a suit standing in front of a wedding cake 87.5%
a person standing in front of a wedding cake 82%
a man and a woman standing in front of a wedding cake 75.2%