Human Generated Data

Title

Untitled (waiter pouring champagne, dozens of empty bottles)
Date

1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.432.16
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (waiter pouring champagne, dozens of empty bottles)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-25

Person 99.3
Human 99.3
Alcohol 99.2
Beer 99.2
Drink 99.2
Beverage 99.2
Bottle 99.2
Beer Bottle 93.8
Game 82
Chess 82
Wine 67.4
Stout 62.2
Wine Bottle 59.2

Clarifai
created on 2019-03-25

people 100
adult 99.2
man 96.3
two 96.2
one 96
leader 95.8
group 95.7
group together 93.9
wear 93.1
woman 93
administration 90.7
military 87.3
outfit 85
uniform 83.8
three 83.2
many 77
music 76.8
chair 75.1
portrait 72.5
four 71.2

Imagga
created on 2019-03-25

groom 49.6
bride 36.7
dress 34.3
wedding 32.2
people 26.2
couple 26.1
love 24.4
married 23
adult 22.5
person 22.4
bouquet 20
male 19.3
marriage 19
happy 18.2
portrait 18.1
happiness 18
man 17.6
two 16.9
women 15.8
celebration 15.1
fashion 15.1
clothing 15
musical instrument 14.8
flowers 14.8
ceremony 14.5
romance 14.3
day 14.1
gown 13.8
men 13.7
smile 12.8
looking 12.8
pretty 12.6
smiling 12.3
lady 12.2
church 12
human 12
bridal 11.7
together 11.4
wife 11.4
outdoors 11.2
husband 10.7
life 10.6
elegance 10.1
suit 10
traditional 10
face 9.9
holding 9.9
wed 9.8
veil 9.8
room 9.7
summer 9.6
future 9.3
business 9.1
attractive 9.1
old 9.1
cheerful 8.9
new 8.9
hair 8.7
engagement 8.7
holiday 8.6
youth 8.5
outdoor 8.4
wind instrument 8.3
park 8.2
one 8.2
cute 7.9
hands 7.8
model 7.8
wall 7.7
flower 7.7
pair 7.6
joy 7.5
rose 7.5
black 7.4
romantic 7.1
interior 7.1

Google
created on 2019-03-25

Photograph 96
Vintage clothing 75.3
Stock photography 64
Retro style 61.5

Microsoft
created on 2019-03-25

old 86.2
posing 46.4
street 46.4
black and white 32.1
wedding 19.1
person 15.6
monochrome 10.5
retro 9.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-59
Gender Male, 55%
Surprised 45.2%
Confused 45.3%
Calm 51.6%
Disgusted 45.1%
Angry 45.2%
Happy 46.8%
Sad 45.9%

Microsoft Cognitive Services

Age 61
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Chess 82%

Captions

Microsoft

a vintage photo of a man 91.8%
an old photo of a man 91.7%
old photo of a man 90.7%