Human Generated Data

Title

Untitled (man with chef hat stirring large vat)
Date

1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5115
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man with chef hat stirring large vat)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.6
Person 99.6
Person 99.3
Building 80.8
Factory 66.9
Pot 60.7

Imagga
created on 2022-01-23

glass 66.8
drink 54.3
beaker 46.7
beverage 44.4
alcohol 43.3
container 38.5
bottle 35.3
vessel 34.4
jar 33.8
liquid 33.4
party 30.9
transparent 26
wine 25.7
champagne 25.4
glasses 24.1
celebration 23.9
bubbles 22.8
ice 21.8
water 21.3
crystal 20
clear 20
celebrate 19.9
bar 19.4
toast 18.4
wineglass 17.6
festive 17.5
sax 17.3
drop 17.2
restaurant 16.7
cold 16.4
fresh 16.3
cup 15.9
cheers 15.7
wet 15.2
cool 15.1
anniversary 15
occasion 14.4
close 14.3
fizz 13.8
congratulations 13.7
glassware 13.7
year 13.7
cocktail shaker 13.7
cocktail 13.6
eve 13.4
romantic 13.4
wedding 12.9
bubbly 12.8
refreshment 12.7
pour 12.6
splash 12.4
gold 12.3
bubble 12.2
table 12.1
empty 12
shaker 11.9
freshness 11.6
victory 11.6
laboratory 11.6
new 11.3
happy 11.3
fun 11.2
luxury 11.1
food 10.6
reflection 10.6
light 10
water jug 10
jug 9.9
special 9.8
chemistry 9.7
sparkle 9.6
research 9.5
biology 9.5
decoration 9.4
clean 9.2
vodka 9
health 9
life 8.9
h2o 8.8
medical 8.8
biotechnology 8.8
sparkling 8.8
medicine 8.8
experiment 8.8
pouring 8.8
chemical 8.7
splashing 8.7
drinking 8.6
aqua 8.6
drops 8.5
dinner 8.4
ribbon 8.3
closeup 8.1
juice 8
congrats 7.9
flutes 7.9
holiday 7.9
alcoholic 7.8
thirsty 7.8
lab 7.8
scientific 7.7
dining 7.6
healthy 7.6
pure 7.4
birthday 7.4
equipment 7.3
full 7.3
yellow 7.3
bucket 7.1
science 7.1

Google
created on 2022-01-23

Sleeve 87
Gas 78
Mass production 76.8
Monochrome 72.5
Monochrome photography 72.4
Cooking 70
Art 66
Vintage clothing 64.7
Machine 63.5
Window 60.6
Science 60.5
Cylinder 57.7
Hat 56.8
Kitchen appliance 55.9
Barrel 55.2
Metal 54.5
Advertising 53.7
Photography 52.6
History 51

Microsoft
created on 2022-01-23

text 98.4
drawing 96.2
sketch 95
person 91.8
clothing 86.8
black and white 81.7
man 50.2

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Male, 95.6%
Calm 99.2%
Sad 0.4%
Happy 0.2%
Confused 0.1%
Angry 0.1%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 48-54
Gender Male, 87.7%
Calm 85.7%
Surprised 12.8%
Confused 0.5%
Angry 0.4%
Disgusted 0.3%
Sad 0.2%
Fear 0.2%
Happy 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a person standing in front of a refrigerator 25.4%

Text analysis

Amazon

12409.
62

Google

12409.
60429
T2409.
ーもー
63
12409. ーもー 63 12409. 60429 T2409.