Human Generated Data

Title

Untitled (boy eating birthday cake from spatula)

Date

1941

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5001

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (boy eating birthday cake from spatula)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.6
Human 99.6
Person 96.9
Food 95.5
Meal 95.5
Dish 94.7
Furniture 88.3
Dining Table 87.9
Table 87.9
Clothing 81.3
Apparel 81.3
Chair 76.3
Face 70.3
Female 66.8
Girl 66.7
People 65.5
Glasses 64.4
Accessory 64.4
Accessories 64.4
Pottery 63.6
Photography 61.4
Photo 61.4
Portrait 60.5
Restaurant 60.4
Eating 58.3
Cutlery 57.6
Supper 56.9
Dinner 56.9
Indoors 55.7
Room 55.7
Hat 55.2
Leisure Activities 55

Imagga
created on 2022-01-22

glass 30.5
table 22.1
brass 21.8
home 16.7
drink 16.7
wind instrument 16.3
dinner 16
party 15.5
device 15.4
wine 15.3
celebration 15.1
musical instrument 15
man 14.8
person 14.7
people 14.5
chemistry 14.5
laboratory 14.5
lifestyle 14.4
kitchen 14.4
adult 14.3
medical 14.1
glasses 13.9
wineglass 13.8
container 13.5
plate 12.9
wedding 12.9
experiment 12.7
food 12.5
science 12.4
research 12.4
restaurant 12.3
meal 12.2
lunch 12.1
happy 11.9
setting 11.6
interior 11.5
dining 11.4
biology 11.4
equipment 11.2
elegant 11.1
cup 10.9
medicine 10.6
health 10.4
alcohol 10.4
luxury 10.3
male 10
reception 9.8
napkin 9.8
chemical 9.6
test 9.6
knife 9.6
arrangement 9.6
fork 9.6
gramophone 9.2
elegance 9.2
hand 9.1
black 9
technology 8.9
banquet 8.8
biotechnology 8.8
lab 8.7
scientific 8.7
decoration 8.7
smiling 8.7
education 8.7
machine 8.6
happiness 8.6
close 8.6
marriage 8.5
silverware 8.5
modern 8.4
service 8.3
cheerful 8.1
silver 8
life 7.9
indoors 7.9
cooking 7.9
beverage 7.8
couple 7.8
instrument 7.6
formal 7.6
music 7.6
eating 7.6
eat 7.5
crystal 7.5
clean 7.5
senior 7.5
record player 7.4
student 7.2
color 7.2
transparent 7.2
romance 7.1
smile 7.1
romantic 7.1
cornet 7.1
love 7.1
liquid 7

Google
created on 2022-01-22

Food 97.5
Tableware 95
Table 91.5
Black 89.5
Plate 88.6
Dishware 86.5
Chair 86.4
Black-and-white 85.7
Style 84.1
Cuisine 82.6
Serveware 79.9
Dish 76.5
Monochrome photography 76.1
Cooking 75.4
Hat 75.4
Monochrome 75.3
Snapshot 74.3
Art 73.6
Platter 69.5
Bowl 68.6

Microsoft
created on 2022-01-22

person 98.5
text 98.1
tableware 93.2
indoor 93.1
birthday cake 88.2
black and white 76.1
plate 58.3
candle 54.5
meal 18.7

Face analysis

Amazon

Google

AWS Rekognition

Age 12-20
Gender Female, 98.5%
Sad 66.1%
Calm 32.8%
Happy 0.3%
Confused 0.3%
Surprised 0.2%
Disgusted 0.2%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 22-30
Gender Female, 95%
Calm 75.5%
Confused 9.3%
Sad 5.6%
Happy 2.5%
Angry 2.5%
Fear 1.6%
Surprised 1.5%
Disgusted 1.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Glasses 64.4%

Captions

Microsoft

a person sitting at a table 80.7%
a person sitting on a table 70.7%
a person sitting at a table eating food 50.4%

Text analysis

Amazon

16726.
Birthday
16726
6
1h-E-9

Google

16726.
6-3-41.
16726. 16726. 6-3-41.