Human Generated Data

Title

Untitled (man and woman seated at table on balcony)

Date

1957

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8983

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man and woman seated at table on balcony)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1957

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Clothing 99.8
Apparel 99.8
Furniture 98.7
Person 98.4
Human 98.4
Person 98.4
Chair 96.2
Tablecloth 89
Table 87.4
Dining Table 85.1
Hat 84.1
Musical Instrument 81.4
Leisure Activities 81.4
Piano 81.4
Sun Hat 79.4
Home Decor 66.5
Portrait 61.2
Photography 61.2
Photo 61.2
Face 61.2
Tabletop 56.3
Sitting 55.4

Imagga
created on 2022-01-09

musical instrument 73.8
keyboard instrument 67.3
piano 65.9
percussion instrument 57.9
upright 51.5
stringed instrument 45.6
seat 31.9
accordion 28
chair 27.4
bench 25.7
grand piano 23.4
furniture 22.5
park bench 18.9
sitting 18
wind instrument 17.3
lifestyle 16.6
marimba 15.7
people 14.5
relax 13.5
interior 13.3
park 13.2
outdoor 13
outdoors 12.7
travel 12.7
relaxation 12.6
adult 11.8
leisure 11.6
technology 11.1
black 10.8
person 10.8
vacation 10.6
fashion 10.5
modern 10.5
scene 10.4
style 10.4
summer 10.3
wall 10.3
music 10
old 9.7
portrait 9.7
sun 9.7
scenic 9.6
rest 9.6
home 9.6
sky 9.6
man 9.4
peaceful 9.1
relaxing 9.1
tourism 9.1
table 9
landscape 8.9
sofa 8.9
room 8.8
computer 8.8
indoors 8.8
natural 8.7
water 8.7
sea 8.6
empty 8.6
luxury 8.6
sit 8.5
rocking chair 8.4
resort 8.4
wood 8.3
ocean 8.3
device 8.2
cheerful 8.1
business 7.9
holiday 7.9
day 7.8
male 7.8
shopping cart 7.8
model 7.8
instrument 7.6
beach 7.6
house 7.5
happy 7.5
shore 7.4
calm 7.3
digital 7.3
coast 7.2
trees 7.1

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

furniture 96.7
table 93.3
text 93.1
chair 91.2
black and white 90.4
black 75.2
white 73
bench 68.2

Face analysis

Google

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%
Chair 96.2%
Piano 81.4%

Captions

Microsoft

a person sitting on a bench 74.7%
a person sitting on a bench in front of a window 58.3%
a man and a woman sitting on a bench 54.5%

Text analysis

Amazon

42468