Human Generated Data

Title

Untitled (Ben Stahl and family in living room)
Date

1955
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7872
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Ben Stahl and family in living room)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Furniture 99.7
Chair 99.7
Room 99.6
Indoors 99.6
Human 98.9
Person 98.9
Person 98.1
Person 96.8
Dining Table 91.9
Table 91.9
Chair 89.1
Dining Room 87.3
Chair 84.7
Chair 83.8
Person 78.1
Dressing Room 74
Restaurant 71.9
Living Room 57.6
Home Decor 57.2
Food 56.2
Meal 56.2
Waiting Room 55.5

Imagga
created on 2022-01-09

room 66.8
chair 63.4
interior 56.6
table 55.3
furniture 52.7
restaurant 34.8
modern 33.7
seat 33
house 30.9
home 29.4
floor 27.9
dining 27.6
decor 27.4
design 26.5
glass 24.8
window 24.3
hall 23.8
wood 23.4
luxury 22.3
inside 22.1
dinner 21.2
chairs 20.6
indoors 20.2
contemporary 19.8
style 19.3
comfortable 18.2
architecture 18
nobody 17.1
empty 16.9
wall 16.4
light 16
classroom 16
indoor 15.5
tables 14.8
building 14.7
kitchen 14.7
apartment 14.4
residential 14.4
hotel 14.3
drink 14.2
cafeteria 13.9
folding chair 13.8
toilet 13.8
structure 13.4
lamp 13.3
food 13.3
tile 13.1
decoration 13
elegant 12.9
counter 12.7
plant 12.7
setting 12.5
living 12.3
lunch 12.2
office 12.1
party 12
bar 12
elegance 11.8
stylish 11.8
meal 11.4
decorate 11.4
service 11.1
business 10.9
eat 10.9
area 10.8
sofa 10.7
stool 10.1
banquet 9.9
upscale 9.9
estate 9.5
wine 9.3
3d 9.3
domestic 9
drawer 8.9
furnishing 8.9
stove 8.9
reception 8.8
catering 8.8
wooden 8.8
center 8.8
real 8.5
space 8.5
bathroom 8.4
event 8.3
cook 8.2
patio 8.2
door 8.1
dining table 8
lifestyle 8
cabinets 7.9
vase 7.9
urban 7.9
napkin 7.8
life 7.8
ceremony 7.8
lighting 7.7
relax 7.6
relaxation 7.5
blackboard 7.5
residence 7.5
wedding 7.4
refrigerator 7.2
steel 7.1
day 7.1

Google
created on 2022-01-09

Furniture 95.6
Table 93.1
Chair 92.8
Black 89.5
Plant 86.7
Black-and-white 85.6
Style 83.9
Building 82.7
Line 81.9
Monochrome 76.5
Tints and shades 76.3
Monochrome photography 75.9
Event 68
Rectangle 67.6
Room 67.4
Window 61.2
Classic 55.2
Dining room 54.9
Tablecloth 53.3
History 53.2

Microsoft
created on 2022-01-09

table 99
vase 97.3
chair 96.8
coffee table 93.6
house 89.1
kitchen & dining room table 89.1
text 83
interior design 72.3
curtain 71.1
mirror 70.2
black and white 69.1
bed 65.8
white 64.8
couch 59.5
studio couch 53.8
room 50.9
furniture 47.5

Face analysis

Amazon

Google

AWS Rekognition

Age 39-47
Gender Female, 94.4%
Calm 98.5%
Happy 0.6%
Sad 0.4%
Surprised 0.1%
Angry 0.1%
Fear 0.1%
Confused 0.1%
Disgusted 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Chair 99.7%
Person 98.9%

Captions

Microsoft

a room filled with furniture and a window 79.7%
a room filled with furniture and a large window 78.1%
a room filled with furniture next to a window 73.2%

Text analysis

Amazon

41572.
KODAK--A-ITW

Google

YT37A°2
MJI7--
XAGOX
41572.
-
41572. MJI7-- YT37A°2 - - XAGOX