Human Generated Data

Title

Untitled (man and woman seated in living room reading)
Date

c. 1950
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4645
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man and woman seated in living room reading)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Indoors 99.2
Room 99.2
Living Room 99.2
Furniture 97.6
Human 95.1
Person 95.1
Chair 86.7
Person 86.5
Interior Design 83.8
Couch 79
Bedroom 66.7
Waiting Room 66.3
Home Decor 65.7
Chair 65.2
Monitor 59.6
Screen 59.6
Electronics 59.6
Display 59.6
Dorm Room 55.2
People 55.1
Person 47.9

Imagga
created on 2021-12-14

room 96.2
furniture 86.5
table 79.3
interior 74.4
house 52.7
home 50.3
desk 47.2
modern 45.6
bedroom 44.2
chair 43.9
floor 37.2
decor 37.2
design 36.1
luxury 34.3
architecture 31.3
wood 30.9
window 30.5
living 30.4
apartment 28.8
inside 28.6
sofa 28.3
indoor 26.5
indoors 25.5
kitchen 25.2
furnishing 24.4
residential 24
light 23.4
style 23
dining 22.9
contemporary 22.6
lamp 21.1
decoration 19.6
3d 19.4
comfortable 18.2
empty 18.1
wall 17.9
chairs 17.6
glass 17.2
nobody 16.3
living room 15.7
seat 14.7
fireplace 14.5
couch 14.5
elegance 14.3
cabinet 13.7
carpet 13.6
domestic 13.6
plant 13.5
estate 13.3
rug 12.8
residence 12.7
hardwood 11.8
lighting 11.6
hotel 11.5
decorate 11.4
render 11.3
office 11.2
building 11
space 10.9
spacious 10.9
stylish 10.9
decorating 10.7
vase 10.7
classic 10.2
cozy 9.8
ceiling 9.8
real estate 9.8
structure 9.7
expensive 9.6
door 9.5
real 9.5
bed 9.5
hall 9.3
new 8.9
steel 8.9
oven 8.8
mansion 8.8
studio apartment 8.8
wooden 8.8
pillow 8.8
lifestyle 8.7
elegant 8.6
counter 8.6
flower 8.5
relax 8.4
relaxation 8.4
area 8.3
refrigerator 8.3
dining table 8.2
marble 8
domestic room 7.9
cabinets 7.9
dining room 7.9
upscale 7.9
furnishings 7.9
tables 7.9
stove 7.9
urban 7.9
food 7.9
flowers 7.8
comfort 7.7
rendering 7.6
dinner 7.6
lifestyles 7.6
clean 7.5
place 7.5
parquet 7.5
restaurant 7.3

Google
created on 2021-12-14

Picture frame 95.8
Window 90.5
Black 89.5
Chair 87.4
Interior design 86.2
Black-and-white 84.2
Style 83.9
Building 81.8
Art 75.9
Monochrome photography 74.8
Monochrome 74.8
Couch 72.9
Living room 71
Room 69.8
Painting 63.8
Television set 62.2
Stock photography 62.1
Rectangle 60.4
Machine 59.6
Shelf 59.2

Microsoft
created on 2021-12-14

text 99.8
indoor 99.3
table 97.9
living 97.4
chair 96.2
wall 95.9
room 95.5
window 91.1
house 80.4
coffee table 71.7
black and white 71
kitchen & dining room table 70.9
vase 69.2
white 68.2
building 63.5
furniture 59.6
cluttered 15.7
desk 7.3

Face analysis

Amazon

Google

AWS Rekognition

Age 15-27
Gender Female, 65.5%
Sad 29.3%
Calm 27%
Confused 19.1%
Fear 14.1%
Surprised 7.2%
Happy 2.3%
Angry 0.6%
Disgusted 0.4%

AWS Rekognition

Age 49-67
Gender Female, 72.2%
Calm 74.5%
Sad 22.5%
Confused 1.2%
Happy 1%
Surprised 0.4%
Angry 0.2%
Disgusted 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 95.1%
Chair 86.7%

Captions

Microsoft

a vintage photo of a living room 87.3%
a vintage photo of a living room filled with furniture and a window 73.8%
a vintage photo of a living room filled with furniture and a tv 66.2%

Text analysis

Amazon

STEINMETZ,
FLORIDA
STEINMETZ, SARASOTA. FLORIDA
SARASOTA.

Google

STEINMETZ,
STEINMETZ, SARASOTA FLORIDA
SARASOTA
FLORIDA