Human Generated Data

Title

Untitled (couple seated in living room of home in Punta Gorda Isles, Florida)
Date

c. 1970
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11584
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (couple seated in living room of home in Punta Gorda Isles, Florida)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1970

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Furniture 98.9
Person 98.6
Human 98.6
Living Room 98.3
Indoors 98.3
Room 98.3
Person 95.8
Chair 83.9
Couch 82.7
Interior Design 82.5
Person 79.4
Chair 70.8
Shop 61.1
Person 60.8
Monitor 59.6
Electronics 59.6
Screen 59.6
Display 59.6
Shelf 58.2
Armchair 58

Imagga
created on 2022-01-15

table 79.2
furniture 76.6
chair 76
interior 67.3
room 65.3
desk 47.8
seat 40.3
modern 38.6
house 38.5
home 35.1
restaurant 34.9
floor 32.6
design 31.5
decor 30.1
indoors 29.9
wood 28.4
office 28
window 26.6
barber chair 24.3
empty 24.1
building 23.7
chairs 23.5
dining 22.9
indoor 22.8
light 22.1
architecture 21.1
lamp 21
furnishing 20.8
kitchen 20.6
luxury 20.6
glass 19.5
structure 19.4
contemporary 18.8
style 18.6
elegance 18.5
inside 18.4
apartment 18.2
nobody 17.9
decoration 17.4
residential 17.3
comfortable 17.2
living 17.1
sofa 16.3
wall 16.3
3d 15.5
shop 15.2
barbershop 15
salon 14.8
dinner 14.3
plant 14.2
business 14
decorate 13.3
food 13.3
cabinet 12.9
drink 12.5
urban 12.3
tables 11.8
classroom 11.7
counter 11.7
lighting 11.6
equipment 11.4
work 11
stool 10.9
computer 10.6
place 10.3
domestic 10
stove 9.9
cafeteria 9.7
mirror 9.5
scene 9.5
render 9.5
space 9.3
eat 9.2
city 9.2
mercantile establishment 9.1
stylish 9.1
upscale 8.9
working 8.8
oven 8.8
carpet 8.8
hotel 8.6
relax 8.4
bar 8.3
occupation 8.3
steel 8
cabinets 7.9
wooden 7.9
drawer 7.9
hardwood 7.9
vase 7.7
elegant 7.7
flower 7.7
plate 7.6
relaxation 7.5
coffee 7.4
island 7.3
cook 7.3
studio apartment 7.3
success 7.3
lifestyle 7.2
life 7
device 7

Google
created on 2022-01-15

Picture frame 94
Furniture 92.9
Window 89.9
Couch 88.8
Chair 88.5
Building 88.4
Interior design 85.4
Style 83.8
Black-and-white 83.5
Bookcase 79.9
Living room 78.8
Houseplant 78.2
Television set 77.5
Television 73.8
Monochrome photography 73.3
Monochrome 72.2
Lamp 71.2
Art 70.2
House 69.8
Room 68.6

Microsoft
created on 2022-01-15

text 99.7
indoor 98.3
table 98
chair 97
living 96.8
room 94.9
black and white 85.4
house 84
kitchen & dining room table 74
coffee table 73.2
building 69.2
furniture 52.1
couch 51.7
cluttered 16.1
desk 8.9

Face analysis

Amazon

Google

AWS Rekognition

Age 22-30
Gender Male, 98.6%
Sad 74.9%
Confused 18.6%
Calm 3.8%
Angry 1.1%
Surprised 0.5%
Happy 0.4%
Disgusted 0.3%
Fear 0.3%

AWS Rekognition

Age 18-24
Gender Male, 96.9%
Fear 57.6%
Calm 14.9%
Sad 8.7%
Surprised 8.2%
Happy 5.6%
Angry 1.9%
Disgusted 1.7%
Confused 1.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%
Chair 83.9%

Captions

Microsoft

an old photo of a living room 82.5%
an old photo of a living room filled with furniture and a tv 57%
old photo of a living room 56.9%

Text analysis

Amazon

STEINMETZ,
FLORIDA
STEINMETZ, SARASOTA. FLORIDA
SARASOTA.
61461.
KODYK
I

Google

STEINMETZ, SARASOTA. FLORIDA
STEINMETZ,
SARASOTA.
FLORIDA