Human Generated Data

Title

Untitled (Ben Stahl and family in living room)

Date

1955

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7870

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Ben Stahl and family in living room)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.3
Human 99.3
Room 99.3
Indoors 99.3
Chair 99.3
Furniture 99.3
Person 96.1
Person 92.3
Chair 90.4
Chair 89.8
Dressing Room 85
Person 83.6
Restaurant 79.4
Person 77.2
Living Room 70.1
Chair 65.2
Cafeteria 59.4
Cafe 57.1

Imagga
created on 2022-01-09

room 67.7
chair 60.3
interior 57.5
table 57.2
furniture 47.8
restaurant 40.3
modern 31.6
house 30.9
floor 30.7
patio 28.8
structure 28.4
home 28.3
decor 28.3
cafeteria 27.8
seat 27.1
design 27
area 26.9
dining 25.7
window 24.3
wood 24.2
inside 23.9
classroom 23.2
luxury 23.2
hall 23
building 22.5
glass 21.3
contemporary 20.7
indoors 20.2
chairs 19.6
architecture 19.5
dinner 18.7
style 17.8
indoor 17.4
nobody 16.3
kitchen 15.6
empty 15.6
office 15.1
decoration 14.5
light 14
tables 13.8
elegant 13.7
residential 13.4
drink 13.4
lunch 13.1
food 12.8
eat 12.6
apartment 12.5
comfortable 12.4
hotel 12.4
lamp 12.4
setting 11.6
meal 11.5
counter 11.4
decorate 11.4
wall 11.4
living 11.4
plant 11.2
business 10.9
stylish 10.9
3d 10.8
estate 10.5
service 10.2
bar 10.2
elegance 10.1
stool 10.1
upscale 9.9
tile 9.8
dining table 9.7
banquet 9.7
sofa 9.7
party 9.5
folding chair 9.4
event 9.3
cabinets 8.9
drawer 8.9
stove 8.9
catering 8.8
urban 8.7
lifestyle 8.7
expensive 8.6
real 8.5
center 8.3
deck 8.3
cook 8.2
hardwood 7.9
day 7.9
reception 7.8
space 7.8
desk 7.7
lighting 7.7
relax 7.6
relaxation 7.5
hospital 7.5
place 7.5
lights 7.4
coffee 7.4
wine 7.4
domestic 7.2
residence 7.2
life 7

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

table 98.5
chair 97.3
floor 94.2
vase 93.6
indoor 93.1
coffee table 91.5
text 90.8
house 88.7
window 87.9
kitchen & dining room table 86.5
bed 73.7
curtain 70.1
interior design 68.2
mirror 66.8
white 66.3
couch 64.1
black and white 58.4
studio couch 56.5
room 55.9
furniture 46.5
cluttered 10.8
dining table 7.6

Face analysis

Amazon

AWS Rekognition

Age 28-38
Gender Male, 100%
Calm 99.6%
Sad 0.1%
Surprised 0.1%
Happy 0.1%
Fear 0.1%
Confused 0%
Disgusted 0%
Angry 0%

Feature analysis

Amazon

Person 99.3%
Chair 99.3%

Captions

Microsoft

a room filled with furniture and a window 85.4%
a room filled with furniture and a large window 83.7%
a room filled with furniture next to a window 80.4%

Text analysis

Amazon

MING

Google

SI MJ -YT3RA°2--XA
-YT3RA°2--XA
SI
MJ