Human Generated Data

Title

Untitled (Ben Stahl and family in living room)

Date

1955

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7876

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Ben Stahl and family in living room)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Room 99.6
Indoors 99.6
Chair 99.2
Furniture 99.2
Person 98.7
Human 98.7
Person 96.5
Person 96.3
Person 89.7
Chair 88.9
Chair 87.8
Dressing Room 86
Living Room 79.7
Restaurant 77.1
Chair 76.6
Dining Room 71
Interior Design 63.9
Cafeteria 57.2

Imagga
created on 2022-01-09

room 65.2
interior 56.6
chair 54.8
table 51.9
furniture 45.4
house 35.1
home 33.1
modern 32.9
floor 30.7
window 29
decor 26.5
design 26.5
wood 25.9
patio 24.2
seat 23.9
indoors 23.7
luxury 23.2
inside 23
area 22.3
glass 22.1
structure 22
architecture 22
restaurant 21.8
comfortable 19.1
wall 19.1
style 18.5
classroom 18.1
living 18
chairs 17.6
office 17.4
dining 17.1
contemporary 16.9
sofa 16.1
light 15.4
dinner 15.3
residential 15.3
building 14.9
kitchen 14.8
nobody 14.8
indoor 14.6
hall 14
empty 13.9
lamp 13.3
decoration 13
stylish 12.7
apartment 12.5
estate 12.4
elegance 11.8
3d 11.6
real 11.4
tile 10.9
tables 10.8
lighting 10.6
hotel 10.5
decorate 10.5
plant 10.4
business 10.3
food 10.3
door 10.3
counter 10.2
domestic 9.9
hospital 9.8
elegant 9.4
bar 9.2
desk 9.1
center 8.8
urban 8.7
toilet 8.7
vase 8.7
couch 8.7
lifestyle 8.7
expensive 8.6
lunch 8.6
eat 8.4
relaxation 8.4
bathroom 8.4
drink 8.4
cabinet 8
upscale 7.9
sink 7.8
place 7.4
meal 7.4
coffee 7.4
service 7.4
cook 7.3
black 7.2
cafeteria 7.2
stool 7

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

table 98.4
chair 97.1
vase 96.1
coffee table 94.5
text 91.9
indoor 90.8
kitchen & dining room table 88.6
house 88.3
window 85.1
black and white 78.5
mirror 72.6
interior design 70.5
couch 69.3
white 66.8
curtain 66.4
bed 65.4
studio couch 64.9
room 62.1
interior 59.3
furniture 34.3
cluttered 10.5
dining table 6.6

Face analysis

Amazon

Google

AWS Rekognition

Age 43-51
Gender Male, 99.9%
Calm 97.8%
Sad 0.8%
Fear 0.4%
Happy 0.3%
Disgusted 0.2%
Confused 0.2%
Angry 0.2%
Surprised 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Chair 99.2%
Person 98.7%

Captions

Microsoft

a group of people sitting at a table in front of a window 60.2%
a room filled with furniture and a window 60.1%
a room filled with furniture and a large window 60%

Text analysis

Amazon

snhw

Google

17--YT37A°2 - - XAGON
17--YT37A°2
-
XAGON