Human Generated Data

Title

Untitled (family seated at dinner table, Broomall, PA)
Date

1941
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11965
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (family seated at dinner table, Broomall, PA)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Chair 99.8
Furniture 99.8
Person 98.7
Human 98.7
Table 98.4
Dining Table 98.4
Chair 96.8
Restaurant 96.3
Chair 94.1
Tabletop 93.6
Dining Room 92.7
Room 92.7
Indoors 92.7
Person 90.7
Person 88.3
Interior Design 88.1
Person 82.4
Cafeteria 72.2
Cafe 71
Meal 70.1
Food 70.1
Living Room 59.7
Face 59.2
Dish 59.2

Imagga
created on 2022-01-15

room 92.3
classroom 63.5
table 60
interior 56.6
chair 53.7
furniture 48.5
home 32.7
modern 31.6
house 30.9
floor 29.8
design 27
window 26.9
wood 25.9
decor 25.6
indoors 25.5
restaurant 25.5
dining 21.9
seat 21.1
inside 20.3
indoor 20.1
apartment 19.2
desk 18.9
decoration 17.4
kitchen 16.8
chairs 16.7
residential 16.3
comfortable 16.2
architecture 15.6
empty 15.5
light 15.4
contemporary 15
glass 14.8
wall 14.6
luxury 14.6
sofa 13.7
domestic 13.6
style 13.4
lamp 13.4
wooden 13.2
blackboard 13.1
office 12.9
living 12.3
building 11.2
structure 11.1
cabinet 11
lifestyle 10.8
education 10.4
business 10.3
sitting 10.3
relaxation 10.1
furnishing 9.7
lighting 9.7
counter 9.6
estate 9.5
school 9.3
nobody 9.3
relax 9.3
elegance 9.2
rug 8.9
salon 8.8
carpet 8.8
class 8.7
real 8.5
dinner 8.4
hall 8.3
bar 8.3
board 8.2
plant 8.2
cafeteria 8.2
stove 8
food 8
work 8
stool 7.9
urban 7.9
oven 7.9
sink 7.8
tile 7.8
vase 7.7
couch 7.7
comfort 7.7
decorate 7.6
person 7.5
study 7.5
reflection 7.4
man 7.4
group 7.3
people 7.3
metal 7.2
women 7.1
steel 7.1

Google
created on 2022-01-15

Furniture 93.4
Table 92.6
Chair 87.6
Black-and-white 85.4
Style 83.8
Building 80.6
Desk 78.5
Tableware 78.2
Door 77.6
Monochrome 76.7
Rectangle 76.1
Art 75.4
Monochrome photography 74.9
Font 72.5
Room 69.1
Suit 67.3
Sitting 65
Illustration 63.9
Stock photography 62.5
Machine 62.4

Microsoft
created on 2022-01-15

text 99.4
furniture 98.6
table 97.6
chair 94.3
indoor 90.9
house 78.1
kitchen & dining room table 76.7
black and white 75.5
coffee table 70.3
desk 58
building 55.1

Face analysis

Amazon

Google

AWS Rekognition

Age 33-41
Gender Male, 97.2%
Happy 94.6%
Surprised 2.7%
Calm 1.8%
Sad 0.4%
Fear 0.1%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Chair 99.8%
Person 98.7%

Captions

Microsoft

a group of people in a room 77.6%
a group of people sitting at a desk 64.2%
a group of people sitting at a table 43.1%

Text analysis

Amazon

15816A
ar
15816A.

Google

9
A
8
158)6A-
158)6A- 158)6 A YAGOX-YT37A2-NAMTE 9 8 ar 3x889
158)6
YAGOX-YT37A2-NAMTE
ar
3x889