Human Generated Data

Title

Untitled (Harbor Inn dining room, Punta Gorda, FL)
Date

c. 1965
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11414
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Harbor Inn dining room, Punta Gorda, FL)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1965

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-14

Restaurant 100
Chair 99.8
Furniture 99.8
Cafeteria 98.2
Person 98
Human 98
Chair 98
Chair 97.9
Person 97.6
Person 96.6
Person 96.6
Person 96.1
Person 95
Cafe 93.6
Person 92.1
Chair 90.4
Food Court 86.7
Food 86.7
Person 84.2
Person 83.3
Meal 75.3
Chair 65.7
Person 61.3

Imagga
created on 2022-01-14

restaurant 70.5
interior 59.3
barbershop 52.4
cafeteria 51.2
shop 46.8
chair 46.6
room 44.8
table 44.4
building 39.4
furniture 35
mercantile establishment 32.7
modern 31.6
salon 30.5
structure 27.9
house 25.9
design 25.9
dining 24.8
office 24.4
wood 24.2
indoors 23.7
floor 23.3
home 23.1
kitchen 22.5
decor 22.1
place of business 22
inside 21.2
counter 21.1
glass 21
indoor 20.1
empty 19.8
contemporary 19.8
style 19.3
seat 18.7
luxury 18
light 17.4
food 16.9
dinner 16.9
decoration 15.9
nobody 15.6
drink 15.1
bar 14.8
chairs 14.7
classroom 13.8
comfortable 13.4
service 13
drawer 12.9
stove 12.8
business 12.8
work 12.6
architecture 12.5
desk 12.5
computer 12
establishment 12
stool 11.9
oven 11.8
hotel 11.5
lamp 11.4
people 11.2
window 11
eat 10.9
stylish 10.9
tables 10.8
residential 10.5
decorate 10.5
plant 10.5
elegant 10.3
meal 9.7
lunch 9.7
education 9.5
party 9.5
lifestyle 9.4
plate 9.3
coffee 9.3
elegance 9.2
cook 9.2
cabinets 8.9
upscale 8.9
success 8.9
wooden 8.8
man 8.7
place 8.4
equipment 8.2
refrigerator 7.9
urban 7.9
person 7.9
napkin 7.8
3d 7.7
class 7.7
wall 7.7
professional 7.7
apartment 7.7
relax 7.6
living 7.6
lights 7.4
occupation 7.3
island 7.3
group 7.3
steel 7.1
working 7.1

Google
created on 2022-01-14

Black 89.5
Table 86.9
Black-and-white 86.4
Style 84
Chair 83
Monochrome photography 76
Plant 74.7
Monochrome 74.7
Art 72.5
T-shirt 70.2
Machine 68.3
Room 67.4
Building 66.9
Sitting 64.8
Stock photography 62.4
Cooking 60.2
Photographic paper 55.5
Font 55.2
Street 54
Shelf 53

Microsoft
created on 2022-01-14

text 98.5
table 98.3
furniture 96
person 94.9
indoor 94.8
chair 85.5
black and white 77.6
building 76.5
people 69.7
kitchen & dining room table 65.6
group 56.6
vase 53.2
tableware 52.7
working 51
cluttered 19.2

Face analysis

Amazon

Google

AWS Rekognition

Age 38-46
Gender Male, 95.1%
Calm 74.3%
Sad 14.1%
Confused 8.3%
Angry 0.9%
Disgusted 0.9%
Surprised 0.7%
Happy 0.5%
Fear 0.4%

AWS Rekognition

Age 38-46
Gender Male, 99.8%
Calm 75.6%
Sad 18.2%
Disgusted 1.7%
Angry 1.3%
Confused 1.2%
Happy 1%
Surprised 0.8%
Fear 0.2%

AWS Rekognition

Age 23-31
Gender Male, 86.1%
Calm 56.6%
Angry 11.7%
Happy 9.6%
Disgusted 9.5%
Sad 9.1%
Confused 2.1%
Surprised 0.7%
Fear 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Chair 99.8%
Person 98%

Captions

Microsoft

a group of people sitting at a table 94.9%
a group of people sitting at a table in a restaurant 94.2%
a group of people sitting around a table 94.1%

Text analysis

Amazon

DP
REGOR
MJIF--YT3RA°2