Human Generated Data

Title

Untitled (women sitting around table, Old Ferry Tavern, Pennsylvania)
Date

c. 1936, printed later
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.251
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (women sitting around table, Old Ferry Tavern, Pennsylvania)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1936, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.251

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.4
Human 99.4
Person 99.1
Chair 98.9
Furniture 98.9
Person 98.5
Person 98.4
Indoors 97.3
Room 97.3
Sitting 91.5
Chair 83.4
Living Room 83.3
Restaurant 81.5
Dressing Room 79.6
Chair 78
Bedroom 68.7
Cafeteria 65.3
Cafe 63.7
Chair 61.7
Dining Table 61.4
Table 61.4
Couch 58.9
Dining Room 58.6
Worker 58.4
Dorm Room 57.5

Clarifai
created on 2023-10-25

people 99.8
furniture 99.2
chair 99.2
room 98.9
table 97.9
group together 97.7
adult 96.9
man 96.6
group 96.5
home 96.5
dining room 96.4
family 96
woman 95.9
seat 92.4
restaurant 92.2
indoors 92.1
three 89.9
dining 89.3
monochrome 88.3
house 86.6

Imagga
created on 2022-01-08

barbershop 83.7
shop 68.2
mercantile establishment 52
interior 49.5
chair 36.4
room 35
place of business 34.8
modern 32.2
table 29.6
restaurant 29
furniture 25.6
floor 24.2
inside 23
design 22.5
indoors 21.9
house 21.7
kitchen 20.7
counter 20.4
architecture 18.7
dining 18.1
decor 17.7
home 17.5
establishment 17.4
building 16.8
cafeteria 16.4
glass 16.3
light 16
wood 15.8
empty 15.4
comfortable 15.3
business 15.2
office 14.9
equipment 14.7
contemporary 14.1
window 14
decoration 13.7
indoor 13.7
dinner 13.5
style 13.3
steel 13.2
bar 12.9
people 12.8
lamp 12.4
food 12.1
oven 12.1
luxury 12
stove 11.9
work 11.8
elegance 11.7
chairs 11.7
drink 11.7
party 11.2
life 10.9
nobody 10.9
drawer 10.9
seat 10.8
urban 10.5
industry 10.2
service 10.2
space 10.1
eat 10.1
stylish 9.9
stool 9.9
tables 9.8
structure 9.7
apartment 9.6
residential 9.6
lights 9.3
black 9
hospital 9
working 8.8
computer 8.8
scene 8.6
place 8.4
cook 8.2
plant 8.2
lifestyle 7.9
cabinets 7.9
refrigerator 7.9
wall 7.7
hotel 7.6
horizontal 7.5
city 7.5
occupation 7.3
center 7.3
industrial 7.3
transportation 7.2
night 7.1
travel 7

Google
created on 2022-01-08

Furniture 93.4
Table 93.4
Chair 89.6
Tableware 87.2
Black-and-white 84.9
Style 83.8
Suit 76.7
Monochrome photography 75.6
Monochrome 75.1
Dining room 69.7
Classic 68.5
Event 66.5
Sitting 66.4
Vintage clothing 66.1
Room 65.6
Stock photography 64.5
History 62.4
Art 59.8
Rectangle 56.7
Kitchen & dining room table 54.6

Microsoft
created on 2022-01-08

table 98.2
black and white 94.3
text 93.7
furniture 92.3
person 92
clothing 88
window 82.5
man 77.5
restaurant 76.4
monochrome 68.3
bar 60.7
chair 58.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 38-46
Gender Female, 99.5%
Calm 98.3%
Confused 1.1%
Sad 0.2%
Surprised 0.1%
Angry 0.1%
Happy 0.1%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 45-51
Gender Female, 99.4%
Calm 97.7%
Confused 1%
Sad 0.3%
Happy 0.3%
Fear 0.2%
Disgusted 0.2%
Surprised 0.1%
Angry 0.1%

AWS Rekognition

Age 25-35
Gender Male, 88.1%
Happy 76.1%
Calm 9.9%
Confused 6.4%
Surprised 4.6%
Sad 1%
Disgusted 1%
Angry 0.5%
Fear 0.4%

AWS Rekognition

Age 39-47
Gender Female, 61.6%
Calm 81.5%
Sad 15.1%
Angry 1.7%
Happy 0.8%
Surprised 0.4%
Disgusted 0.3%
Fear 0.2%
Confused 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Chair 98.9%
Dining Table 61.4%

Categories

Imagga

paintings art 77.6%
interior objects 20.7%

Captions

Microsoft
created on 2022-01-08

an old photo of a person 69.2%
a group of people in a store window 41.9%
a group of people in a room 41.8%