Human Generated Data

Title

Untitled (men sitting at long tales at Federal Shipbuilding restaurant, Kearny, NJ)
Date

1936
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12050
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (men sitting at long tales at Federal Shipbuilding restaurant, Kearny, NJ)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1936

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Person 99.7
Human 99.7
Person 97.6
Person 95.8
Person 94.7
Person 92.8
Person 91.8
Person 91.8
Person 91.3
Person 89.9
Building 88.2
Person 87.6
Chair 85.9
Furniture 85.9
Person 83.2
Cafeteria 78.4
Restaurant 78.4
Person 69.9
Person 69.7
Person 69.7
Shelter 69
Nature 69
Countryside 69
Rural 69
Outdoors 69
Indoors 67
Person 64.9
People 62.7
Female 61.5
Crowd 61.5
Girl 60.4
Factory 56.9
Classroom 56.6
Room 56.6
School 56.6
Hall 55.7

Imagga
created on 2022-01-15

building 25
structure 23
landscape 21.6
city 20.8
architecture 20.6
tree 19.7
travel 19
tourism 19
center 18.8
old 17.4
hall 17
house 16.7
trees 16
vacation 14.7
sky 14.7
snow 13.4
tourist 13.1
summer 12.9
fence 12.7
scenic 12.3
destination 12.1
winter 11.9
university 11.7
outdoor 11.5
sea 10.9
park 10.7
water 10.7
urban 10.5
history 9.8
rural 9.7
houses 9.7
resort 9.6
room 9.6
scene 9.5
holiday 9.3
world 9.3
wall 9.2
classroom 9.1
landmark 9
scenery 9
hut 8.9
crowd 8.6
stone 8.6
beach 8.4
palm 8.4
outdoors 8.4
wood 8.3
traditional 8.3
street 8.3
historic 8.2
roof 8.2
sun 8
plant 7.9
sand 7.8
forest 7.8
season 7.8
construction 7.7
culture 7.7
attraction 7.6
clouds 7.6
journey 7.5
town 7.4
shelter 7.3
group 7.3
road 7.2
coast 7.2
home 7.2
picket fence 7.1
village 7.1
country 7

Google
created on 2022-01-15

Art 82.6
Line 81.9
Monochrome 75.7
Event 72.3
Monochrome photography 67.6
Illustration 67.5
Suit 66.2
Room 65.4
Font 64.9
Drawing 64.9
Stock photography 64.6
History 64.4
Painting 63.8
Paper product 63.2
Crowd 61
Team 57
Uniform 56.4
Class 56.3
Table 56.1
Rectangle 56.1

Microsoft
created on 2022-01-15

text 99.4
building 99.2
chair 75.3
table 54.8
store 34.6
crowd 20.1
clothes 15.8

Face analysis

Amazon

AWS Rekognition

Age 54-62
Gender Male, 99.6%
Calm 99.8%
Sad 0.1%
Surprised 0%
Happy 0%
Disgusted 0%
Confused 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 45-51
Gender Male, 99.8%
Calm 98.3%
Happy 1.1%
Surprised 0.2%
Confused 0.1%
Disgusted 0.1%
Sad 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 23-31
Gender Male, 93.1%
Fear 41.7%
Confused 26.3%
Surprised 11.9%
Happy 10.4%
Angry 2.9%
Disgusted 2.4%
Sad 2.2%
Calm 2.1%

AWS Rekognition

Age 30-40
Gender Male, 95.8%
Sad 29.5%
Confused 23.5%
Angry 12.1%
Happy 10.3%
Calm 9.8%
Surprised 6.4%
Fear 5.4%
Disgusted 2.8%

AWS Rekognition

Age 18-24
Gender Male, 91.5%
Calm 92.7%
Happy 3%
Angry 2.1%
Sad 0.9%
Disgusted 0.4%
Confused 0.4%
Fear 0.3%
Surprised 0.3%

AWS Rekognition

Age 24-34
Gender Female, 51.6%
Calm 88.7%
Happy 10.8%
Sad 0.2%
Confused 0.1%
Disgusted 0.1%
Fear 0.1%
Angry 0%
Surprised 0%

AWS Rekognition

Age 31-41
Gender Female, 55.1%
Calm 92.5%
Happy 5.6%
Sad 1.3%
Confused 0.2%
Disgusted 0.1%
Fear 0.1%
Angry 0.1%
Surprised 0.1%

AWS Rekognition

Age 21-29
Gender Male, 69.4%
Calm 94.9%
Happy 2.9%
Sad 0.9%
Confused 0.6%
Fear 0.4%
Disgusted 0.2%
Surprised 0.2%
Angry 0.1%

AWS Rekognition

Age 41-49
Gender Male, 92.8%
Calm 97.2%
Sad 1%
Happy 0.8%
Confused 0.6%
Disgusted 0.2%
Surprised 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 23-31
Gender Male, 74.4%
Happy 35.6%
Sad 34.5%
Calm 20.4%
Confused 3.3%
Surprised 1.9%
Disgusted 1.8%
Fear 1.3%
Angry 1%

AWS Rekognition

Age 21-29
Gender Female, 82.3%
Calm 95%
Fear 4%
Sad 0.7%
Surprised 0.1%
Disgusted 0.1%
Confused 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 25-35
Gender Male, 99.8%
Sad 66.5%
Calm 21.5%
Confused 6.4%
Happy 1.6%
Surprised 1.5%
Disgusted 1%
Angry 0.7%
Fear 0.7%

AWS Rekognition

Age 18-26
Gender Male, 79.3%
Calm 89%
Sad 6.2%
Happy 2.8%
Fear 0.8%
Confused 0.4%
Angry 0.3%
Disgusted 0.2%
Surprised 0.2%

AWS Rekognition

Age 23-33
Gender Male, 75.7%
Calm 74.2%
Happy 17.9%
Fear 2.7%
Sad 1.6%
Disgusted 1.3%
Angry 0.9%
Surprised 0.9%
Confused 0.4%

AWS Rekognition

Age 16-22
Gender Male, 97.5%
Calm 31.8%
Sad 21.8%
Confused 20.4%
Happy 10.6%
Angry 6.9%
Disgusted 4.3%
Surprised 2.2%
Fear 1.9%

AWS Rekognition

Age 27-37
Gender Male, 99.9%
Calm 90.6%
Happy 6.3%
Confused 0.7%
Disgusted 0.7%
Surprised 0.7%
Sad 0.4%
Fear 0.3%
Angry 0.3%

AWS Rekognition

Age 23-31
Gender Male, 99.9%
Calm 43.7%
Sad 30.5%
Happy 18.6%
Confused 2.8%
Surprised 1.4%
Disgusted 1.2%
Fear 1.1%
Angry 0.7%

AWS Rekognition

Age 22-30
Gender Male, 81.7%
Calm 98.1%
Sad 1.1%
Happy 0.2%
Disgusted 0.2%
Angry 0.2%
Confused 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 30-40
Gender Male, 89.6%
Happy 64.4%
Calm 9.6%
Surprised 7.5%
Sad 6.6%
Fear 5.2%
Disgusted 3.3%
Angry 2.2%
Confused 1.1%

AWS Rekognition

Age 18-26
Gender Male, 95.3%
Calm 54%
Sad 18.1%
Happy 10%
Fear 6.8%
Angry 6%
Disgusted 2.4%
Confused 2%
Surprised 0.7%

AWS Rekognition

Age 29-39
Gender Male, 96.9%
Calm 55%
Sad 18.4%
Happy 9.8%
Confused 8.9%
Angry 3.3%
Disgusted 2.5%
Surprised 1.4%
Fear 0.7%

AWS Rekognition

Age 45-51
Gender Male, 80.8%
Calm 71.7%
Happy 14%
Angry 4.6%
Sad 3.4%
Fear 2.9%
Surprised 1.5%
Disgusted 1.3%
Confused 0.5%

AWS Rekognition

Age 10-18
Gender Female, 59.6%
Calm 90%
Sad 6.5%
Happy 1.3%
Fear 0.6%
Disgusted 0.6%
Confused 0.4%
Angry 0.4%
Surprised 0.2%

AWS Rekognition

Age 4-10
Gender Female, 72.6%
Sad 47.1%
Calm 44.5%
Confused 4.2%
Angry 1.1%
Fear 1.1%
Happy 1%
Disgusted 0.6%
Surprised 0.5%

AWS Rekognition

Age 13-21
Gender Male, 95.7%
Calm 90.6%
Sad 6.8%
Angry 0.7%
Fear 0.5%
Disgusted 0.4%
Happy 0.4%
Confused 0.3%
Surprised 0.3%

AWS Rekognition

Age 24-34
Gender Male, 97.1%
Calm 93.3%
Sad 3.2%
Angry 1.2%
Happy 0.8%
Fear 0.8%
Surprised 0.4%
Disgusted 0.2%
Confused 0.2%

AWS Rekognition

Age 21-29
Gender Male, 95.3%
Sad 50.1%
Confused 19.2%
Happy 12.4%
Calm 11.5%
Surprised 2.1%
Disgusted 2%
Fear 1.4%
Angry 1.3%

AWS Rekognition

Age 25-35
Gender Female, 55.2%
Calm 84.7%
Sad 13.2%
Confused 1%
Happy 0.4%
Surprised 0.2%
Fear 0.2%
Angry 0.2%
Disgusted 0.1%

AWS Rekognition

Age 16-24
Gender Female, 94.2%
Calm 49.5%
Surprised 20.9%
Fear 12%
Happy 8.1%
Sad 3.7%
Disgusted 2.9%
Confused 1.5%
Angry 1.5%

AWS Rekognition

Age 33-41
Gender Male, 99.8%
Happy 49.8%
Sad 19.5%
Calm 16.3%
Disgusted 4.3%
Angry 3.2%
Confused 2.9%
Surprised 2.5%
Fear 1.5%

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a group of people standing in front of a building 90.1%
a group of people standing in front of a store 83.5%
a group of people in front of a building 83.4%

Text analysis

Amazon

.A
..A lines .A
..A
lines