Human Generated Data

Title

Untitled (men and women seated in a large theater)

Date

c. 1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5639

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (men and women seated in a large theater)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5639

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Human 96.2
Person 92.6
Crowd 92.1
Indoors 86.8
Audience 85.3
Interior Design 82.4
Text 80
Person 76.9
People 76.2
Room 72.6
Suit 67.2
Clothing 67.2
Coat 67.2
Overcoat 67.2
Apparel 67.2
Person 66.4
Theater 64.2
Concert 58
Wedding 56

Clarifai
created on 2023-10-15

people 99.9
many 99.3
group 99.1
crowd 99
man 97.8
adult 97.6
illustration 95.9
child 95.4
audience 93.4
war 91.7
group together 90.7
administration 87.8
leader 87.3
woman 85
military 83.5
monochrome 82.8
spectator 80.5
sit 80.1
boy 78.4
music 78.3

Imagga
created on 2021-12-15

billboard 41.2
signboard 33.7
structure 33.1
old 26.5
vintage 26.5
grunge 25.5
sky 20.4
landscape 20.1
ancient 19.9
aged 19
texture 18.1
retro 18
negative 17.8
travel 16.9
film 16.9
city 16.6
wall 16.1
black 15.6
antique 15.6
frame 15
tourism 14.9
space 14.7
canyon 13.8
scenery 13.5
newspaper 13.5
art 13.4
grungy 13.3
border 12.7
mountain 12.5
trees 12.5
park 12.4
snow 12.3
tree 12.3
rock 12.2
stone 12.1
paint 11.8
architecture 11.7
rough 10.9
design 10.7
scenic 10.5
urban 10.5
text 10.5
product 10.4
national 10
desert 9.7
damaged 9.5
graphic 9.5
blank 9.4
paper 9.4
winter 9.4
daily 9.2
decoration 9.1
environment 9
history 8.9
pattern 8.9
textured 8.8
edge 8.7
scene 8.7
creation 8.6
worn 8.6
empty 8.6
canvas 8.5
clouds 8.5
wallpaper 8.4
color 8.3
mountains 8.3
building 8.2
dirty 8.1
backgrounds 8.1
horizon 8.1
coast 8.1
water 8
photographic paper 7.8
forest 7.8
card 7.7
weathered 7.6
skyline 7.6
cityscape 7.6
buildings 7.6
lake 7.5
silhouette 7.5
element 7.4
style 7.4
grain 7.4
natural 7.4
brown 7.4
material 7.1

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

text 99.8
person 94
white 76.6
black 72.2
old 54.7
posing 52.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 49-67
Gender Female, 66.3%
Calm 64.8%
Happy 24.5%
Sad 7.8%
Angry 2.3%
Confused 0.5%
Disgusted 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 39-57
Gender Female, 81.3%
Calm 91.3%
Happy 7.7%
Sad 0.8%
Angry 0.1%
Confused 0.1%
Disgusted 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 48-66
Gender Female, 69.2%
Calm 98.9%
Sad 0.4%
Happy 0.4%
Angry 0.1%
Confused 0.1%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 29-45
Gender Female, 64%
Sad 71.1%
Calm 21.9%
Happy 2.1%
Confused 1.9%
Fear 1.8%
Angry 0.6%
Surprised 0.3%
Disgusted 0.1%

AWS Rekognition

Age 40-58
Gender Female, 72.2%
Calm 50.8%
Sad 24.1%
Happy 21.4%
Confused 1.4%
Fear 0.9%
Surprised 0.6%
Angry 0.5%
Disgusted 0.2%

AWS Rekognition

Age 57-75
Gender Male, 78.4%
Calm 51.8%
Happy 19.5%
Sad 17.3%
Confused 7.8%
Angry 1.6%
Surprised 0.9%
Disgusted 0.7%
Fear 0.4%

AWS Rekognition

Age 26-40
Gender Female, 61.2%
Calm 91.8%
Sad 6.9%
Happy 0.8%
Angry 0.2%
Confused 0.1%
Surprised 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 55-73
Gender Female, 68.8%
Sad 85.8%
Calm 11.3%
Happy 2%
Confused 0.3%
Fear 0.3%
Angry 0.2%
Surprised 0%
Disgusted 0%

AWS Rekognition

Age 41-59
Gender Male, 68.5%
Calm 58.5%
Sad 16.3%
Confused 10.7%
Happy 10.2%
Surprised 2.4%
Angry 1.3%
Disgusted 0.5%
Fear 0.2%

AWS Rekognition

Age 55-73
Gender Female, 52.5%
Calm 82.7%
Confused 5.8%
Happy 4.8%
Sad 3.8%
Surprised 2.3%
Angry 0.4%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 42-60
Gender Female, 98.1%
Happy 48.9%
Calm 32.4%
Sad 15.6%
Fear 1.6%
Angry 0.6%
Confused 0.4%
Surprised 0.3%
Disgusted 0.1%

AWS Rekognition

Age 45-63
Gender Male, 79.2%
Sad 50.5%
Calm 33.2%
Happy 14.4%
Angry 1%
Confused 0.6%
Fear 0.1%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 41-59
Gender Male, 52.2%
Calm 50.2%
Sad 18.3%
Happy 18.2%
Angry 6.9%
Surprised 2.8%
Confused 2.2%
Fear 0.9%
Disgusted 0.6%

AWS Rekognition

Age 26-42
Gender Male, 69.6%
Calm 53.2%
Sad 44.1%
Angry 1%
Happy 0.9%
Confused 0.3%
Surprised 0.3%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 44-62
Gender Male, 58.6%
Calm 86.2%
Sad 5.4%
Happy 4%
Confused 1.9%
Angry 1.2%
Surprised 0.9%
Fear 0.3%
Disgusted 0.2%

AWS Rekognition

Age 36-54
Gender Male, 61.1%
Calm 88.8%
Angry 5.9%
Sad 2.7%
Confused 1.7%
Happy 0.4%
Surprised 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 23-35
Gender Female, 73.9%
Calm 47.2%
Sad 24.1%
Happy 22.8%
Angry 1.5%
Confused 1.4%
Fear 1.4%
Surprised 1.3%
Disgusted 0.4%

AWS Rekognition

Age 44-62
Gender Male, 66%
Calm 69.5%
Happy 25.4%
Sad 2%
Surprised 1.2%
Confused 0.8%
Angry 0.7%
Disgusted 0.3%
Fear 0.1%

AWS Rekognition

Age 42-60
Gender Female, 76.4%
Calm 47.5%
Sad 43.3%
Confused 3.9%
Happy 3.3%
Angry 1.2%
Disgusted 0.3%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 23-35
Gender Male, 59.3%
Happy 89.5%
Calm 7.6%
Sad 1.7%
Angry 0.5%
Confused 0.4%
Surprised 0.2%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 23-35
Gender Female, 88.3%
Calm 77.1%
Happy 12.5%
Sad 7.6%
Angry 1.1%
Confused 0.7%
Surprised 0.4%
Fear 0.4%
Disgusted 0.2%

AWS Rekognition

Age 48-66
Gender Male, 92.3%
Calm 67%
Sad 21.9%
Happy 7.9%
Angry 1.3%
Confused 1.1%
Surprised 0.4%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 51-69
Gender Female, 81.1%
Happy 62.6%
Calm 22.9%
Sad 10.7%
Angry 1.6%
Confused 0.8%
Fear 0.7%
Surprised 0.4%
Disgusted 0.3%

AWS Rekognition

Age 33-49
Gender Male, 58.5%
Sad 83%
Calm 10.5%
Confused 2.2%
Surprised 1.3%
Angry 1.2%
Happy 1%
Fear 0.6%
Disgusted 0.2%

AWS Rekognition

Age 44-62
Gender Female, 71.2%
Happy 50.9%
Calm 37.9%
Sad 5.5%
Angry 4%
Surprised 0.8%
Confused 0.6%
Fear 0.3%
Disgusted 0.2%

AWS Rekognition

Age 27-43
Gender Female, 69.9%
Happy 27.5%
Fear 25.3%
Sad 24.1%
Calm 13.6%
Angry 4.8%
Confused 2.2%
Surprised 1.9%
Disgusted 0.5%

AWS Rekognition

Age 46-64
Gender Female, 89.5%
Happy 89.9%
Calm 5.9%
Sad 2.1%
Surprised 1%
Angry 0.4%
Confused 0.4%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 39-57
Gender Female, 83.3%
Calm 70%
Happy 19.5%
Sad 7.7%
Confused 1.3%
Angry 0.7%
Surprised 0.5%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 36-52
Gender Female, 77.8%
Calm 51.9%
Sad 35.6%
Happy 9.4%
Confused 1.4%
Angry 0.7%
Surprised 0.6%
Fear 0.3%
Disgusted 0.1%

AWS Rekognition

Age 33-49
Gender Male, 64%
Sad 81%
Calm 10.6%
Happy 3.2%
Confused 2.4%
Fear 1.1%
Angry 1%
Surprised 0.4%
Disgusted 0.2%

AWS Rekognition

Age 32-48
Gender Female, 71.3%
Calm 62.1%
Sad 33.7%
Fear 1.2%
Happy 0.9%
Surprised 0.7%
Confused 0.6%
Disgusted 0.4%
Angry 0.4%

AWS Rekognition

Age 45-63
Gender Male, 84.6%
Calm 54.7%
Sad 27.3%
Happy 16.5%
Confused 0.6%
Angry 0.5%
Surprised 0.3%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 41-59
Gender Female, 83.4%
Sad 62.3%
Calm 29%
Happy 7.7%
Confused 0.5%
Fear 0.2%
Angry 0.2%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 38-56
Gender Female, 61.3%
Happy 62.6%
Calm 31.2%
Sad 3.2%
Confused 1%
Angry 0.9%
Surprised 0.6%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 37-55
Gender Male, 61.7%
Calm 62.8%
Happy 31.5%
Sad 4.8%
Angry 0.3%
Confused 0.3%
Surprised 0.2%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 45-63
Gender Female, 51.3%
Calm 55.9%
Sad 39%
Happy 3.2%
Confused 1%
Angry 0.5%
Fear 0.2%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 49-67
Gender Female, 75.7%
Calm 40%
Sad 38.2%
Happy 14%
Angry 3%
Confused 2.5%
Surprised 1.3%
Disgusted 0.7%
Fear 0.3%

AWS Rekognition

Age 26-42
Gender Male, 89%
Calm 83.5%
Sad 10.7%
Happy 3.2%
Angry 1%
Confused 0.8%
Surprised 0.4%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 34-50
Gender Female, 67.9%
Sad 49.9%
Calm 35.8%
Happy 13%
Angry 0.4%
Confused 0.4%
Surprised 0.2%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 24-38
Gender Female, 89.8%
Sad 75.8%
Calm 21.2%
Happy 2.3%
Confused 0.4%
Angry 0.1%
Fear 0.1%
Surprised 0.1%
Disgusted 0%

AWS Rekognition

Age 42-60
Gender Female, 55.9%
Sad 52.3%
Calm 36.3%
Happy 9.5%
Confused 0.7%
Angry 0.4%
Disgusted 0.4%
Fear 0.2%
Surprised 0.2%

AWS Rekognition

Age 51-69
Gender Female, 84.9%
Sad 78.6%
Calm 19.8%
Happy 0.6%
Angry 0.5%
Confused 0.2%
Surprised 0.2%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 36-52
Gender Female, 90.4%
Happy 91.5%
Calm 5.6%
Sad 2.5%
Confused 0.1%
Fear 0.1%
Disgusted 0.1%
Angry 0.1%
Surprised 0.1%

AWS Rekognition

Age 44-62
Gender Male, 80.3%
Calm 91.5%
Happy 4.7%
Sad 3%
Confused 0.5%
Angry 0.2%
Surprised 0.2%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 18-30
Gender Female, 63.1%
Sad 69.8%
Calm 27.3%
Happy 2.2%
Confused 0.3%
Angry 0.2%
Fear 0.2%
Surprised 0%
Disgusted 0%

AWS Rekognition

Age 34-50
Gender Female, 55%
Calm 38.6%
Happy 37.7%
Confused 6.6%
Sad 6%
Surprised 5.3%
Angry 4%
Fear 1.3%
Disgusted 0.6%

AWS Rekognition

Age 29-45
Gender Female, 63.5%
Calm 49.7%
Happy 30.1%
Sad 8%
Confused 5.4%
Surprised 3.1%
Angry 2.2%
Fear 0.7%
Disgusted 0.6%

AWS Rekognition

Age 28-44
Gender Male, 81.9%
Calm 74.9%
Happy 23.5%
Sad 1.1%
Angry 0.2%
Confused 0.1%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 42-60
Gender Female, 55.8%
Happy 60.3%
Calm 31.8%
Sad 3.5%
Angry 1.5%
Fear 1.2%
Surprised 0.8%
Confused 0.7%
Disgusted 0.3%

AWS Rekognition

Age 5-15
Gender Male, 59.7%
Calm 83.8%
Happy 14.2%
Sad 1.7%
Angry 0.1%
Confused 0.1%
Surprised 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 27-43
Gender Male, 76%
Calm 25.9%
Surprised 23.5%
Confused 12.1%
Fear 11.2%
Angry 10.1%
Sad 8.4%
Happy 6.6%
Disgusted 2.2%

AWS Rekognition

Age 36-52
Gender Female, 71.5%
Calm 40.2%
Sad 24.6%
Happy 22.4%
Confused 9.5%
Angry 2.5%
Surprised 0.3%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 30-46
Gender Female, 94.3%
Happy 40.4%
Calm 39.6%
Sad 17.6%
Angry 1.2%
Confused 0.5%
Fear 0.3%
Disgusted 0.2%
Surprised 0.2%

AWS Rekognition

Age 18-30
Gender Female, 66.7%
Sad 47.9%
Calm 39.4%
Happy 10.6%
Angry 1.1%
Confused 0.7%
Fear 0.2%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 38-56
Gender Male, 52.6%
Calm 58.6%
Happy 24.5%
Confused 7.8%
Sad 6%
Angry 2.3%
Disgusted 0.4%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 28-44
Gender Female, 63.4%
Calm 49.6%
Happy 30%
Sad 18.1%
Angry 0.8%
Confused 0.7%
Fear 0.4%
Surprised 0.2%
Disgusted 0.1%

AWS Rekognition

Age 29-45
Gender Female, 77.2%
Calm 65.6%
Sad 21.4%
Happy 10%
Surprised 0.9%
Angry 0.8%
Fear 0.6%
Confused 0.5%
Disgusted 0.2%

AWS Rekognition

Age 39-57
Gender Female, 52.1%
Sad 57.2%
Calm 20.4%
Happy 9.4%
Angry 7.7%
Confused 3.1%
Fear 1.1%
Surprised 0.6%
Disgusted 0.5%

AWS Rekognition

Age 2-8
Gender Female, 96.9%
Happy 83.3%
Sad 5.5%
Calm 4.4%
Angry 4.3%
Fear 1.3%
Disgusted 0.6%
Confused 0.4%
Surprised 0.3%

AWS Rekognition

Age 31-47
Gender Female, 89.1%
Happy 46.9%
Sad 31.4%
Calm 9.3%
Fear 9.3%
Surprised 1.3%
Angry 0.8%
Confused 0.7%
Disgusted 0.2%

AWS Rekognition

Age 30-46
Gender Female, 94.6%
Calm 61.1%
Sad 16.8%
Happy 16.1%
Angry 3.5%
Confused 1.2%
Surprised 0.6%
Disgusted 0.3%
Fear 0.3%

AWS Rekognition

Age 46-64
Gender Female, 64.4%
Sad 92.5%
Calm 5.5%
Happy 1.2%
Confused 0.3%
Angry 0.2%
Fear 0.1%
Disgusted 0.1%
Surprised 0%

AWS Rekognition

Age 17-29
Gender Female, 81.8%
Calm 76.1%
Sad 8.7%
Happy 8.5%
Angry 3.8%
Confused 1.7%
Disgusted 0.6%
Fear 0.4%
Surprised 0.2%

AWS Rekognition

Age 36-54
Gender Female, 97.7%
Sad 49.3%
Calm 41.8%
Happy 3%
Surprised 1.9%
Confused 1.7%
Fear 1.4%
Angry 0.5%
Disgusted 0.4%

AWS Rekognition

Age 5-15
Gender Female, 77.9%
Calm 78.5%
Happy 13.4%
Sad 5.1%
Angry 1.6%
Confused 0.7%
Surprised 0.3%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 26-42
Gender Female, 56.7%
Calm 52.4%
Happy 27.4%
Sad 15.1%
Confused 2.1%
Angry 1.8%
Surprised 0.5%
Disgusted 0.4%
Fear 0.3%

AWS Rekognition

Age 16-28
Gender Female, 53.9%
Calm 50%
Sad 40.4%
Happy 5.7%
Angry 2.1%
Confused 1.1%
Surprised 0.3%
Fear 0.3%
Disgusted 0.1%

AWS Rekognition

Age 34-50
Gender Female, 85.3%
Calm 76.5%
Sad 20.2%
Happy 2.1%
Angry 0.5%
Confused 0.3%
Fear 0.2%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 45-63
Gender Female, 61.2%
Calm 84.5%
Sad 10.2%
Happy 3.7%
Confused 1%
Surprised 0.2%
Angry 0.2%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 38-56
Gender Male, 54.7%
Sad 49.5%
Calm 46.8%
Happy 1.4%
Confused 1.2%
Surprised 0.4%
Angry 0.4%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 26-42
Gender Male, 76%
Calm 76.7%
Happy 22.2%
Sad 0.9%
Angry 0.1%
Confused 0%
Disgusted 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 45-63
Gender Female, 80.9%
Happy 76.7%
Calm 14.1%
Sad 4.6%
Surprised 2.5%
Angry 0.8%
Fear 0.7%
Confused 0.5%
Disgusted 0.2%

AWS Rekognition

Age 42-60
Gender Male, 90.3%
Calm 69.1%
Sad 15.9%
Happy 6.1%
Angry 4.5%
Confused 3.1%
Surprised 0.6%
Disgusted 0.4%
Fear 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 92.6%

Text analysis

Amazon

13877.
13877

Google

8 3ו 13877.
8
13877.