Human Generated Data

Title

Untitled (standing group portrait of employees from Mutual Life of Newark, NJ)
Date

1972
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11450
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (standing group portrait of employees from Mutual Life of Newark, NJ)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1972

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11450

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-14

Human 96.9
Military 94.6
Military Uniform 93.2
Person 93.2
People 91
Person 90.5
Army 86.9
Armored 86.9
Person 84.1
Crowd 81.5
Person 77.3
Collage 76
Poster 76
Advertisement 76
Troop 75.8
Text 75.3
Person 69.5
Art 67.4
Person 66
Airplane 61.9
Transportation 61.9
Vehicle 61.9
Aircraft 61.9
Suit 60.3
Clothing 60.3
Coat 60.3
Overcoat 60.3
Apparel 60.3
Soldier 58.6

Clarifai
created on 2023-10-25

people 99.9
many 99.7
crowd 98.9
group 98.5
man 96.5
adult 95.5
audience 92.5
war 92.2
education 90.9
leader 89.3
administration 88.2
illustration 88.1
group together 87.9
interaction 85.7
military 85.6
desktop 85.2
woman 81.7
spectator 80.8
music 78.1
conformity 76.8

Imagga
created on 2022-01-14

jigsaw puzzle 100
puzzle 99.9
game 68.6
old 34.1
grunge 33.2
texture 32
aged 24.4
vintage 21.5
wall 21.3
art 20.5
pattern 20.5
grungy 19
design 18
map 17.6
ancient 17.3
surface 16.8
antique 16.5
dirty 16.3
rough 15.5
retro 14.7
wallpaper 14.5
paint 14.5
textured 13.1
brown 12.5
city 12.5
worn 12.4
architecture 11.7
material 11.6
world 11.5
rusty 11.4
weathered 11.4
drawing 11.2
black 10.8
stain 10.6
travel 10.6
decorative 10
frame 10
backdrop 9.9
detail 9.7
rust 9.6
atlas 9.6
north 9.6
damaged 9.5
color 9.5
blank 9.4
structure 9.4
decoration 9.3
grain 9.2
history 8.9
country 8.8
building 8.8
graphic 8.8
continent 8.7
geography 8.7
aging 8.6
paper 8.6
empty 8.6
dark 8.4
global 8.2
border 8.1
creative 7.9
artistic 7.8
messy 7.7
decay 7.7
rustic 7.7
floral 7.7
seamless 7.6
ocean 7.5
element 7.4
town 7.4
park 7.4
exterior 7.4
earth 7.3
digital 7.3
stone 7.3
lines 7.2
modern 7

Google
created on 2022-01-14

Font 80.6
Art 74.4
Monochrome 71.5
Event 71.4
Crowd 70.3
Pole 69.2
Monochrome photography 68.7
History 67.9
Room 67.1
Chair 64.5
Urban design 63
Paper product 62.4
Team 60.5
Illustration 59.9
Holy places 56.1
Metal 53.9
Visual arts 53.8
Photographic paper 52.9
Uniform 52.6
Collection 50.2

Microsoft
created on 2022-01-14

text 99.5
posing 99.1
book 90.5
person 88.2
group 86.9
old 81.1
standing 80.8
white 69.2
people 56
drawing 54.9
team 52.6
vintage 30.3
dressed 26.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 19-27
Gender Male, 91.7%
Disgusted 82.2%
Surprised 6.8%
Sad 3.8%
Confused 2.9%
Calm 1.3%
Angry 1.3%
Happy 1%
Fear 0.7%

AWS Rekognition

Age 29-39
Gender Male, 93.2%
Calm 51.1%
Fear 31.8%
Surprised 6.3%
Happy 3.9%
Angry 2.3%
Sad 2.2%
Disgusted 1.5%
Confused 1%

AWS Rekognition

Age 22-30
Gender Male, 97.1%
Disgusted 27.1%
Happy 20.4%
Angry 18%
Calm 13.9%
Fear 7.7%
Sad 7.2%
Surprised 4.7%
Confused 1%

AWS Rekognition

Age 22-30
Gender Female, 92.6%
Calm 27.7%
Confused 22.1%
Sad 15.6%
Happy 11.7%
Surprised 9.9%
Disgusted 7.2%
Angry 3.5%
Fear 2.2%

AWS Rekognition

Age 25-35
Gender Male, 72.4%
Calm 47%
Sad 31.1%
Angry 7.2%
Disgusted 5.6%
Confused 4.7%
Surprised 1.8%
Fear 1.6%
Happy 0.9%

AWS Rekognition

Age 23-33
Gender Female, 81%
Calm 49.8%
Disgusted 15.6%
Happy 11.2%
Sad 10.2%
Surprised 5.3%
Angry 3.6%
Fear 3.5%
Confused 0.8%

AWS Rekognition

Age 20-28
Gender Male, 86.7%
Fear 87.9%
Disgusted 5.6%
Sad 1.9%
Happy 1.3%
Calm 1.2%
Angry 1.2%
Surprised 0.6%
Confused 0.3%

AWS Rekognition

Age 16-24
Gender Male, 99.1%
Sad 73.7%
Calm 19.5%
Angry 2%
Disgusted 1.8%
Fear 1.5%
Surprised 0.6%
Confused 0.5%
Happy 0.4%

AWS Rekognition

Age 45-51
Gender Female, 99.3%
Calm 51.4%
Fear 25.2%
Happy 10.8%
Surprised 7.8%
Disgusted 1.8%
Angry 1.2%
Sad 1%
Confused 0.7%

AWS Rekognition

Age 28-38
Gender Female, 94.9%
Fear 30.8%
Calm 29.6%
Surprised 12.9%
Disgusted 9.4%
Happy 8.7%
Sad 4.4%
Angry 3.3%
Confused 0.9%

AWS Rekognition

Age 20-28
Gender Male, 68.8%
Calm 78.5%
Confused 8.3%
Happy 4.9%
Sad 3.5%
Angry 1.5%
Surprised 1.5%
Disgusted 0.9%
Fear 0.9%

AWS Rekognition

Age 40-48
Gender Male, 72.4%
Fear 33.2%
Calm 25.9%
Sad 15.5%
Disgusted 12.1%
Happy 5.9%
Angry 3.9%
Surprised 1.8%
Confused 1.7%

AWS Rekognition

Age 20-28
Gender Female, 73.2%
Happy 31.6%
Sad 31.3%
Disgusted 13.2%
Angry 8.1%
Surprised 6.8%
Fear 4.2%
Confused 2.5%
Calm 2.1%

AWS Rekognition

Age 18-24
Gender Female, 84.2%
Calm 97.8%
Sad 0.8%
Happy 0.4%
Angry 0.3%
Surprised 0.3%
Disgusted 0.2%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 16-22
Gender Male, 51.3%
Sad 85.2%
Surprised 5.7%
Calm 3%
Disgusted 1.6%
Happy 1.3%
Fear 1.3%
Angry 1.2%
Confused 0.7%

AWS Rekognition

Age 33-41
Gender Female, 96.5%
Calm 93.2%
Sad 1.9%
Disgusted 1.1%
Fear 1%
Surprised 0.8%
Angry 0.8%
Confused 0.7%
Happy 0.5%

AWS Rekognition

Age 21-29
Gender Female, 52.7%
Happy 88.1%
Surprised 10.5%
Calm 0.4%
Disgusted 0.3%
Angry 0.2%
Sad 0.2%
Fear 0.1%
Confused 0.1%

AWS Rekognition

Age 21-29
Gender Female, 67.7%
Calm 97.4%
Surprised 0.9%
Happy 0.7%
Confused 0.4%
Sad 0.2%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 22-30
Gender Male, 86.5%
Calm 25.7%
Disgusted 24.3%
Sad 19.3%
Angry 7.1%
Fear 6.9%
Confused 6.2%
Surprised 6.1%
Happy 4.4%

AWS Rekognition

Age 27-37
Gender Female, 96.3%
Calm 34.3%
Sad 27.4%
Angry 17.8%
Happy 5.9%
Fear 5.8%
Confused 3.7%
Disgusted 3.2%
Surprised 1.9%

AWS Rekognition

Age 10-18
Gender Female, 77.6%
Fear 44.2%
Calm 35.8%
Sad 7.7%
Surprised 5.3%
Angry 4.6%
Disgusted 1.3%
Happy 0.6%
Confused 0.5%

AWS Rekognition

Age 16-24
Gender Female, 95.9%
Sad 93.6%
Calm 2.4%
Fear 1.2%
Confused 0.9%
Angry 0.6%
Happy 0.5%
Disgusted 0.5%
Surprised 0.4%

AWS Rekognition

Age 20-28
Gender Male, 56.9%
Sad 40%
Fear 21.8%
Disgusted 19%
Calm 7.7%
Angry 3.7%
Happy 3.1%
Surprised 2.5%
Confused 2.2%

AWS Rekognition

Age 16-24
Gender Male, 97.9%
Calm 61%
Fear 27.1%
Disgusted 4.2%
Sad 2.9%
Happy 1.3%
Confused 1.2%
Surprised 1.2%
Angry 1.1%

AWS Rekognition

Age 18-24
Gender Male, 95.2%
Disgusted 72.7%
Sad 8.5%
Fear 5.4%
Angry 3.8%
Happy 3.7%
Surprised 3.2%
Calm 2.1%
Confused 0.6%

AWS Rekognition

Age 21-29
Gender Female, 65.9%
Fear 85.6%
Happy 3.9%
Surprised 3.3%
Sad 2.7%
Calm 1.7%
Disgusted 1.2%
Angry 0.9%
Confused 0.7%

AWS Rekognition

Age 21-29
Gender Male, 67%
Surprised 61.1%
Fear 16.6%
Calm 9.3%
Disgusted 5.7%
Sad 3.1%
Happy 2.2%
Angry 1.3%
Confused 0.7%

AWS Rekognition

Age 23-33
Gender Female, 70.4%
Surprised 73.8%
Calm 14.2%
Disgusted 4.5%
Happy 3.5%
Angry 1.5%
Sad 1.2%
Fear 0.9%
Confused 0.3%

AWS Rekognition

Age 27-37
Gender Female, 91.1%
Sad 55.4%
Disgusted 30.7%
Calm 7%
Happy 2.5%
Angry 2.2%
Fear 0.9%
Confused 0.7%
Surprised 0.6%

AWS Rekognition

Age 18-24
Gender Female, 98.6%
Fear 42.4%
Sad 36.1%
Disgusted 10.8%
Surprised 2.6%
Angry 2.4%
Calm 2.4%
Happy 2.2%
Confused 1.2%

AWS Rekognition

Age 21-29
Gender Female, 84.6%
Calm 95.2%
Angry 1.7%
Fear 1.1%
Sad 0.8%
Happy 0.6%
Confused 0.4%
Disgusted 0.2%
Surprised 0.1%

AWS Rekognition

Age 18-24
Gender Male, 94.2%
Calm 49.9%
Fear 30.8%
Sad 8.9%
Happy 3.9%
Disgusted 1.8%
Surprised 1.6%
Confused 1.5%
Angry 1.5%

AWS Rekognition

Age 22-30
Gender Male, 92.7%
Disgusted 81.6%
Sad 4.7%
Fear 4.4%
Surprised 3%
Angry 2.8%
Confused 1.7%
Happy 1%
Calm 0.9%

AWS Rekognition

Age 21-29
Gender Male, 62.7%
Disgusted 33%
Calm 30%
Fear 26.2%
Surprised 3.3%
Happy 3%
Angry 2.6%
Sad 1.3%
Confused 0.6%

AWS Rekognition

Age 10-18
Gender Female, 98.5%
Calm 77.6%
Fear 8.4%
Surprised 7.8%
Disgusted 2.5%
Sad 1.4%
Confused 1.3%
Happy 0.5%
Angry 0.4%

AWS Rekognition

Age 20-28
Gender Female, 95.4%
Calm 82.9%
Fear 8.4%
Disgusted 6.3%
Happy 0.7%
Surprised 0.6%
Angry 0.4%
Sad 0.4%
Confused 0.3%

AWS Rekognition

Age 23-31
Gender Female, 77.6%
Happy 45.2%
Fear 21.1%
Sad 9.4%
Calm 7.5%
Surprised 7.5%
Angry 3.9%
Disgusted 3.6%
Confused 1.9%

AWS Rekognition

Age 21-29
Gender Female, 57.2%
Disgusted 62.4%
Sad 34.3%
Angry 0.8%
Fear 0.6%
Surprised 0.5%
Happy 0.5%
Calm 0.4%
Confused 0.3%

AWS Rekognition

Age 21-29
Gender Female, 99.9%
Calm 61.8%
Happy 14%
Surprised 10.6%
Fear 4.8%
Disgusted 2.9%
Sad 2.5%
Confused 2.2%
Angry 1.2%

AWS Rekognition

Age 47-53
Gender Male, 90.9%
Disgusted 41.5%
Sad 21.2%
Happy 10.4%
Calm 7.3%
Fear 6%
Angry 5.4%
Surprised 5.3%
Confused 3%

AWS Rekognition

Age 21-29
Gender Female, 65.1%
Fear 53.2%
Calm 26.9%
Sad 9.4%
Disgusted 5.7%
Happy 2.7%
Angry 1%
Confused 0.7%
Surprised 0.4%

AWS Rekognition

Age 19-27
Gender Male, 77.6%
Fear 42.2%
Sad 19.7%
Surprised 14.5%
Angry 9.3%
Calm 6.2%
Disgusted 4.3%
Confused 2.7%
Happy 1.2%

AWS Rekognition

Age 22-30
Gender Male, 93.8%
Calm 35.8%
Surprised 30.4%
Sad 15.9%
Fear 5.4%
Angry 4.9%
Confused 3.6%
Happy 2.4%
Disgusted 1.6%

AWS Rekognition

Age 18-24
Gender Male, 82.6%
Sad 76.5%
Fear 12.6%
Calm 4.2%
Disgusted 3.2%
Happy 1.2%
Angry 1.1%
Surprised 0.9%
Confused 0.3%

AWS Rekognition

Age 23-31
Gender Male, 97.5%
Sad 90.9%
Calm 5.2%
Disgusted 1.9%
Angry 0.7%
Happy 0.6%
Fear 0.2%
Surprised 0.2%
Confused 0.1%

AWS Rekognition

Age 30-40
Gender Male, 60.4%
Calm 82.1%
Happy 8.7%
Surprised 6.9%
Disgusted 0.8%
Confused 0.5%
Angry 0.5%
Fear 0.4%
Sad 0.1%

AWS Rekognition

Age 24-34
Gender Male, 97.5%
Sad 80.8%
Disgusted 13.6%
Calm 2.9%
Confused 0.8%
Fear 0.8%
Angry 0.6%
Surprised 0.3%
Happy 0.3%

AWS Rekognition

Age 34-42
Gender Female, 89.3%
Sad 29.4%
Happy 26.3%
Fear 25.2%
Angry 6%
Calm 5.8%
Surprised 3%
Confused 2.2%
Disgusted 2.1%

AWS Rekognition

Age 28-38
Gender Female, 77.6%
Calm 68.9%
Happy 7.7%
Fear 7.7%
Surprised 5.6%
Angry 3.4%
Sad 2.8%
Disgusted 2.7%
Confused 1.3%

AWS Rekognition

Age 18-24
Gender Female, 83.6%
Calm 88.3%
Disgusted 6.6%
Fear 2%
Sad 1.4%
Happy 0.9%
Angry 0.5%
Confused 0.2%
Surprised 0.2%

AWS Rekognition

Age 27-37
Gender Female, 98.2%
Calm 43.1%
Surprised 24.1%
Fear 22%
Sad 4.7%
Disgusted 2.1%
Confused 2%
Angry 1.4%
Happy 0.6%

AWS Rekognition

Age 20-28
Gender Female, 97.3%
Calm 99.4%
Sad 0.3%
Confused 0.1%
Disgusted 0%
Surprised 0%
Happy 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 25-35
Gender Male, 96.8%
Disgusted 54.5%
Happy 14.1%
Sad 7.1%
Fear 7%
Calm 5%
Surprised 4.9%
Confused 4.3%
Angry 3.1%

AWS Rekognition

Age 27-37
Gender Male, 89.2%
Sad 83.4%
Happy 8%
Calm 2.3%
Disgusted 2.2%
Fear 1.9%
Surprised 1.1%
Angry 1%
Confused 0.3%

AWS Rekognition

Age 9-17
Gender Female, 85.8%
Calm 68.7%
Angry 13.2%
Sad 5%
Fear 4.5%
Surprised 3.6%
Happy 1.8%
Disgusted 1.8%
Confused 1.4%

AWS Rekognition

Age 30-40
Gender Female, 71.1%
Calm 33.5%
Happy 19.7%
Fear 19%
Sad 15.9%
Disgusted 3.9%
Angry 2.9%
Confused 2.8%
Surprised 2.3%

AWS Rekognition

Age 35-43
Gender Male, 99.4%
Sad 88.9%
Disgusted 8.2%
Happy 0.8%
Fear 0.7%
Calm 0.6%
Angry 0.4%
Confused 0.3%
Surprised 0.2%

AWS Rekognition

Age 22-30
Gender Female, 51.8%
Fear 45.9%
Calm 35.7%
Sad 7.2%
Confused 4.1%
Happy 3.1%
Angry 2.4%
Disgusted 1%
Surprised 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 93.2%
Airplane 61.9%

Text analysis

Amazon

4
KOOK

Google

NAGON
NAGON