Human Generated Data

Title

Untitled (class photo on bleachers)

Date

1949

People

Artist: John Deusing, American active 1940s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1809

Human Generated Data

Title

Untitled (class photo on bleachers)

People

Artist: John Deusing, American active 1940s

Date

1949

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1809

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Human 98.1
Person 98.1
Person 95.8
Person 94.3
Person 93.4
Person 91.6
Room 84.8
Indoors 84.8
Person 84.6
Audience 84.5
Crowd 84.5
Person 83.1
Person 82
Person 80.6
Person 75.6
People 75.2
Person 72.1
Clothing 70.1
Apparel 70.1
School 65.6
Classroom 65.6
Person 63.2
Person 63.1
Female 59.9
Girl 57.9
Chair 57.6
Furniture 57.6
Dress 57.1
Suit 56.9
Coat 56.9
Overcoat 56.9
Drawing 55.4
Art 55.4

Clarifai
created on 2023-10-15

illustration 94.5
desktop 94.4
people 92.5
chair 91
design 87.1
abstract 86.9
group 86.5
decoration 86.1
monochrome 85.7
pattern 84.3
many 83.6
balcony 83.4
indoors 82.2
vector 81.4
crowd 81.2
horizontal 81.1
no person 80.5
empty 80.3
modern 79
light 78.8

Imagga
created on 2021-12-14

architecture 24.7
building 22.9
old 22.3
balcony 21.2
vintage 19
snow 17.6
grunge 17
sketch 16.3
drawing 16.2
city 15.8
antique 14.8
structure 14.7
retro 14.7
art 14.1
frame 13.9
money 13.6
design 13.5
paper 12.6
facade 11.9
bank 11.8
business 11.5
urban 11.4
construction 11.1
texture 11.1
fence 10.8
dirty 10.8
black 10.8
currency 10.8
wall 10.7
text 10.5
house 10.3
winter 10.2
sky 10.2
seat 10.1
space 10.1
paint 10
border 9.9
travel 9.9
tile 9.8
digital 9.7
decoration 9.7
pattern 9.6
cold 9.5
finance 9.3
history 8.9
us 8.7
home 8.6
park bench 8.5
grungy 8.5
tree 8.5
railing 8.1
film 8
computer 8
trees 8
ancient 7.8
bench 7.7
architectural 7.7
weathered 7.6
negative 7.5
tourism 7.4
dollar 7.4
street 7.4
historic 7.3
graphic 7.3
landmark 7.2
representation 7.1

Google
created on 2021-12-14

Microsoft
created on 2021-12-14

text 97.2
drawing 87.2
sketch 60.7
pattern 57.9

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 19-31
Gender Male, 65.5%
Happy 43.2%
Calm 41.7%
Sad 5.2%
Angry 3.7%
Confused 1.9%
Disgusted 1.5%
Surprised 1.4%
Fear 1.4%

AWS Rekognition

Age 48-66
Gender Male, 76.5%
Happy 39.2%
Calm 32.9%
Confused 11.2%
Sad 10%
Angry 2.7%
Disgusted 1.7%
Surprised 1.7%
Fear 0.6%

AWS Rekognition

Age 22-34
Gender Male, 87.2%
Happy 89.2%
Calm 5.7%
Confused 1.4%
Surprised 1.1%
Sad 1%
Fear 0.9%
Angry 0.6%
Disgusted 0.2%

AWS Rekognition

Age 36-52
Gender Male, 55.4%
Surprised 58%
Fear 20.2%
Happy 8.5%
Calm 6.3%
Disgusted 2.3%
Angry 2.2%
Confused 1.4%
Sad 1.1%

AWS Rekognition

Age 44-62
Gender Female, 53.6%
Calm 83%
Happy 6.5%
Sad 6.3%
Confused 1.2%
Angry 1.2%
Disgusted 0.7%
Surprised 0.6%
Fear 0.5%

AWS Rekognition

Age 36-54
Gender Male, 75%
Calm 54.5%
Happy 27.4%
Sad 7.3%
Surprised 4.4%
Fear 2.7%
Angry 1.4%
Disgusted 1.1%
Confused 1.1%

AWS Rekognition

Age 13-25
Gender Male, 69.9%
Calm 80.4%
Happy 10.1%
Sad 8.2%
Angry 0.7%
Confused 0.3%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 42-60
Gender Male, 67.3%
Fear 49.5%
Happy 12.4%
Confused 11.5%
Angry 6.3%
Disgusted 5.3%
Sad 5.3%
Surprised 4.9%
Calm 4.9%

AWS Rekognition

Age 34-50
Gender Male, 82.6%
Happy 59.9%
Calm 34.6%
Sad 1.8%
Confused 1%
Angry 0.8%
Fear 0.7%
Surprised 0.6%
Disgusted 0.5%

AWS Rekognition

Age 22-34
Gender Female, 59.4%
Calm 53.5%
Happy 31.3%
Confused 4%
Sad 3.8%
Angry 3.2%
Surprised 2%
Disgusted 1.4%
Fear 0.8%

AWS Rekognition

Age 31-47
Gender Female, 56.3%
Calm 87.9%
Sad 6%
Happy 2.8%
Confused 1%
Fear 1%
Angry 0.6%
Disgusted 0.4%
Surprised 0.3%

AWS Rekognition

Age 33-49
Gender Male, 83.3%
Calm 81.8%
Happy 12.2%
Sad 3%
Angry 1.5%
Confused 0.6%
Disgusted 0.4%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 31-47
Gender Male, 90.5%
Happy 71.7%
Calm 13%
Angry 6.9%
Fear 4.6%
Sad 2.7%
Confused 0.5%
Disgusted 0.3%
Surprised 0.3%

AWS Rekognition

Age 31-47
Gender Female, 76.9%
Calm 53.4%
Happy 17.8%
Surprised 8.6%
Fear 7.8%
Sad 7.7%
Angry 2.1%
Confused 1.6%
Disgusted 1.1%

AWS Rekognition

Age 17-29
Gender Female, 76.7%
Happy 84.1%
Calm 14.8%
Sad 0.9%
Fear 0.1%
Angry 0%
Confused 0%
Surprised 0%
Disgusted 0%

AWS Rekognition

Age 22-34
Gender Male, 82.7%
Happy 87.3%
Calm 9.8%
Angry 1%
Sad 0.8%
Fear 0.4%
Confused 0.3%
Surprised 0.3%
Disgusted 0.2%

AWS Rekognition

Age 33-49
Gender Male, 93.5%
Calm 87.1%
Disgusted 7.5%
Sad 1.6%
Confused 1.1%
Happy 1.1%
Angry 0.7%
Surprised 0.7%
Fear 0.2%

AWS Rekognition

Age 26-40
Gender Male, 76.5%
Calm 90.6%
Happy 3.3%
Sad 2.8%
Confused 1.8%
Angry 0.8%
Surprised 0.4%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 22-34
Gender Male, 53%
Calm 51.4%
Happy 42.2%
Sad 1.7%
Disgusted 1.5%
Confused 1.1%
Angry 1.1%
Surprised 0.8%
Fear 0.2%

AWS Rekognition

Age 23-37
Gender Female, 78%
Calm 86.3%
Happy 9.7%
Sad 2.3%
Angry 0.6%
Fear 0.5%
Disgusted 0.2%
Surprised 0.2%
Confused 0.1%

AWS Rekognition

Age 33-49
Gender Male, 89.6%
Calm 52.2%
Happy 18%
Sad 12%
Confused 7.5%
Surprised 3.9%
Fear 2.8%
Angry 2.7%
Disgusted 1.1%

AWS Rekognition

Age 22-34
Gender Male, 98.5%
Happy 58.4%
Calm 29.1%
Surprised 7.5%
Confused 2%
Sad 0.8%
Fear 0.8%
Angry 0.8%
Disgusted 0.4%

AWS Rekognition

Age 46-64
Gender Female, 59.3%
Happy 89.3%
Calm 7.1%
Sad 2.2%
Angry 0.7%
Fear 0.3%
Confused 0.2%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 18-30
Gender Male, 96.7%
Calm 82.5%
Angry 5.9%
Surprised 3.3%
Confused 2.9%
Disgusted 2.6%
Happy 2.3%
Sad 0.4%
Fear 0.2%

AWS Rekognition

Age 32-48
Gender Male, 93.4%
Happy 55.4%
Calm 20.4%
Sad 12.1%
Angry 5.4%
Confused 3.2%
Disgusted 1.6%
Fear 1.5%
Surprised 0.3%

AWS Rekognition

Age 18-30
Gender Female, 79.3%
Calm 84.1%
Sad 10.9%
Confused 3.4%
Happy 0.6%
Fear 0.4%
Surprised 0.3%
Angry 0.2%
Disgusted 0.1%

AWS Rekognition

Age 47-65
Gender Female, 81.1%
Happy 72.7%
Calm 21.9%
Sad 4.3%
Angry 0.6%
Confused 0.2%
Fear 0.1%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 42-60
Gender Female, 65.6%
Calm 77.3%
Surprised 5.3%
Sad 5.1%
Confused 4.4%
Happy 3.1%
Fear 2.1%
Disgusted 1.4%
Angry 1.4%

AWS Rekognition

Age 25-39
Gender Male, 77%
Fear 73.3%
Happy 8.4%
Surprised 6.4%
Calm 3.6%
Sad 2.8%
Angry 2.7%
Confused 1.9%
Disgusted 0.9%

AWS Rekognition

Age 11-21
Gender Female, 81.1%
Calm 68.6%
Sad 21.8%
Happy 5.1%
Angry 1.9%
Fear 0.9%
Confused 0.8%
Surprised 0.5%
Disgusted 0.3%

AWS Rekognition

Age 23-35
Gender Male, 85.8%
Happy 82.8%
Calm 9.9%
Angry 2%
Confused 1.4%
Sad 1.4%
Disgusted 1.2%
Surprised 0.9%
Fear 0.4%

AWS Rekognition

Age 44-62
Gender Female, 59%
Calm 55.4%
Happy 41.9%
Sad 1.3%
Surprised 0.5%
Angry 0.4%
Disgusted 0.2%
Fear 0.2%
Confused 0.1%

AWS Rekognition

Age 25-39
Gender Female, 74.4%
Calm 69.3%
Sad 19.2%
Fear 5.2%
Happy 2%
Angry 1.4%
Surprised 1.2%
Confused 1.2%
Disgusted 0.6%

AWS Rekognition

Age 31-47
Gender Male, 84.2%
Happy 63.8%
Calm 26.2%
Sad 5.6%
Fear 2.1%
Angry 1.4%
Surprised 0.4%
Confused 0.4%
Disgusted 0.2%

AWS Rekognition

Age 3-11
Gender Female, 59.2%
Angry 42.9%
Calm 24.9%
Happy 17.3%
Sad 9.2%
Fear 2.5%
Confused 1.9%
Disgusted 0.7%
Surprised 0.6%

AWS Rekognition

Age 45-63
Gender Male, 87.6%
Calm 65.4%
Sad 23.6%
Angry 4.7%
Confused 3%
Fear 1.4%
Happy 0.8%
Surprised 0.7%
Disgusted 0.5%

AWS Rekognition

Age 24-38
Gender Female, 56.5%
Calm 69.8%
Sad 24.1%
Happy 1.7%
Angry 1.6%
Fear 1%
Confused 0.7%
Surprised 0.7%
Disgusted 0.4%

AWS Rekognition

Age 38-56
Gender Male, 88.6%
Happy 82.2%
Calm 9.4%
Sad 3.3%
Fear 1.7%
Angry 1.2%
Surprised 1%
Confused 0.7%
Disgusted 0.6%

AWS Rekognition

Age 16-28
Gender Female, 52.1%
Calm 52.4%
Sad 23.7%
Fear 10.1%
Happy 4.4%
Disgusted 2.7%
Confused 2.7%
Surprised 2.4%
Angry 1.6%

AWS Rekognition

Age 23-35
Gender Male, 63.6%
Calm 76.4%
Happy 7.6%
Sad 5.7%
Surprised 3.1%
Confused 2.4%
Angry 2.2%
Fear 1.5%
Disgusted 1%

AWS Rekognition

Age 20-32
Gender Male, 88.8%
Calm 49.5%
Happy 46.5%
Sad 1.3%
Angry 0.9%
Surprised 0.6%
Confused 0.4%
Fear 0.4%
Disgusted 0.3%

AWS Rekognition

Age 8-18
Gender Male, 94.5%
Happy 89.3%
Calm 8.1%
Disgusted 1%
Confused 0.8%
Angry 0.3%
Surprised 0.3%
Sad 0.1%
Fear 0%

AWS Rekognition

Age 16-28
Gender Male, 78.7%
Calm 78.9%
Sad 9.5%
Surprised 3.4%
Confused 3%
Fear 1.9%
Angry 1.7%
Happy 1.2%
Disgusted 0.4%

AWS Rekognition

Age 52-70
Gender Female, 67.2%
Happy 63.8%
Fear 14.5%
Sad 5.3%
Calm 4.2%
Surprised 4.2%
Angry 3.7%
Disgusted 2.6%
Confused 1.8%

AWS Rekognition

Age 32-48
Gender Female, 91.7%
Happy 56.4%
Sad 25.9%
Calm 9.2%
Angry 3.6%
Fear 3%
Surprised 0.9%
Disgusted 0.7%
Confused 0.4%

AWS Rekognition

Age 24-38
Gender Male, 78.4%
Calm 68.1%
Happy 11.3%
Sad 9.4%
Confused 5.3%
Angry 3.9%
Surprised 0.7%
Disgusted 0.6%
Fear 0.6%

AWS Rekognition

Age 24-38
Gender Male, 73.4%
Happy 62.5%
Calm 21.7%
Fear 5.5%
Sad 5%
Confused 1.7%
Angry 1.5%
Surprised 1.5%
Disgusted 0.5%

AWS Rekognition

Age 33-49
Gender Male, 93.9%
Calm 58.1%
Sad 13.1%
Happy 8.8%
Surprised 6.2%
Angry 5.1%
Fear 3.8%
Confused 3.2%
Disgusted 1.6%

AWS Rekognition

Age 23-35
Gender Male, 78%
Calm 82.4%
Happy 7.9%
Sad 5.3%
Angry 1.6%
Fear 0.9%
Surprised 0.8%
Disgusted 0.6%
Confused 0.4%

AWS Rekognition

Age 22-34
Gender Male, 97.8%
Happy 58%
Calm 27.5%
Confused 7.3%
Sad 4.2%
Angry 1%
Surprised 0.8%
Disgusted 0.8%
Fear 0.5%

AWS Rekognition

Age 3-11
Gender Female, 83.9%
Calm 50.4%
Confused 13.6%
Sad 12.3%
Fear 9.3%
Happy 7.5%
Angry 2.6%
Surprised 2.2%
Disgusted 2%

AWS Rekognition

Age 22-34
Gender Male, 67.4%
Calm 57.7%
Happy 26.3%
Sad 12%
Angry 2.3%
Confused 0.8%
Disgusted 0.5%
Fear 0.3%
Surprised 0.1%

AWS Rekognition

Age 22-34
Gender Male, 79.3%
Calm 66%
Angry 10.1%
Surprised 7.8%
Happy 5.9%
Confused 5.1%
Sad 2.3%
Fear 1.5%
Disgusted 1.3%

AWS Rekognition

Age 26-42
Gender Female, 53.2%
Calm 56.6%
Sad 26.9%
Happy 10.9%
Confused 1.7%
Angry 1.3%
Disgusted 1.1%
Fear 0.9%
Surprised 0.6%

AWS Rekognition

Age 42-60
Gender Male, 72.2%
Calm 45.3%
Happy 43%
Fear 3%
Surprised 2.4%
Disgusted 2%
Sad 1.9%
Confused 1.3%
Angry 1.1%

AWS Rekognition

Age 26-42
Gender Male, 59.2%
Calm 43.8%
Happy 34.8%
Sad 4.7%
Surprised 4.2%
Fear 4%
Confused 3.4%
Angry 3.4%
Disgusted 1.6%

AWS Rekognition

Age 38-56
Gender Male, 95.9%
Calm 54.7%
Confused 11.4%
Happy 11.4%
Sad 9.8%
Angry 8.2%
Disgusted 1.7%
Surprised 1.6%
Fear 1.1%

AWS Rekognition

Age 36-52
Gender Male, 82.2%
Calm 71.7%
Happy 20.1%
Sad 3.3%
Angry 2.4%
Confused 0.7%
Fear 0.7%
Disgusted 0.6%
Surprised 0.5%

AWS Rekognition

Age 22-34
Gender Male, 51.7%
Calm 51.2%
Happy 32.2%
Angry 5.8%
Sad 3.8%
Confused 2.4%
Surprised 1.7%
Fear 1.6%
Disgusted 1.2%

AWS Rekognition

Age 36-52
Gender Female, 87.7%
Happy 61.7%
Calm 29.6%
Sad 2.8%
Confused 1.7%
Angry 1.4%
Surprised 1.2%
Disgusted 1.2%
Fear 0.4%

AWS Rekognition

Age 32-48
Gender Female, 67.2%
Happy 65.5%
Calm 32.1%
Angry 0.9%
Sad 0.8%
Surprised 0.3%
Confused 0.2%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 15-27
Gender Male, 84.1%
Happy 76.2%
Calm 11.6%
Sad 4.7%
Angry 2.6%
Confused 2.1%
Fear 1.5%
Surprised 0.8%
Disgusted 0.5%

AWS Rekognition

Age 24-38
Gender Male, 85.2%
Calm 70.8%
Happy 8.5%
Confused 6.4%
Sad 4.8%
Surprised 3.8%
Angry 3.1%
Fear 1.6%
Disgusted 1.1%

AWS Rekognition

Age 54-72
Gender Male, 86.4%
Calm 40.1%
Sad 36.2%
Angry 8.1%
Happy 7.1%
Confused 6.2%
Disgusted 1.1%
Fear 0.7%
Surprised 0.3%

AWS Rekognition

Age 19-31
Gender Male, 91.9%
Calm 64.1%
Happy 28.4%
Sad 2.3%
Confused 1.5%
Surprised 1.3%
Fear 0.9%
Angry 0.9%
Disgusted 0.6%

AWS Rekognition

Age 50-68
Gender Female, 73.1%
Calm 61.2%
Happy 19.2%
Sad 11.5%
Angry 3.1%
Confused 1.8%
Disgusted 1.6%
Fear 1.1%
Surprised 0.5%

AWS Rekognition

Age 24-38
Gender Female, 67.8%
Calm 70%
Happy 20.5%
Sad 5%
Angry 2.8%
Fear 0.6%
Surprised 0.5%
Confused 0.4%
Disgusted 0.3%

AWS Rekognition

Age 20-32
Gender Male, 85.4%
Happy 75.3%
Calm 14.9%
Sad 2.7%
Angry 2.2%
Confused 1.9%
Surprised 1.8%
Fear 0.6%
Disgusted 0.5%

AWS Rekognition

Age 23-35
Gender Male, 95.5%
Happy 89.4%
Calm 7.5%
Sad 1.8%
Fear 0.5%
Angry 0.4%
Confused 0.2%
Surprised 0.2%
Disgusted 0.1%

AWS Rekognition

Age 42-60
Gender Male, 95.2%
Calm 60.9%
Surprised 12.7%
Disgusted 10.5%
Happy 6.4%
Confused 3.3%
Fear 2.6%
Sad 2.5%
Angry 1%

AWS Rekognition

Age 22-34
Gender Male, 76.1%
Happy 27.9%
Calm 27.8%
Sad 23.2%
Angry 12.2%
Confused 5.7%
Surprised 1.4%
Fear 1.2%
Disgusted 0.6%

AWS Rekognition

Age 34-50
Gender Male, 62.9%
Happy 56.8%
Calm 38.7%
Confused 1.8%
Sad 0.9%
Surprised 0.8%
Angry 0.7%
Disgusted 0.3%
Fear 0.1%

AWS Rekognition

Age 49-67
Gender Female, 78.3%
Calm 50.2%
Sad 35.7%
Happy 10.5%
Confused 2.3%
Angry 0.6%
Disgusted 0.3%
Surprised 0.3%
Fear 0.1%

AWS Rekognition

Age 36-54
Gender Male, 92.6%
Happy 92%
Calm 5.6%
Sad 0.8%
Angry 0.5%
Confused 0.4%
Surprised 0.3%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 23-37
Gender Female, 78.4%
Calm 46.1%
Happy 33.1%
Sad 13.2%
Angry 2.9%
Fear 1.6%
Confused 1.6%
Disgusted 0.8%
Surprised 0.7%

AWS Rekognition

Age 25-39
Gender Male, 86.6%
Calm 80.6%
Sad 15.9%
Happy 2%
Confused 0.7%
Angry 0.4%
Surprised 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 22-34
Gender Male, 94.7%
Calm 35%
Happy 23.9%
Confused 16.8%
Surprised 8.9%
Fear 6.5%
Angry 3.9%
Sad 2.8%
Disgusted 2.3%

AWS Rekognition

Age 21-33
Gender Female, 59.2%
Calm 90.3%
Sad 4.9%
Happy 3%
Surprised 0.6%
Fear 0.4%
Angry 0.3%
Confused 0.3%
Disgusted 0.1%

AWS Rekognition

Age 40-58
Gender Female, 85.8%
Happy 39.3%
Calm 23.5%
Angry 13.2%
Fear 12%
Sad 8.6%
Surprised 2.1%
Confused 0.7%
Disgusted 0.7%

AWS Rekognition

Age 19-31
Gender Male, 86.2%
Happy 84.6%
Calm 12.7%
Sad 1.1%
Confused 0.6%
Surprised 0.4%
Angry 0.2%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 30-46
Gender Male, 94.9%
Calm 54.3%
Happy 37.2%
Confused 2.8%
Sad 2.3%
Surprised 1.9%
Disgusted 0.5%
Angry 0.5%
Fear 0.4%

AWS Rekognition

Age 23-35
Gender Male, 91.9%
Calm 58.8%
Surprised 25.5%
Confused 6.1%
Happy 5.3%
Fear 1.7%
Angry 1.1%
Sad 1%
Disgusted 0.5%

AWS Rekognition

Age 41-59
Gender Male, 67.8%
Calm 53.1%
Happy 38.1%
Sad 3.8%
Confused 1.4%
Surprised 1.3%
Angry 1.2%
Disgusted 0.6%
Fear 0.5%

AWS Rekognition

Age 20-32
Gender Female, 73.4%
Calm 55.6%
Happy 36.2%
Sad 5.3%
Confused 0.8%
Angry 0.6%
Disgusted 0.6%
Surprised 0.5%
Fear 0.5%

AWS Rekognition

Age 23-35
Gender Male, 77.1%
Sad 46%
Calm 42.6%
Happy 5.6%
Confused 2.3%
Angry 1.4%
Surprised 0.8%
Disgusted 0.7%
Fear 0.5%

AWS Rekognition

Age 26-42
Gender Male, 77.4%
Calm 37.9%
Sad 31.4%
Happy 17.2%
Confused 5.6%
Fear 2.5%
Angry 2.4%
Surprised 2.1%
Disgusted 0.9%

Feature analysis

Amazon

Person 98.1%

Categories

Imagga

paintings art 82.5%
interior objects 11.5%
text visuals 5.6%

Captions

Microsoft
created on 2021-12-14

an old photo of a person 52.5%
old photo of a person 47.5%
an old photo of a person 47.4%