Human Generated Data

Title

Untitled (boy scout polish troop, pulaski monument, Manchester, New Hampshire)

Date

1939, printed later

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.84

Human Generated Data

Title

Untitled (boy scout polish troop, pulaski monument, Manchester, New Hampshire)

People

Artist: Durette Studio, American 20th century

Date

1939, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.84

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.4
Human 99.4
Person 97.8
Horse 96.9
Animal 96.9
Mammal 96.9
Person 92.9
Monitor 92.7
Display 92.7
Screen 92.7
Electronics 92.7
Person 83.3
Person 81.4
Text 77.4
Crowd 76.5
Person 68.4
Person 66.6
LCD Screen 65
People 64.8
Person 63.5
Home Decor 61.2
Person 60
Person 55.6
Person 41.8

Clarifai
created on 2023-10-15

people 99.6
monochrome 98.3
group 97.5
many 95.1
art 95
street 94.9
music 92.6
movie 91.1
man 89.6
group together 88.8
cemetery 87.4
landscape 85.7
adult 85.2
child 84.7
documentary 84.6
crowd 83.1
war 82.7
cavalry 82.2
tree 81.5
analogue 79

Imagga
created on 2021-12-14

television 83
monitor 56.6
screen 55.7
telecommunication system 53.2
background 43.9
display 39.6
web site 29.3
electronic equipment 24.4
equipment 24
design 20.3
computer 20.2
technology 17.8
electronic device 17.5
frame 15.8
silhouette 15.7
black 15.6
flat 13.5
modern 13.3
digital 13
grunge 12.8
border 12.7
film 12.5
graphic 12.4
pattern 12.3
symbol 12.1
entertainment 12
people 11.7
art 11.7
vintage 11.6
business 11.5
person 11.2
old 11.1
movie 10.7
office 10.4
player 10.4
device 10.3
electronic 10.3
field 10
retro 9.8
texture 9.7
lights 9.3
event 9.2
rough 9.1
global 9.1
laptop 9.1
broadcasting 8.8
noise 8.8
object 8.8
audience 8.8
icon 8.7
video 8.7
skill 8.7
blank 8.6
dark 8.3
sky 8.3
competition 8.2
landscape 8.2
paint 8.1
dirty 8.1
home 8
shiny 7.9
text 7.9
nighttime 7.8
antique 7.8
stadium 7.8
championship 7.8
match 7.7
collage 7.7
crowd 7.7
wide 7.7
patriotic 7.7
muscular 7.6
damaged 7.6
athlete 7.6
tech 7.6
nation 7.6
sport 7.4
park 7.4
man 7.4
training 7.4
flag 7.3
color 7.2
road 7.2
sunset 7.2

Google
created on 2021-12-14

Microsoft
created on 2021-12-14

text 99.7
window 91.9
tree 91.2
screenshot 81
person 64.7
park 54

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 21-33
Gender Female, 91.3%
Calm 50.4%
Sad 22.4%
Happy 6.4%
Angry 6.4%
Confused 5.8%
Surprised 3.5%
Fear 2.6%
Disgusted 2.4%

AWS Rekognition

Age 18-30
Gender Male, 71.6%
Calm 98.6%
Sad 0.8%
Angry 0.2%
Confused 0.1%
Happy 0.1%
Surprised 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 2-8
Gender Female, 86%
Calm 88.6%
Happy 6.2%
Sad 1.9%
Disgusted 1%
Surprised 0.8%
Confused 0.8%
Angry 0.5%
Fear 0.3%

AWS Rekognition

Age 4-14
Gender Female, 90.3%
Calm 36.1%
Sad 34.3%
Confused 13.2%
Angry 11.2%
Surprised 2%
Disgusted 1.6%
Happy 1%
Fear 0.5%

AWS Rekognition

Age 13-23
Gender Female, 64.8%
Calm 68.3%
Sad 8.7%
Fear 6.6%
Happy 6.5%
Surprised 6.3%
Angry 1.4%
Confused 1.3%
Disgusted 0.8%

AWS Rekognition

Age 22-34
Gender Female, 88.7%
Happy 62.6%
Fear 26.3%
Surprised 5.1%
Sad 3.4%
Calm 0.9%
Confused 0.7%
Angry 0.6%
Disgusted 0.3%

AWS Rekognition

Age 13-23
Gender Female, 57%
Calm 48.8%
Sad 23.7%
Happy 10.1%
Confused 7.6%
Fear 5%
Angry 2%
Disgusted 1.9%
Surprised 1%

AWS Rekognition

Age 11-21
Gender Female, 79.9%
Calm 73.7%
Sad 15.9%
Fear 3%
Surprised 2%
Angry 1.8%
Happy 1.7%
Confused 1.2%
Disgusted 0.6%

AWS Rekognition

Age 4-12
Gender Female, 85.2%
Sad 47.4%
Calm 23.3%
Surprised 10.6%
Confused 7.7%
Fear 6.2%
Happy 2.3%
Disgusted 1.3%
Angry 1.2%

AWS Rekognition

Age 11-21
Gender Female, 81.7%
Calm 51%
Sad 33.7%
Angry 6%
Happy 3.8%
Confused 1.7%
Disgusted 1.5%
Fear 1.1%
Surprised 1%

AWS Rekognition

Age 29-45
Gender Male, 53.9%
Sad 52.9%
Calm 36.8%
Angry 2.6%
Happy 2.6%
Confused 1.7%
Fear 1.3%
Surprised 1.1%
Disgusted 1.1%

AWS Rekognition

Age 3-9
Gender Female, 96%
Calm 70.4%
Fear 12%
Sad 9.5%
Happy 2.7%
Surprised 2.7%
Disgusted 1.3%
Angry 0.8%
Confused 0.7%

AWS Rekognition

Age 2-8
Gender Male, 61.9%
Calm 58.1%
Sad 34.5%
Confused 2%
Fear 1.6%
Angry 1.4%
Happy 1.2%
Surprised 0.6%
Disgusted 0.6%

AWS Rekognition

Age 17-29
Gender Female, 96.6%
Happy 68.6%
Fear 22.4%
Calm 3.2%
Surprised 2.6%
Sad 1.7%
Angry 0.6%
Confused 0.5%
Disgusted 0.3%

AWS Rekognition

Age 8-18
Gender Female, 60.1%
Calm 68.7%
Angry 16.7%
Sad 5%
Confused 2.9%
Surprised 2.3%
Fear 1.7%
Happy 1.6%
Disgusted 1.2%

AWS Rekognition

Age 30-46
Gender Female, 95.2%
Calm 30.1%
Surprised 22.5%
Confused 13.2%
Happy 8.1%
Fear 7.7%
Disgusted 6.5%
Angry 6.1%
Sad 5.7%

AWS Rekognition

Age 20-32
Gender Female, 72.7%
Calm 79.5%
Happy 7.4%
Sad 4.7%
Confused 2.9%
Disgusted 2.7%
Angry 1.3%
Surprised 0.9%
Fear 0.6%

AWS Rekognition

Age 9-19
Gender Female, 93.6%
Happy 38.9%
Sad 17.8%
Disgusted 16.1%
Calm 15.7%
Fear 4.7%
Angry 2.5%
Confused 2.4%
Surprised 2%

AWS Rekognition

Age 22-34
Gender Male, 82%
Angry 61.4%
Calm 24.4%
Confused 5.3%
Happy 3.6%
Disgusted 1.8%
Sad 1.5%
Surprised 1.4%
Fear 0.5%

AWS Rekognition

Age 3-9
Gender Female, 71.2%
Calm 93.8%
Sad 2.6%
Happy 1.3%
Confused 0.6%
Surprised 0.5%
Angry 0.5%
Disgusted 0.4%
Fear 0.2%

AWS Rekognition

Age 26-40
Gender Male, 51.4%
Happy 50.7%
Calm 43.8%
Sad 2.7%
Confused 0.7%
Surprised 0.7%
Angry 0.6%
Fear 0.5%
Disgusted 0.4%

AWS Rekognition

Age 21-33
Gender Female, 58.7%
Sad 86.4%
Calm 10.8%
Confused 0.8%
Angry 0.6%
Fear 0.5%
Happy 0.4%
Surprised 0.3%
Disgusted 0.3%

AWS Rekognition

Age 25-39
Gender Female, 96.8%
Fear 85.7%
Calm 5.7%
Sad 4.1%
Surprised 2%
Angry 1.5%
Confused 0.5%
Disgusted 0.3%
Happy 0.3%

AWS Rekognition

Age 8-18
Gender Male, 74.1%
Surprised 41.2%
Calm 28.1%
Confused 13.1%
Sad 6.4%
Fear 6.1%
Angry 2.3%
Disgusted 1.5%
Happy 1.3%

AWS Rekognition

Age 37-55
Gender Female, 92.1%
Fear 93.3%
Sad 4.8%
Calm 0.5%
Surprised 0.4%
Happy 0.3%
Angry 0.3%
Confused 0.2%
Disgusted 0.1%

AWS Rekognition

Age 13-25
Gender Female, 54.8%
Calm 82.4%
Sad 6.4%
Angry 4.2%
Confused 2%
Surprised 1.8%
Fear 1.2%
Happy 1.1%
Disgusted 0.8%

AWS Rekognition

Age 49-67
Gender Male, 84.9%
Happy 24%
Calm 23.7%
Angry 16.2%
Surprised 13%
Confused 6.9%
Fear 6%
Sad 5.1%
Disgusted 5.1%

AWS Rekognition

Age 36-52
Gender Female, 78.9%
Fear 62.1%
Happy 23.7%
Calm 6%
Surprised 2.7%
Sad 2.2%
Angry 1.7%
Confused 1%
Disgusted 0.5%

AWS Rekognition

Age 36-52
Gender Female, 64.9%
Calm 82.4%
Happy 13.8%
Sad 1.5%
Angry 0.6%
Confused 0.6%
Surprised 0.4%
Fear 0.3%
Disgusted 0.3%

AWS Rekognition

Age 3-9
Gender Male, 89.6%
Sad 86.3%
Calm 6.4%
Angry 2.8%
Fear 1.9%
Confused 1.2%
Surprised 0.5%
Happy 0.5%
Disgusted 0.4%

AWS Rekognition

Age 9-19
Gender Male, 89.2%
Calm 96.3%
Disgusted 1.5%
Sad 0.7%
Surprised 0.5%
Happy 0.5%
Confused 0.3%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 4-14
Gender Female, 60.3%
Happy 75.5%
Calm 20.4%
Sad 1.1%
Disgusted 0.8%
Confused 0.7%
Surprised 0.7%
Fear 0.4%
Angry 0.4%

AWS Rekognition

Age 2-8
Gender Male, 94%
Calm 85.1%
Sad 7.3%
Happy 2.4%
Confused 1.6%
Disgusted 1.4%
Angry 1.2%
Surprised 0.9%
Fear 0.2%

AWS Rekognition

Age 12-22
Gender Female, 90.1%
Calm 32.7%
Happy 25.7%
Fear 20.5%
Sad 7.4%
Angry 7%
Surprised 3.4%
Confused 2.9%
Disgusted 0.4%

AWS Rekognition

Age 23-35
Gender Female, 51.9%
Fear 61.1%
Angry 21.1%
Sad 6.6%
Calm 5%
Happy 4.3%
Surprised 0.8%
Disgusted 0.7%
Confused 0.3%

AWS Rekognition

Age 29-45
Gender Male, 89.1%
Angry 41.6%
Happy 16.8%
Calm 15.9%
Disgusted 8.8%
Fear 6.3%
Sad 4.2%
Surprised 3.6%
Confused 2.8%

AWS Rekognition

Age 2-8
Gender Female, 55.5%
Calm 68.8%
Sad 13.5%
Angry 8.2%
Happy 5.4%
Fear 1.2%
Confused 1.1%
Surprised 1%
Disgusted 0.8%

AWS Rekognition

Age 23-35
Gender Female, 66.7%
Calm 61%
Sad 27%
Fear 3.3%
Surprised 2.9%
Confused 1.8%
Angry 1.6%
Happy 1.3%
Disgusted 1.1%

AWS Rekognition

Age 38-56
Gender Male, 71.4%
Angry 35.9%
Disgusted 23.1%
Confused 16%
Calm 14.7%
Sad 4.4%
Fear 4.1%
Surprised 0.9%
Happy 0.8%

AWS Rekognition

Age 1-7
Gender Female, 53.3%
Calm 61.6%
Sad 12%
Angry 7.6%
Fear 7%
Disgusted 4.3%
Surprised 3.6%
Confused 2.1%
Happy 1.7%

AWS Rekognition

Age 40-58
Gender Female, 91.3%
Calm 27%
Sad 25.1%
Disgusted 21.3%
Happy 11.3%
Fear 8.3%
Angry 2.8%
Surprised 2.3%
Confused 1.9%

AWS Rekognition

Age 32-48
Gender Female, 72.8%
Calm 28.7%
Fear 28.4%
Sad 24.4%
Happy 6.2%
Surprised 4.3%
Confused 4%
Disgusted 2.1%
Angry 1.9%

AWS Rekognition

Age 30-46
Gender Female, 52.3%
Calm 88.5%
Sad 10%
Happy 0.5%
Confused 0.4%
Angry 0.3%
Surprised 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 13-25
Gender Female, 56.6%
Fear 84%
Disgusted 5%
Surprised 4%
Happy 1.7%
Calm 1.7%
Confused 1.2%
Angry 1.2%
Sad 1.1%

AWS Rekognition

Age 1-5
Gender Female, 82.1%
Angry 64.3%
Disgusted 10.9%
Calm 5.7%
Surprised 5%
Happy 4.2%
Fear 3.8%
Sad 3.2%
Confused 2.8%

AWS Rekognition

Age 22-34
Gender Female, 50.5%
Calm 75%
Sad 18.8%
Angry 2.3%
Surprised 1.2%
Fear 1.1%
Happy 0.6%
Confused 0.6%
Disgusted 0.3%

AWS Rekognition

Age 4-14
Gender Male, 60.7%
Sad 61.3%
Fear 25.5%
Calm 5.6%
Disgusted 3.4%
Angry 2.5%
Confused 0.8%
Happy 0.7%
Surprised 0.3%

AWS Rekognition

Age 20-32
Gender Female, 58.5%
Calm 59.2%
Happy 26.3%
Sad 5.2%
Confused 3%
Disgusted 2.6%
Angry 1.6%
Surprised 1.5%
Fear 0.8%

AWS Rekognition

Age 21-33
Gender Male, 87.5%
Calm 97.9%
Sad 0.7%
Happy 0.6%
Confused 0.3%
Angry 0.2%
Surprised 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 36-52
Gender Female, 96.8%
Calm 56.7%
Sad 23.3%
Happy 11.1%
Disgusted 3.6%
Confused 1.8%
Surprised 1.5%
Angry 0.9%
Fear 0.9%

AWS Rekognition

Age 14-26
Gender Male, 72.8%
Calm 77.8%
Sad 18.6%
Confused 1.8%
Angry 1.1%
Surprised 0.2%
Happy 0.2%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 49-67
Gender Male, 61.9%
Calm 63.9%
Fear 17.6%
Happy 15%
Sad 1.6%
Angry 0.6%
Confused 0.5%
Surprised 0.5%
Disgusted 0.4%

AWS Rekognition

Age 23-37
Gender Male, 67.7%
Calm 93.5%
Sad 2.3%
Surprised 1.4%
Disgusted 0.9%
Angry 0.6%
Happy 0.6%
Confused 0.5%
Fear 0.2%

AWS Rekognition

Age 19-31
Gender Female, 62%
Happy 66.2%
Calm 25.3%
Sad 5.5%
Angry 0.8%
Confused 0.8%
Surprised 0.5%
Fear 0.5%
Disgusted 0.4%

AWS Rekognition

Age 35-51
Gender Female, 53.4%
Calm 83.2%
Surprised 3.3%
Sad 3.2%
Fear 2.9%
Confused 2.7%
Happy 2.1%
Angry 1.5%
Disgusted 1.2%

AWS Rekognition

Age 11-21
Gender Female, 93.9%
Happy 75.7%
Calm 11.9%
Sad 4.1%
Fear 3.3%
Angry 1.8%
Confused 1.6%
Surprised 0.9%
Disgusted 0.7%

AWS Rekognition

Age 3-9
Gender Male, 57.6%
Calm 29.4%
Confused 23.9%
Angry 18.5%
Surprised 9.3%
Sad 7%
Disgusted 4.2%
Happy 4.1%
Fear 3.6%

AWS Rekognition

Age 20-32
Gender Female, 64.6%
Calm 89.7%
Sad 5.1%
Angry 2.5%
Happy 1.5%
Surprised 0.4%
Disgusted 0.4%
Confused 0.3%
Fear 0.2%

AWS Rekognition

Age 4-14
Gender Female, 91.8%
Calm 53.1%
Confused 28.4%
Sad 7.8%
Surprised 6%
Fear 1.6%
Angry 1.1%
Happy 1.1%
Disgusted 0.8%

AWS Rekognition

Age 24-38
Gender Male, 54.4%
Happy 55.1%
Calm 34.9%
Sad 5.5%
Confused 2.2%
Disgusted 0.9%
Surprised 0.7%
Angry 0.4%
Fear 0.3%

AWS Rekognition

Age 29-45
Gender Female, 70.4%
Calm 55.5%
Fear 27.1%
Sad 8.2%
Surprised 3.5%
Confused 1.9%
Happy 1.9%
Disgusted 1.1%
Angry 0.8%

AWS Rekognition

Age 21-33
Gender Female, 97%
Happy 31.9%
Disgusted 24.2%
Calm 24%
Sad 12.1%
Angry 2.1%
Fear 2.1%
Confused 2.1%
Surprised 1.5%

AWS Rekognition

Age 34-50
Gender Male, 93.4%
Happy 54.7%
Calm 26.2%
Surprised 5%
Fear 4%
Sad 3.3%
Disgusted 2.8%
Angry 2.1%
Confused 1.7%

AWS Rekognition

Age 3-11
Gender Male, 74.6%
Calm 81.9%
Sad 11.3%
Confused 3.6%
Angry 0.8%
Happy 0.8%
Surprised 0.8%
Fear 0.5%
Disgusted 0.3%

AWS Rekognition

Age 7-17
Gender Female, 53.8%
Calm 48.7%
Sad 36.8%
Happy 5.9%
Angry 2.6%
Confused 2.5%
Disgusted 2.4%
Fear 0.7%
Surprised 0.4%

AWS Rekognition

Age 29-45
Gender Female, 72%
Happy 88.5%
Calm 6.4%
Fear 1.9%
Angry 1.2%
Disgusted 0.8%
Surprised 0.7%
Sad 0.3%
Confused 0.3%

AWS Rekognition

Age 8-18
Gender Female, 72.8%
Confused 43.7%
Disgusted 22.8%
Calm 17.4%
Sad 11.5%
Angry 1.6%
Happy 1.1%
Surprised 1%
Fear 0.8%

AWS Rekognition

Age 2-8
Gender Male, 75.4%
Calm 67.6%
Sad 14.9%
Confused 5%
Surprised 4.6%
Fear 3.7%
Happy 2.2%
Angry 1%
Disgusted 0.9%

AWS Rekognition

Age 38-56
Gender Female, 91%
Happy 87%
Calm 9.9%
Sad 0.9%
Surprised 0.7%
Angry 0.4%
Disgusted 0.4%
Fear 0.4%
Confused 0.3%

AWS Rekognition

Age 31-47
Gender Female, 52.1%
Happy 46.1%
Calm 39%
Disgusted 7.6%
Sad 2.6%
Confused 1.7%
Angry 1.3%
Fear 0.9%
Surprised 0.8%

AWS Rekognition

Age 5-15
Gender Female, 92.6%
Calm 89%
Sad 3.5%
Happy 2.8%
Confused 1.4%
Surprised 1.1%
Fear 1%
Angry 0.7%
Disgusted 0.5%

AWS Rekognition

Age 12-22
Gender Female, 60.7%
Calm 66.4%
Fear 8.5%
Sad 7.2%
Confused 4.9%
Angry 4.2%
Disgusted 4%
Surprised 2.7%
Happy 2.1%

AWS Rekognition

Age 26-40
Gender Male, 81.1%
Happy 45.6%
Angry 24.7%
Fear 10.2%
Calm 8.6%
Surprised 3.6%
Sad 3.2%
Disgusted 2.3%
Confused 1.7%

AWS Rekognition

Age 29-45
Gender Male, 73.9%
Calm 89.2%
Sad 5%
Angry 1.7%
Confused 1.6%
Surprised 0.8%
Disgusted 0.7%
Fear 0.6%
Happy 0.3%

AWS Rekognition

Age 31-47
Gender Male, 84.9%
Surprised 21.7%
Fear 21.4%
Calm 20%
Sad 9.8%
Confused 7.9%
Angry 7.5%
Happy 6%
Disgusted 5.8%

AWS Rekognition

Age 21-33
Gender Male, 50.7%
Happy 55.2%
Calm 38.2%
Angry 2.1%
Sad 1.2%
Confused 1.2%
Disgusted 0.9%
Surprised 0.6%
Fear 0.5%

AWS Rekognition

Age 24-38
Gender Female, 53.7%
Sad 32.8%
Calm 26.7%
Fear 24.6%
Happy 12%
Surprised 2.2%
Angry 1.3%
Confused 0.2%
Disgusted 0.1%

AWS Rekognition

Age 41-59
Gender Female, 86.9%
Calm 92.3%
Happy 6.7%
Disgusted 0.3%
Surprised 0.2%
Angry 0.1%
Confused 0.1%
Sad 0.1%
Fear 0%

AWS Rekognition

Age 26-40
Gender Male, 59.8%
Calm 87.9%
Happy 5.9%
Surprised 2.6%
Angry 1.8%
Disgusted 1.1%
Sad 0.4%
Confused 0.2%
Fear 0.2%

AWS Rekognition

Age 12-22
Gender Female, 55%
Happy 67.1%
Calm 16.3%
Confused 5.3%
Angry 3.9%
Surprised 2.5%
Fear 1.8%
Sad 1.7%
Disgusted 1.3%

AWS Rekognition

Age 41-59
Gender Male, 52.1%
Calm 91.1%
Happy 5%
Sad 1.3%
Angry 1.1%
Surprised 0.6%
Fear 0.5%
Disgusted 0.3%
Confused 0.2%

AWS Rekognition

Age 23-37
Gender Female, 64.1%
Calm 95.8%
Surprised 1.6%
Disgusted 1.2%
Confused 0.4%
Sad 0.3%
Angry 0.3%
Happy 0.3%
Fear 0.1%

AWS Rekognition

Age 32-48
Gender Female, 64.9%
Sad 52.6%
Calm 37.7%
Angry 4.7%
Happy 4.2%
Fear 0.4%
Surprised 0.1%
Confused 0.1%
Disgusted 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Horse 96.9%
Monitor 92.7%

Captions

Text analysis

Amazon

82%
28
180
1939
New
Hampshire
George
Durette
George Durette Studio
P.N.A
Studio
Manchester, New Hampshire
08
Manchester,
HARCERSTWO
MANCHESTERAU

Google

PN.A HARCERSTWWO SHESTER 28 82% George Durette Studio Manchester, New Hampshire 1939 .08 180
PN.A
82%
Studio
Manchester,
New
Hampshire
1939
.08
180
HARCERSTWWO
SHESTER
28
George
Durette