Human Generated Data

Title

Untitled (large family reunion, posed on steps in front of trees)
Date

1941
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3162

Human Generated Data

Title

Untitled (large family reunion, posed on steps in front of trees)

People

Artist: Harry Annas, American 1897 - 1980

Date

1941

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3162

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Art 92.2
Person 89.7
Human 89.7
Person 87.2
Person 86.1
Painting 83.1
Person 82.4
Crowd 68.6
Nature 68.5
Person 66.7
Outdoors 62.7
Plant 61.4
Person 61.1
Person 54.8
Person 51.3

Clarifai
created on 2023-10-26

people 99.3
group 97.3
art 97.1
illustration 94.7
adult 93.6
print 93.5
many 91.9
wear 91.3
painting 89.5
vintage 86.3
war 86.3
man 85.9
desktop 85.6
military 84.9
cavalry 84.2
administration 84
collage 83.1
soldier 82.5
tree 81.8
paper 80

Imagga
created on 2022-01-22

snow 91.8
weather 50.3
winter 34.1
landscape 33.5
tree 33
structure 31.7
cold 28.4
picket fence 24.6
season 24.2
fountain 23.5
fence 22.8
forest 22.7
trees 22.3
old 21.6
grunge 19.6
frost 19.2
barrier 18.5
ice 18.3
sky 17.8
wood 16.7
vintage 16.6
park 16.5
scene 16.5
scenery 16.3
texture 16
lake 15.8
weathered 15.2
snowy 13.6
aged 13.6
morning 13.6
frozen 13.4
rural 13.2
rough 12.8
river 12.5
obstruction 12.4
light 12
black 12
freeze 11.7
pattern 11.6
negative 11.6
fog 11.6
cool 11.6
outdoor 11.5
scenic 11.4
seasonal 11.4
antique 11.3
frame 10.8
water 10.7
covered 10.7
sun 10.7
outdoors 10.6
travel 10.6
grungy 10.4
rock 10.4
countryside 10.1
field 10
branch 10
dark 10
environment 9.9
retro 9.8
frosty 9.8
textured 9.7
stone 9.5
holiday 9.3
art 9.3
city 9.2
paint 9.1
country 8.8
film 8.8
decoration 8.7
day 8.6
woods 8.6
space 8.5
design 8.5
wallpaper 8.4
fall 8.2
dirty 8.1
mountain 8.1
natural 8
surface 7.9
grass 7.9
snowing 7.9
paper 7.9
wall 7.8
ancient 7.8
wilderness 7.8
scenics 7.7
worn 7.6
basin 7.6
path 7.6
material 7.2
sunlight 7.1
birch 7.1
land 7

Google
created on 2022-01-22

Organism 85.7
Plant 85.6
Painting 84.5
Black-and-white 84.5
Style 83.8
Art 82.8
Tree 82.8
Rectangle 82
Font 81.3
Wall 81.1
Adaptation 79.3
Tints and shades 77.2
Monochrome 76.2
Monochrome photography 75.8
Landscape 74.3
Natural landscape 70.9
Visual arts 70.8
Water 68.9
History 66.7
Drawing 66

Microsoft
created on 2022-01-22

text 99
water 97.2
black and white 92.1
old 78
white 74.9
tree 66.6
monochrome 60.9
picture frame 23.1
window 23

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 21-29
Gender Male, 88.6%
Happy 54.9%
Calm 30.2%
Sad 5.7%
Disgusted 4.2%
Angry 1.7%
Confused 1.4%
Surprised 1%
Fear 1%

AWS Rekognition

Age 25-35
Gender Male, 98.4%
Happy 98.9%
Surprised 0.2%
Sad 0.2%
Calm 0.2%
Disgusted 0.2%
Angry 0.2%
Fear 0.1%
Confused 0.1%

AWS Rekognition

Age 35-43
Gender Male, 83.6%
Calm 50.3%
Happy 47%
Sad 1.1%
Angry 0.6%
Disgusted 0.4%
Surprised 0.3%
Confused 0.2%
Fear 0.2%

AWS Rekognition

Age 20-28
Gender Male, 65.4%
Happy 76%
Calm 11.3%
Sad 3.3%
Disgusted 2.4%
Confused 2.4%
Angry 1.9%
Surprised 1.7%
Fear 1%

AWS Rekognition

Age 23-31
Gender Female, 74.8%
Happy 91.7%
Calm 2.8%
Sad 1.4%
Disgusted 1.4%
Angry 1.1%
Surprised 0.8%
Confused 0.5%
Fear 0.3%

AWS Rekognition

Age 23-31
Gender Male, 99.9%
Calm 98%
Sad 1.4%
Disgusted 0.2%
Happy 0.1%
Angry 0.1%
Surprised 0.1%
Fear 0.1%
Confused 0%

AWS Rekognition

Age 27-37
Gender Male, 99.7%
Fear 30.9%
Surprised 24.6%
Happy 13.9%
Sad 9.9%
Calm 9.2%
Angry 5.4%
Disgusted 5%
Confused 1%

AWS Rekognition

Age 20-28
Gender Male, 99.3%
Calm 66%
Fear 20.5%
Happy 7.3%
Sad 2.7%
Angry 2.4%
Disgusted 0.6%
Surprised 0.1%
Confused 0.1%

AWS Rekognition

Age 25-35
Gender Male, 99.2%
Happy 80.9%
Calm 8.6%
Sad 5.1%
Angry 2%
Fear 1.6%
Disgusted 0.8%
Surprised 0.5%
Confused 0.5%

AWS Rekognition

Age 19-27
Gender Male, 60.8%
Calm 71.2%
Sad 11.8%
Happy 10.5%
Disgusted 2.5%
Angry 1.9%
Confused 0.8%
Surprised 0.8%
Fear 0.6%

AWS Rekognition

Age 42-50
Gender Male, 99.5%
Happy 59.2%
Calm 37.6%
Sad 1.5%
Fear 0.6%
Angry 0.4%
Surprised 0.3%
Disgusted 0.2%
Confused 0.1%

AWS Rekognition

Age 27-37
Gender Male, 97.4%
Happy 98.8%
Calm 0.6%
Surprised 0.2%
Sad 0.2%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 24-34
Gender Male, 99.8%
Happy 69.9%
Calm 10.5%
Sad 8.8%
Angry 4.7%
Fear 3.3%
Surprised 1.1%
Disgusted 0.9%
Confused 0.8%

AWS Rekognition

Age 22-30
Gender Male, 99.8%
Happy 78.1%
Sad 7.6%
Surprised 5.8%
Calm 3.1%
Fear 3%
Disgusted 1.2%
Angry 1%
Confused 0.1%

AWS Rekognition

Age 18-24
Gender Male, 99.9%
Calm 90.3%
Happy 6.9%
Angry 1.2%
Sad 0.6%
Disgusted 0.3%
Fear 0.3%
Surprised 0.2%
Confused 0.1%

AWS Rekognition

Age 21-29
Gender Male, 87.6%
Happy 91.2%
Calm 5.6%
Sad 1.1%
Surprised 0.6%
Angry 0.6%
Confused 0.5%
Disgusted 0.3%
Fear 0.1%

AWS Rekognition

Age 23-33
Gender Male, 99.6%
Disgusted 55.3%
Sad 28.1%
Angry 7.1%
Calm 5.8%
Happy 1.9%
Fear 0.9%
Confused 0.5%
Surprised 0.5%

AWS Rekognition

Age 25-35
Gender Male, 58.2%
Calm 70.5%
Fear 10.7%
Happy 5.3%
Sad 5%
Disgusted 2.6%
Confused 2.4%
Angry 2.1%
Surprised 1.4%

AWS Rekognition

Age 33-41
Gender Male, 86.8%
Happy 38%
Fear 22.6%
Calm 12.5%
Angry 10%
Sad 6.6%
Disgusted 4.9%
Surprised 3.9%
Confused 1.6%

AWS Rekognition

Age 7-17
Gender Female, 51.4%
Calm 80.1%
Happy 17.4%
Disgusted 0.8%
Sad 0.6%
Surprised 0.4%
Angry 0.4%
Confused 0.2%
Fear 0.1%

AWS Rekognition

Age 28-38
Gender Male, 99.8%
Happy 93.1%
Disgusted 4%
Sad 1%
Calm 0.8%
Angry 0.4%
Surprised 0.3%
Confused 0.2%
Fear 0.1%

AWS Rekognition

Age 18-24
Gender Male, 98%
Sad 73.4%
Happy 9.6%
Confused 6.6%
Calm 5.4%
Angry 3.4%
Disgusted 0.8%
Fear 0.4%
Surprised 0.3%

AWS Rekognition

Age 19-27
Gender Female, 53.9%
Sad 48%
Calm 17.8%
Happy 15.6%
Fear 10.3%
Angry 5.2%
Disgusted 1.6%
Surprised 0.8%
Confused 0.6%

AWS Rekognition

Age 29-39
Gender Female, 60.4%
Happy 78.6%
Calm 12.3%
Disgusted 4.7%
Confused 1.2%
Fear 1%
Sad 0.8%
Angry 0.7%
Surprised 0.7%

AWS Rekognition

Age 21-29
Gender Female, 65.5%
Happy 91.2%
Calm 5.4%
Fear 1.1%
Surprised 0.8%
Angry 0.5%
Sad 0.5%
Disgusted 0.4%
Confused 0.1%

AWS Rekognition

Age 43-51
Gender Male, 98.6%
Calm 63%
Happy 14.6%
Sad 9.6%
Fear 7.3%
Disgusted 2.4%
Angry 2%
Confused 0.7%
Surprised 0.4%

AWS Rekognition

Age 36-44
Gender Male, 85.5%
Happy 79.5%
Calm 12.6%
Fear 3.5%
Sad 2.1%
Angry 1.2%
Disgusted 0.5%
Surprised 0.4%
Confused 0.3%

AWS Rekognition

Age 27-37
Gender Female, 62.8%
Calm 60.6%
Happy 29.1%
Sad 3%
Surprised 3%
Fear 1.7%
Angry 1.3%
Disgusted 0.8%
Confused 0.4%

AWS Rekognition

Age 33-41
Gender Male, 98.4%
Calm 93.7%
Happy 5.9%
Angry 0.1%
Sad 0.1%
Disgusted 0.1%
Surprised 0.1%
Confused 0%
Fear 0%

AWS Rekognition

Age 27-37
Gender Male, 65.1%
Calm 91.4%
Happy 3.1%
Surprised 1.7%
Fear 1.1%
Sad 0.9%
Disgusted 0.8%
Angry 0.7%
Confused 0.3%

AWS Rekognition

Age 18-26
Gender Male, 98.9%
Calm 66.1%
Happy 20.5%
Sad 5.1%
Angry 4.1%
Fear 1.7%
Disgusted 1.4%
Confused 0.7%
Surprised 0.4%

AWS Rekognition

Age 49-57
Gender Male, 97%
Happy 56.1%
Calm 39.3%
Surprised 1.3%
Sad 1.2%
Angry 0.8%
Disgusted 0.7%
Confused 0.4%
Fear 0.2%

AWS Rekognition

Age 22-30
Gender Male, 72.9%
Sad 32%
Happy 27.3%
Calm 21%
Angry 13%
Fear 2.3%
Confused 1.8%
Disgusted 1.7%
Surprised 0.9%

AWS Rekognition

Age 39-47
Gender Male, 85%
Happy 48.1%
Calm 28.5%
Surprised 5.4%
Angry 5.1%
Disgusted 5%
Sad 4.3%
Fear 2.9%
Confused 0.7%

AWS Rekognition

Age 48-56
Gender Female, 59%
Calm 96.2%
Happy 1.6%
Fear 0.7%
Angry 0.5%
Surprised 0.3%
Sad 0.3%
Disgusted 0.3%
Confused 0.2%

AWS Rekognition

Age 39-47
Gender Male, 52.9%
Calm 88.5%
Sad 4%
Happy 3.1%
Angry 1.6%
Surprised 1%
Fear 0.9%
Disgusted 0.5%
Confused 0.3%

AWS Rekognition

Age 23-33
Gender Female, 89.4%
Happy 98.6%
Calm 0.6%
Sad 0.5%
Angry 0.1%
Surprised 0%
Disgusted 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 30-40
Gender Female, 73.1%
Happy 34.2%
Calm 32.2%
Fear 8.9%
Surprised 8.3%
Sad 7.5%
Disgusted 3.8%
Angry 3.4%
Confused 1.8%

AWS Rekognition

Age 23-31
Gender Female, 97.2%
Calm 50.3%
Happy 29.1%
Angry 8.2%
Surprised 4.9%
Sad 4.8%
Disgusted 1.7%
Confused 0.7%
Fear 0.4%

AWS Rekognition

Age 18-26
Gender Male, 77.3%
Happy 41.7%
Calm 24.6%
Fear 16.7%
Disgusted 7.4%
Sad 4%
Surprised 2.8%
Angry 1.7%
Confused 1.1%

AWS Rekognition

Age 37-45
Gender Male, 83.4%
Happy 92.2%
Calm 2.7%
Disgusted 2.2%
Confused 0.7%
Angry 0.7%
Sad 0.6%
Surprised 0.5%
Fear 0.3%

AWS Rekognition

Age 23-33
Gender Male, 99.8%
Calm 98.3%
Happy 0.4%
Angry 0.4%
Sad 0.3%
Surprised 0.2%
Disgusted 0.2%
Confused 0.2%
Fear 0.1%

AWS Rekognition

Age 20-28
Gender Male, 97.8%
Calm 69.9%
Happy 9.1%
Surprised 7.9%
Sad 5.7%
Fear 2.6%
Angry 2.1%
Disgusted 1.7%
Confused 1%

AWS Rekognition

Age 11-19
Gender Female, 64.9%
Calm 87.9%
Sad 5.8%
Happy 4.1%
Fear 0.9%
Disgusted 0.6%
Angry 0.3%
Surprised 0.2%
Confused 0.2%

AWS Rekognition

Age 30-40
Gender Male, 63.1%
Calm 84.4%
Fear 10.1%
Sad 1.5%
Angry 1.5%
Happy 0.8%
Confused 0.6%
Surprised 0.6%
Disgusted 0.5%

AWS Rekognition

Age 23-31
Gender Female, 70.9%
Happy 83.9%
Calm 14.5%
Disgusted 0.5%
Sad 0.4%
Angry 0.2%
Confused 0.2%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 23-31
Gender Male, 98.2%
Happy 92.1%
Confused 2%
Calm 1.6%
Sad 1.2%
Angry 0.9%
Fear 0.9%
Disgusted 0.9%
Surprised 0.4%

AWS Rekognition

Age 21-29
Gender Male, 91.8%
Calm 51.3%
Sad 17.6%
Happy 16.8%
Fear 5.2%
Surprised 3%
Angry 2.8%
Disgusted 2.7%
Confused 0.6%

AWS Rekognition

Age 38-46
Gender Male, 93.4%
Happy 91.1%
Calm 6.3%
Sad 0.8%
Fear 0.6%
Disgusted 0.6%
Angry 0.3%
Surprised 0.3%
Confused 0.2%

AWS Rekognition

Age 16-24
Gender Male, 52%
Calm 99.9%
Fear 0%
Sad 0%
Happy 0%
Angry 0%
Disgusted 0%
Surprised 0%
Confused 0%

AWS Rekognition

Age 23-31
Gender Male, 99.9%
Calm 81.4%
Sad 7.5%
Happy 6.8%
Angry 2.7%
Fear 0.6%
Confused 0.5%
Disgusted 0.3%
Surprised 0.2%

AWS Rekognition

Age 24-34
Gender Male, 92.4%
Calm 82.7%
Happy 12.4%
Sad 1.7%
Angry 1.5%
Disgusted 0.7%
Fear 0.4%
Confused 0.4%
Surprised 0.3%

AWS Rekognition

Age 24-34
Gender Male, 94.4%
Calm 95.9%
Sad 2.9%
Fear 0.4%
Happy 0.2%
Angry 0.2%
Disgusted 0.1%
Surprised 0.1%
Confused 0.1%

AWS Rekognition

Age 19-27
Gender Male, 96.9%
Happy 99.5%
Fear 0.2%
Sad 0.1%
Calm 0.1%
Angry 0%
Disgusted 0%
Surprised 0%
Confused 0%

AWS Rekognition

Age 27-37
Gender Female, 98.7%
Calm 90.8%
Fear 5.4%
Happy 1.4%
Surprised 0.7%
Angry 0.6%
Sad 0.6%
Disgusted 0.2%
Confused 0.2%

AWS Rekognition

Age 43-51
Gender Male, 97.1%
Happy 58.9%
Calm 37.9%
Sad 0.9%
Disgusted 0.7%
Angry 0.6%
Surprised 0.5%
Fear 0.3%
Confused 0.2%

AWS Rekognition

Age 28-38
Gender Male, 98.9%
Happy 54.5%
Calm 23.4%
Disgusted 7.1%
Sad 4.2%
Surprised 3.4%
Fear 3%
Angry 2.5%
Confused 1.9%

AWS Rekognition

Age 31-41
Gender Female, 50.3%
Calm 86.7%
Happy 6.2%
Surprised 3.1%
Sad 1.5%
Angry 1.1%
Disgusted 0.6%
Fear 0.5%
Confused 0.4%

AWS Rekognition

Age 23-33
Gender Male, 87.6%
Happy 57.9%
Calm 38.8%
Sad 1%
Fear 0.8%
Surprised 0.7%
Disgusted 0.3%
Confused 0.3%
Angry 0.2%

AWS Rekognition

Age 16-24
Gender Male, 99.7%
Calm 95.6%
Disgusted 1.2%
Happy 1.1%
Fear 0.9%
Sad 0.6%
Confused 0.3%
Angry 0.2%
Surprised 0.2%

AWS Rekognition

Age 23-31
Gender Female, 56.2%
Calm 89.7%
Sad 4.6%
Happy 1.9%
Fear 1.1%
Disgusted 1.1%
Angry 0.7%
Confused 0.5%
Surprised 0.4%

AWS Rekognition

Age 24-34
Gender Female, 62.4%
Sad 44.4%
Happy 27.4%
Calm 15.4%
Fear 3.7%
Angry 3.3%
Confused 2.4%
Disgusted 2.2%
Surprised 1.2%

AWS Rekognition

Age 18-26
Gender Female, 75.7%
Happy 58.8%
Sad 29.4%
Calm 4.8%
Angry 2%
Fear 1.8%
Disgusted 1.4%
Confused 1%
Surprised 0.9%

AWS Rekognition

Age 22-30
Gender Female, 97.1%
Happy 42.1%
Sad 39.8%
Calm 9.8%
Angry 2.5%
Surprised 2.2%
Disgusted 1.6%
Confused 1.1%
Fear 0.9%

AWS Rekognition

Age 37-45
Gender Male, 99.5%
Calm 52.1%
Sad 23.2%
Fear 9.5%
Happy 9%
Surprised 2.5%
Angry 1.9%
Disgusted 1.4%
Confused 0.5%

AWS Rekognition

Age 38-46
Gender Male, 97.9%
Calm 88.1%
Sad 4.5%
Angry 2.4%
Happy 2%
Disgusted 1.4%
Confused 0.8%
Fear 0.4%
Surprised 0.4%

AWS Rekognition

Age 24-34
Gender Male, 98.2%
Calm 98.4%
Happy 0.8%
Sad 0.3%
Angry 0.2%
Fear 0.1%
Confused 0.1%
Disgusted 0.1%
Surprised 0%

AWS Rekognition

Age 24-34
Gender Female, 98.7%
Happy 71.4%
Calm 21.2%
Surprised 2.8%
Disgusted 1.5%
Sad 1.3%
Angry 0.8%
Fear 0.7%
Confused 0.3%

AWS Rekognition

Age 20-28
Gender Male, 89.3%
Happy 81.8%
Calm 10%
Sad 4.3%
Angry 1.2%
Fear 1%
Confused 1%
Disgusted 0.5%
Surprised 0.3%

AWS Rekognition

Age 14-22
Gender Female, 79.1%
Happy 96.6%
Calm 1%
Fear 0.5%
Sad 0.5%
Angry 0.5%
Surprised 0.4%
Disgusted 0.3%
Confused 0.1%

AWS Rekognition

Age 26-36
Gender Male, 93.2%
Calm 51.7%
Happy 30.6%
Sad 6.7%
Fear 5.5%
Angry 2.3%
Disgusted 1.5%
Surprised 1.4%
Confused 0.3%

Feature analysis

Amazon

Person 89.7%

Text analysis

Amazon

1