Human Generated Data

Title

Untitled (large family reunion, posed on steps in front of trees)
Date

1941
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3163

Human Generated Data

Title

Untitled (large family reunion, posed on steps in front of trees)

People

Artist: Harry Annas, American 1897 - 1980

Date

1941

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3163

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Person 95
Human 95
Art 86.9
Painting 80.4
Person 80.1
Person 79.6
Person 76.5
Person 74
Person 72.6
Person 70.1
Nature 68.8
Person 63.3
Tree 62.4
Plant 62.4
Outdoors 61.2
Person 53.6
Person 52.4
Person 42.7

Clarifai
created on 2023-10-29

people 98.7
group 95.7
art 93.4
illustration 92
adult 91
print 90.9
many 90.7
vintage 90.4
wear 90.2
desktop 89.6
paper 82.3
tree 81.9
texture 81.3
man 80.9
group together 80.8
painting 80.8
no person 78.9
retro 78.5
military 77.5
antique 76.9

Imagga
created on 2022-02-05

snow 95.7
weather 51.8
winter 46.9
landscape 44.7
tree 42.7
cold 36.2
forest 32.5
trees 30.3
season 28.9
fence 28.1
picket fence 26.5
sky 24.9
ice 24.2
frost 24
snowy 22.4
barrier 21
scene 20.8
scenery 19.9
park 19
frozen 18.2
country 17.6
fog 17.4
structure 17.3
old 16.8
scenic 16.7
outdoors 15.9
frosty 15.7
branch 15.5
light 15.4
outdoor 15.3
countryside 14.6
freeze 14.6
wood 14.2
rural 14.1
obstruction 14
vintage 13.3
seasonal 13.2
lake 13.1
road 12.7
black 12.6
field 12.6
grunge 11.9
clouds 11.9
snowfall 11.8
cool 11.6
woods 11.5
texture 11.1
sun 10.9
dark 10.9
morning 10.9
river 10.7
water 10.7
covered 10.7
travel 10.6
path 10.4
environment 9.9
land 9.9
snowing 9.9
pattern 9.6
antique 9.5
cloud 9.5
day 9.4
holiday 9.3
bright 9.3
frame 9.2
peaceful 9.2
calm 9.2
fall 9.1
autumn 8.8
negative 8.2
retro 8.2
mountain 8.2
natural 8
night 8
pine 7.9
chilly 7.9
icy 7.8
branches 7.7
reflection 7.3
rough 7.3
grass 7.1
nobody 7

Google
created on 2022-02-05

Plant 90.6
Branch 86.7
Black-and-white 85.5
Tree 85.5
Natural landscape 84.1
Style 83.9
Rectangle 83.9
Water 83.1
Art 82.1
Wood 81
Font 80.1
Adaptation 79.3
Grass 79
Twig 78.8
Landscape 77.9
Monochrome photography 77.4
Tints and shades 77.4
Monochrome 75.3
Painting 75.1
Visual arts 68.7

Microsoft
created on 2022-02-05

text 98.8
water 90.8
black and white 87.6
white 74.2
tree 67.5
old 54
picture frame 16.9

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 18-24
Gender Male, 87.1%
Happy 98.2%
Calm 1.3%
Angry 0.1%
Sad 0.1%
Surprised 0.1%
Disgusted 0.1%
Fear 0%
Confused 0%

AWS Rekognition

Age 13-21
Gender Male, 97.3%
Calm 59.3%
Happy 36.3%
Angry 0.9%
Sad 0.9%
Surprised 0.9%
Disgusted 0.9%
Fear 0.6%
Confused 0.2%

AWS Rekognition

Age 23-31
Gender Female, 83%
Calm 45.9%
Happy 13.8%
Fear 11.5%
Surprised 8%
Confused 6.6%
Disgusted 6.1%
Sad 4.4%
Angry 3.6%

AWS Rekognition

Age 36-44
Gender Male, 94.1%
Fear 51.6%
Calm 44.2%
Sad 1.5%
Happy 1.4%
Angry 0.4%
Surprised 0.3%
Disgusted 0.3%
Confused 0.2%

AWS Rekognition

Age 18-24
Gender Female, 66.4%
Calm 91.5%
Fear 4.7%
Surprised 1.4%
Happy 1%
Angry 0.5%
Sad 0.5%
Disgusted 0.3%
Confused 0.1%

AWS Rekognition

Age 19-27
Gender Male, 99.2%
Calm 98.7%
Happy 0.8%
Sad 0.3%
Fear 0.1%
Disgusted 0%
Angry 0%
Surprised 0%
Confused 0%

AWS Rekognition

Age 16-24
Gender Male, 96.2%
Calm 98.9%
Happy 0.6%
Surprised 0.1%
Disgusted 0.1%
Sad 0.1%
Confused 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 20-28
Gender Male, 99.8%
Calm 92%
Happy 4.6%
Sad 1.2%
Fear 0.9%
Angry 0.6%
Disgusted 0.5%
Surprised 0.1%
Confused 0.1%

AWS Rekognition

Age 20-28
Gender Male, 63.8%
Calm 59.8%
Fear 11.6%
Sad 11.4%
Happy 6.5%
Confused 6.3%
Angry 3.1%
Disgusted 0.8%
Surprised 0.5%

AWS Rekognition

Age 30-40
Gender Male, 61.5%
Calm 59.7%
Happy 29.4%
Sad 5.8%
Fear 1.6%
Angry 1%
Surprised 0.8%
Disgusted 0.8%
Confused 0.8%

AWS Rekognition

Age 23-31
Gender Male, 98.1%
Calm 91.4%
Sad 3.3%
Angry 2.2%
Happy 1.6%
Fear 0.7%
Surprised 0.4%
Disgusted 0.3%
Confused 0.1%

AWS Rekognition

Age 30-40
Gender Female, 79%
Calm 94.8%
Angry 1.3%
Happy 1.2%
Sad 1.1%
Surprised 0.6%
Disgusted 0.6%
Fear 0.2%
Confused 0.2%

AWS Rekognition

Age 18-24
Gender Male, 89%
Happy 53.2%
Calm 42.2%
Sad 2.3%
Angry 0.9%
Surprised 0.6%
Disgusted 0.3%
Fear 0.3%
Confused 0.2%

AWS Rekognition

Age 30-40
Gender Female, 52%
Calm 90.6%
Sad 5%
Angry 1.4%
Happy 1.2%
Fear 0.6%
Disgusted 0.6%
Confused 0.4%
Surprised 0.2%

AWS Rekognition

Age 45-51
Gender Male, 100%
Calm 94.7%
Happy 1.8%
Sad 1.3%
Fear 0.9%
Angry 0.5%
Surprised 0.5%
Disgusted 0.2%
Confused 0.2%

AWS Rekognition

Age 24-34
Gender Male, 99.9%
Happy 45%
Calm 28%
Sad 21.5%
Fear 2.8%
Angry 1.5%
Disgusted 0.8%
Surprised 0.3%
Confused 0.2%

AWS Rekognition

Age 41-49
Gender Male, 98.1%
Calm 96.8%
Happy 1.4%
Sad 0.6%
Angry 0.6%
Surprised 0.2%
Fear 0.2%
Disgusted 0.1%
Confused 0%

AWS Rekognition

Age 16-22
Gender Male, 54.8%
Happy 62.1%
Fear 24.1%
Sad 6.7%
Calm 3%
Angry 1.8%
Disgusted 1.7%
Surprised 0.3%
Confused 0.3%

AWS Rekognition

Age 31-41
Gender Male, 99.7%
Calm 98.4%
Happy 1.3%
Surprised 0.1%
Sad 0.1%
Disgusted 0%
Confused 0%
Fear 0%
Angry 0%

AWS Rekognition

Age 25-35
Gender Male, 94.8%
Happy 59.3%
Calm 39.2%
Angry 0.5%
Sad 0.4%
Surprised 0.2%
Disgusted 0.2%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 26-36
Gender Male, 96.4%
Happy 56.8%
Calm 41.1%
Sad 0.9%
Surprised 0.5%
Angry 0.3%
Disgusted 0.2%
Fear 0.1%
Confused 0.1%

AWS Rekognition

Age 23-33
Gender Male, 75.3%
Calm 86.9%
Happy 12.6%
Sad 0.2%
Surprised 0.1%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 33-41
Gender Male, 81.4%
Calm 50.1%
Happy 40.6%
Sad 3.9%
Angry 2.4%
Surprised 1.2%
Fear 0.7%
Confused 0.6%
Disgusted 0.5%

AWS Rekognition

Age 24-34
Gender Female, 73.1%
Happy 85.8%
Sad 8.5%
Calm 5.1%
Disgusted 0.2%
Angry 0.2%
Confused 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 20-28
Gender Male, 98.7%
Happy 68.9%
Calm 13.3%
Sad 13.3%
Angry 1.8%
Fear 1.1%
Surprised 0.8%
Disgusted 0.4%
Confused 0.3%

AWS Rekognition

Age 23-31
Gender Female, 80%
Sad 77.4%
Happy 7.8%
Fear 3.8%
Surprised 3.5%
Angry 2.6%
Calm 2.3%
Disgusted 2.1%
Confused 0.5%

AWS Rekognition

Age 23-31
Gender Male, 99.7%
Happy 92.2%
Sad 2.7%
Angry 2.1%
Fear 1.9%
Calm 0.8%
Surprised 0.2%
Disgusted 0.2%
Confused 0.1%

AWS Rekognition

Age 28-38
Gender Male, 99.9%
Calm 65.8%
Happy 20.6%
Angry 5.7%
Fear 3%
Disgusted 1.6%
Surprised 1.5%
Sad 1.2%
Confused 0.5%

AWS Rekognition

Age 22-30
Gender Male, 97.9%
Calm 75.7%
Happy 11.3%
Angry 3.7%
Confused 3.1%
Sad 2.9%
Disgusted 1.6%
Surprised 1.1%
Fear 0.6%

AWS Rekognition

Age 20-28
Gender Male, 95%
Calm 85.8%
Sad 4.6%
Fear 2.9%
Happy 2.4%
Angry 2%
Confused 0.9%
Disgusted 0.9%
Surprised 0.4%

AWS Rekognition

Age 25-35
Gender Female, 54%
Calm 90.4%
Surprised 4.2%
Happy 2.7%
Angry 0.7%
Confused 0.6%
Fear 0.6%
Sad 0.5%
Disgusted 0.3%

AWS Rekognition

Age 20-28
Gender Male, 79.4%
Calm 38.4%
Happy 20.6%
Fear 18%
Sad 9.8%
Surprised 4.5%
Angry 3.3%
Confused 2.8%
Disgusted 2.6%

AWS Rekognition

Age 28-38
Gender Female, 91.1%
Calm 67.5%
Happy 16.4%
Angry 6.6%
Confused 3.5%
Disgusted 3.2%
Sad 1.8%
Surprised 0.7%
Fear 0.4%

AWS Rekognition

Age 21-29
Gender Male, 94.1%
Calm 73.7%
Sad 12%
Happy 9.1%
Disgusted 1.9%
Angry 1.5%
Confused 1%
Fear 0.5%
Surprised 0.4%

AWS Rekognition

Age 22-30
Gender Male, 97.4%
Calm 93.3%
Happy 4.9%
Surprised 1%
Fear 0.3%
Sad 0.2%
Disgusted 0.2%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 28-38
Gender Male, 64.8%
Calm 70.4%
Angry 17.8%
Fear 5.2%
Sad 2.1%
Happy 1.9%
Disgusted 1.2%
Surprised 0.9%
Confused 0.5%

AWS Rekognition

Age 23-31
Gender Male, 96%
Calm 99.6%
Sad 0.1%
Happy 0.1%
Angry 0.1%
Disgusted 0%
Surprised 0%
Fear 0%
Confused 0%

AWS Rekognition

Age 24-34
Gender Male, 98.8%
Happy 82.4%
Sad 7.8%
Calm 6%
Angry 2.2%
Disgusted 0.5%
Fear 0.5%
Surprised 0.5%
Confused 0.1%

AWS Rekognition

Age 20-28
Gender Male, 99.8%
Calm 42.4%
Confused 18%
Surprised 11%
Angry 9.7%
Disgusted 7.6%
Happy 4.7%
Fear 4.4%
Sad 2.2%

AWS Rekognition

Age 16-22
Gender Female, 99.3%
Happy 46.9%
Calm 39.6%
Angry 4.2%
Disgusted 3.1%
Sad 2.9%
Confused 1.4%
Surprised 1.1%
Fear 0.7%

AWS Rekognition

Age 49-57
Gender Male, 86.2%
Happy 93.6%
Sad 3.5%
Calm 2.1%
Angry 0.4%
Surprised 0.2%
Disgusted 0.1%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 19-27
Gender Male, 99.8%
Calm 88.6%
Sad 10.1%
Happy 0.6%
Surprised 0.4%
Angry 0.2%
Fear 0.1%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 24-34
Gender Male, 99.3%
Calm 85.1%
Happy 11.1%
Sad 1.8%
Angry 0.7%
Fear 0.6%
Disgusted 0.3%
Surprised 0.2%
Confused 0.1%

AWS Rekognition

Age 21-29
Gender Male, 92%
Calm 74%
Happy 23.8%
Angry 0.9%
Sad 0.6%
Surprised 0.3%
Disgusted 0.2%
Fear 0.1%
Confused 0.1%

AWS Rekognition

Age 26-36
Gender Male, 94.5%
Calm 97.5%
Sad 0.9%
Happy 0.6%
Confused 0.3%
Surprised 0.2%
Disgusted 0.2%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 28-38
Gender Male, 99.2%
Sad 45.2%
Calm 29.1%
Happy 18.8%
Angry 3.6%
Fear 1.2%
Disgusted 1.1%
Confused 0.6%
Surprised 0.4%

AWS Rekognition

Age 24-34
Gender Female, 68.2%
Calm 84.9%
Happy 11.7%
Sad 1.2%
Fear 0.7%
Angry 0.6%
Disgusted 0.4%
Surprised 0.4%
Confused 0.2%

AWS Rekognition

Age 22-30
Gender Female, 78.2%
Disgusted 76.8%
Happy 7.9%
Sad 4.4%
Fear 4.2%
Calm 2.2%
Confused 1.9%
Surprised 1.5%
Angry 1.2%

AWS Rekognition

Age 23-31
Gender Male, 98.4%
Calm 51.4%
Fear 30%
Sad 12.1%
Confused 1.8%
Happy 1.5%
Surprised 1.1%
Disgusted 1%
Angry 0.9%

AWS Rekognition

Age 24-34
Gender Male, 70.9%
Happy 35.7%
Calm 35.6%
Fear 8.8%
Sad 7.6%
Angry 6%
Surprised 2.6%
Disgusted 2%
Confused 1.7%

AWS Rekognition

Age 37-45
Gender Male, 99.4%
Happy 60.8%
Calm 35.4%
Sad 1%
Surprised 0.7%
Angry 0.6%
Confused 0.5%
Fear 0.5%
Disgusted 0.4%

AWS Rekognition

Age 26-36
Gender Male, 93.6%
Happy 50%
Calm 42%
Sad 4.2%
Surprised 1.3%
Angry 1%
Disgusted 0.7%
Fear 0.5%
Confused 0.4%

AWS Rekognition

Age 36-44
Gender Male, 79.4%
Calm 94.2%
Surprised 1.3%
Happy 1.2%
Sad 1%
Confused 0.9%
Angry 0.9%
Fear 0.3%
Disgusted 0.3%

AWS Rekognition

Age 35-43
Gender Female, 52.6%
Calm 65.9%
Sad 12%
Happy 10.6%
Disgusted 2.8%
Angry 2.5%
Confused 2.4%
Surprised 2.2%
Fear 1.7%

AWS Rekognition

Age 7-17
Gender Male, 83.5%
Calm 66.4%
Happy 13.9%
Disgusted 8.2%
Sad 5.3%
Confused 2.1%
Surprised 1.5%
Fear 1.4%
Angry 1%

AWS Rekognition

Age 24-34
Gender Female, 57.7%
Calm 96.6%
Happy 1.4%
Angry 0.7%
Disgusted 0.4%
Sad 0.3%
Surprised 0.2%
Fear 0.2%
Confused 0.1%

AWS Rekognition

Age 20-28
Gender Male, 99.8%
Calm 97.4%
Happy 1.1%
Surprised 0.5%
Disgusted 0.5%
Angry 0.2%
Sad 0.1%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 22-30
Gender Male, 73.4%
Calm 85.3%
Happy 6%
Sad 2.4%
Angry 2%
Fear 1.9%
Confused 1%
Disgusted 0.9%
Surprised 0.5%

AWS Rekognition

Age 21-29
Gender Male, 79.7%
Calm 88.9%
Sad 8.3%
Happy 0.8%
Fear 0.6%
Disgusted 0.5%
Confused 0.4%
Angry 0.3%
Surprised 0.1%

AWS Rekognition

Age 27-37
Gender Male, 97.5%
Angry 51.2%
Happy 25.9%
Calm 11.8%
Sad 7.1%
Disgusted 1.9%
Confused 1%
Fear 0.6%
Surprised 0.5%

AWS Rekognition

Age 24-34
Gender Male, 87%
Calm 91.6%
Happy 5.9%
Sad 1%
Angry 0.5%
Confused 0.3%
Disgusted 0.3%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 22-30
Gender Male, 51.3%
Happy 72.8%
Calm 21.4%
Sad 2.1%
Fear 1.5%
Angry 1%
Surprised 0.5%
Confused 0.3%
Disgusted 0.3%

AWS Rekognition

Age 2-8
Gender Male, 95.5%
Calm 53.3%
Disgusted 17.7%
Sad 16.6%
Confused 8.2%
Angry 1.2%
Surprised 1.1%
Fear 1%
Happy 0.8%

AWS Rekognition

Age 36-44
Gender Male, 99.3%
Happy 60.8%
Calm 23.6%
Sad 4.5%
Confused 4.3%
Surprised 3.6%
Fear 1.3%
Disgusted 1.2%
Angry 0.7%

AWS Rekognition

Age 23-31
Gender Male, 95.6%
Sad 62.1%
Calm 18.5%
Happy 8.9%
Disgusted 3.4%
Angry 2.9%
Fear 2.2%
Confused 1.5%
Surprised 0.6%

AWS Rekognition

Age 21-29
Gender Male, 98.2%
Calm 68.6%
Happy 31%
Disgusted 0.1%
Sad 0.1%
Angry 0.1%
Surprised 0.1%
Confused 0%
Fear 0%

Feature analysis

Amazon

Person
Person 95%
Person 80.1%
Person 79.6%
Person 76.5%
Person 74%
Person 72.6%
Person 70.1%
Person 63.3%
Person 53.6%
Person 52.4%
Person 42.7%

Text analysis

Amazon

2