Human Generated Data

Title

Untitled (large group portrait of schoolchildren)
Date

c. 1950
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2393

Human Generated Data

Title

Untitled (large group portrait of schoolchildren)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2393

Machine Generated Data

Tags

Amazon
created on 2022-01-30

Person 91.5
Human 91.5
Person 89.6
Person 88
Person 81.3
Person 80.4
Person 77.6
People 77.5
Person 75.3
Crowd 73.2
Outdoors 72.1
Person 70.7
Clothing 70.5
Apparel 70.5
Person 69.7
Nature 65.4
Text 62.9
Theme Park 57.7
Amusement Park 57.7
Face 57
Tarmac 56.9
Asphalt 56.9
Person 51.8
Person 47.2
Person 43.9

Clarifai
created on 2023-10-28

many 99.7
people 99.7
crowd 97.5
group together 97.4
group 96.5
adult 94.7
military 90.1
war 89.4
man 89.2
cavalry 87.8
leader 87.6
soldier 86.1
spectator 83.6
monochrome 81.2
wear 78.5
chair 77.3
parade 76.6
administration 73.9
home 73.7
uniform 73.4

Imagga
created on 2022-01-30

picket fence 100
fence 87.7
barrier 62.3
cemetery 47.4
snow 43.6
obstruction 41.7
landscape 39.5
tree 28.5
sky 24.4
trees 24
winter 23.9
rural 23.8
structure 23.5
weather 20.5
city 20
cold 19
forest 18.3
grass 18.2
field 17.6
park 17.3
scenery 16.3
country 15.8
season 15.6
old 15.3
outdoors 14.9
architecture 14.9
countryside 14.6
building 13.7
scenic 13.2
scene 13
travel 12.7
road 12.7
frost 12.5
summer 11.6
hill 10.3
spring 10.2
mountains 10.2
land 10.1
horizon 9.9
farm 9.8
mountain 9.8
sun 9.7
woods 9.6
frozen 9.6
panorama 9.5
light 9.4
house 9.2
wood 9.2
outdoor 9.2
autumn 8.8
cloud 8.6
nobody 8.6
grunge 8.5
town 8.4
ice 8.3
plant 8.3
tourism 8.3
fall 8.2
meadow 8.1
cool 8
frosty 7.8
antique 7.8
snowy 7.8
fog 7.7
vintage 7.5
historic 7.3
new 7.3
tranquil 7.3
religion 7.2
stone 7.1
seasonal 7

Google
created on 2022-01-30

Building 87.4
Tree 82.9
Adaptation 79.3
Tints and shades 75.9
Plant 71.7
Font 71
Monochrome 70.4
Monochrome photography 69.1
Event 68.9
History 67.7
Paper product 67.3
Plantation 66.9
Vintage clothing 66.2
Room 66
House 65.7
Rectangle 64.6
Stock photography 63.3
Landscape 60.8
Team 56.1
Pole 56

Microsoft
created on 2022-01-30

text 96.2
white 82.5
black 82.4
old 81.2
person 68.6
funeral 64.1
vintage 50.8
window 19.7

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 30-40
Gender Male, 94.2%
Calm 61.2%
Happy 14.3%
Sad 11.5%
Fear 3.6%
Disgusted 3.4%
Angry 3%
Confused 1.9%
Surprised 1%

AWS Rekognition

Age 24-34
Gender Female, 78.3%
Calm 95.9%
Sad 2.4%
Happy 0.6%
Fear 0.3%
Angry 0.3%
Confused 0.2%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 34-42
Gender Male, 88.3%
Calm 95.8%
Sad 2.1%
Fear 0.5%
Happy 0.4%
Angry 0.4%
Disgusted 0.3%
Confused 0.2%
Surprised 0.1%

AWS Rekognition

Age 28-38
Gender Male, 94%
Calm 98.7%
Happy 0.5%
Sad 0.5%
Surprised 0.1%
Angry 0.1%
Disgusted 0%
Fear 0%
Confused 0%

AWS Rekognition

Age 25-35
Gender Male, 76.5%
Sad 35.7%
Confused 27.3%
Angry 21.3%
Happy 5.1%
Calm 4.6%
Disgusted 2.9%
Surprised 1.8%
Fear 1.1%

AWS Rekognition

Age 29-39
Gender Male, 77.8%
Sad 65.2%
Calm 17.9%
Angry 5.6%
Disgusted 3.8%
Confused 2.1%
Happy 2%
Fear 1.9%
Surprised 1.2%

AWS Rekognition

Age 28-38
Gender Male, 98.5%
Calm 97.9%
Sad 1.1%
Happy 0.4%
Confused 0.2%
Angry 0.2%
Disgusted 0.1%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 22-30
Gender Male, 99.9%
Calm 95.4%
Happy 2.7%
Sad 0.6%
Disgusted 0.4%
Angry 0.3%
Confused 0.2%
Fear 0.2%
Surprised 0.2%

AWS Rekognition

Age 21-29
Gender Male, 94.8%
Calm 98.3%
Sad 0.5%
Happy 0.4%
Fear 0.4%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Surprised 0.1%

AWS Rekognition

Age 27-37
Gender Male, 80.6%
Calm 93.2%
Happy 2.7%
Sad 1.7%
Angry 1.1%
Disgusted 0.4%
Confused 0.4%
Surprised 0.3%
Fear 0.2%

AWS Rekognition

Age 12-20
Gender Male, 99.9%
Calm 71.4%
Sad 10%
Happy 5.6%
Angry 5%
Fear 4%
Disgusted 1.9%
Surprised 1.4%
Confused 0.7%

AWS Rekognition

Age 29-39
Gender Female, 93.2%
Calm 59.7%
Happy 31.3%
Sad 5.4%
Disgusted 1.1%
Confused 0.7%
Angry 0.7%
Fear 0.6%
Surprised 0.5%

AWS Rekognition

Age 27-37
Gender Male, 82.5%
Calm 54.7%
Sad 21.3%
Happy 14.2%
Confused 5.4%
Angry 1.5%
Disgusted 1.1%
Surprised 1.1%
Fear 0.8%

AWS Rekognition

Age 33-41
Gender Male, 99.4%
Sad 54.2%
Happy 14.9%
Calm 10.4%
Disgusted 8.3%
Fear 6%
Angry 3%
Confused 1.9%
Surprised 1.4%

AWS Rekognition

Age 31-41
Gender Male, 99%
Disgusted 55.8%
Calm 32.4%
Happy 3.7%
Sad 3.7%
Fear 2.3%
Angry 1.2%
Surprised 0.5%
Confused 0.4%

AWS Rekognition

Age 30-40
Gender Female, 90.3%
Calm 63%
Sad 23.1%
Angry 3.1%
Fear 3%
Happy 2.9%
Confused 2.7%
Disgusted 1.3%
Surprised 1%

AWS Rekognition

Age 23-33
Gender Male, 83.4%
Calm 37.2%
Sad 29.1%
Happy 12.8%
Fear 10.9%
Angry 3.5%
Disgusted 2.9%
Confused 1.8%
Surprised 1.7%

AWS Rekognition

Age 27-37
Gender Male, 86.2%
Sad 33.2%
Calm 26%
Happy 18.6%
Disgusted 8.8%
Angry 5.9%
Fear 5.1%
Confused 1.2%
Surprised 1%

AWS Rekognition

Age 28-38
Gender Female, 72%
Sad 30.3%
Calm 24.2%
Happy 21.2%
Confused 11.9%
Surprised 3.8%
Disgusted 3.6%
Angry 3%
Fear 2%

AWS Rekognition

Age 27-37
Gender Male, 74.5%
Calm 86.2%
Sad 7.9%
Happy 2.2%
Confused 1%
Fear 1%
Angry 0.8%
Disgusted 0.6%
Surprised 0.3%

AWS Rekognition

Age 21-29
Gender Male, 97.1%
Calm 77.3%
Sad 6.7%
Happy 6.3%
Confused 3.9%
Angry 2.1%
Fear 1.9%
Surprised 1.3%
Disgusted 0.4%

AWS Rekognition

Age 18-26
Gender Male, 85%
Happy 40.5%
Angry 18%
Calm 18%
Sad 11.8%
Fear 4.3%
Surprised 3.8%
Disgusted 2%
Confused 1.7%

AWS Rekognition

Age 23-31
Gender Male, 81.9%
Calm 68.9%
Sad 22.3%
Fear 2.1%
Confused 1.6%
Happy 1.6%
Angry 1.5%
Disgusted 1.1%
Surprised 0.9%

AWS Rekognition

Age 28-38
Gender Male, 98.2%
Calm 74.6%
Happy 15%
Fear 5.4%
Sad 2%
Angry 1.2%
Confused 0.6%
Disgusted 0.6%
Surprised 0.5%

AWS Rekognition

Age 31-41
Gender Female, 95.8%
Happy 35.4%
Calm 31.3%
Sad 18.3%
Angry 4.2%
Fear 3.8%
Confused 3.2%
Disgusted 1.9%
Surprised 1.8%

AWS Rekognition

Age 26-36
Gender Male, 86.7%
Happy 48.6%
Calm 35%
Sad 6.7%
Angry 4%
Disgusted 2.3%
Surprised 1.4%
Confused 1.1%
Fear 0.8%

AWS Rekognition

Age 28-38
Gender Male, 90.4%
Calm 61.7%
Happy 30.1%
Fear 4%
Sad 2.1%
Disgusted 0.7%
Angry 0.7%
Surprised 0.4%
Confused 0.4%

AWS Rekognition

Age 27-37
Gender Male, 89.2%
Calm 53.6%
Happy 19.9%
Sad 15.5%
Angry 3.8%
Confused 3.5%
Disgusted 1.9%
Surprised 1.1%
Fear 0.8%

AWS Rekognition

Age 33-41
Gender Male, 78.8%
Calm 49.4%
Disgusted 41.3%
Sad 3.3%
Angry 2.2%
Happy 1.7%
Confused 0.8%
Surprised 0.7%
Fear 0.6%

AWS Rekognition

Age 36-44
Gender Female, 98.9%
Calm 59.8%
Happy 29.2%
Sad 5.3%
Disgusted 2.6%
Angry 1.2%
Confused 0.9%
Surprised 0.6%
Fear 0.5%

AWS Rekognition

Age 27-37
Gender Male, 88.3%
Happy 51.4%
Calm 43.7%
Sad 2.5%
Disgusted 0.6%
Fear 0.5%
Angry 0.5%
Surprised 0.4%
Confused 0.3%

AWS Rekognition

Age 23-33
Gender Male, 97.3%
Calm 58.9%
Sad 24.9%
Angry 8.6%
Happy 3.5%
Fear 2.1%
Disgusted 0.7%
Confused 0.7%
Surprised 0.6%

AWS Rekognition

Age 22-30
Gender Male, 91.3%
Calm 72.8%
Fear 6.5%
Sad 6%
Disgusted 5.3%
Happy 3.9%
Angry 2.1%
Confused 1.9%
Surprised 1.4%

AWS Rekognition

Age 23-33
Gender Male, 98.9%
Calm 84.4%
Happy 7%
Angry 3.5%
Sad 3.3%
Disgusted 0.7%
Confused 0.6%
Surprised 0.3%
Fear 0.2%

AWS Rekognition

Age 30-40
Gender Male, 88.8%
Calm 61.1%
Happy 27%
Sad 4.4%
Disgusted 4.2%
Angry 1.2%
Fear 0.8%
Confused 0.7%
Surprised 0.5%

AWS Rekognition

Age 24-34
Gender Female, 99.9%
Calm 56.4%
Sad 17.8%
Happy 9.7%
Angry 8.3%
Fear 3.1%
Disgusted 1.7%
Surprised 1.6%
Confused 1.3%

AWS Rekognition

Age 16-22
Gender Male, 59.7%
Calm 89.3%
Sad 5.1%
Fear 1.5%
Happy 1.4%
Confused 0.9%
Angry 0.8%
Disgusted 0.6%
Surprised 0.5%

AWS Rekognition

Age 26-36
Gender Male, 86.8%
Calm 67.1%
Happy 9.6%
Sad 9.5%
Disgusted 4.7%
Angry 3.3%
Surprised 2.9%
Fear 1.6%
Confused 1.4%

AWS Rekognition

Age 20-28
Gender Male, 99.8%
Calm 78.7%
Happy 14.4%
Sad 2.2%
Angry 1.6%
Disgusted 0.9%
Surprised 0.9%
Fear 0.7%
Confused 0.7%

AWS Rekognition

Age 21-29
Gender Male, 99.8%
Calm 98.4%
Sad 0.6%
Fear 0.3%
Happy 0.3%
Angry 0.2%
Disgusted 0.1%
Confused 0.1%
Surprised 0%

AWS Rekognition

Age 27-37
Gender Male, 85.6%
Calm 85.3%
Happy 5.5%
Sad 4.1%
Fear 1.4%
Disgusted 1.4%
Angry 1.2%
Surprised 0.6%
Confused 0.5%

AWS Rekognition

Age 20-28
Gender Male, 91.5%
Calm 60.2%
Sad 15.1%
Happy 9.5%
Disgusted 5.6%
Surprised 3%
Fear 2.6%
Angry 2.1%
Confused 1.9%

AWS Rekognition

Age 22-30
Gender Male, 99%
Calm 47.1%
Sad 30.7%
Happy 13.8%
Confused 4.7%
Angry 1%
Fear 1%
Surprised 1%
Disgusted 0.8%

AWS Rekognition

Age 16-24
Gender Male, 97.6%
Calm 94.6%
Happy 1.7%
Fear 1.4%
Sad 0.9%
Disgusted 0.5%
Confused 0.4%
Angry 0.3%
Surprised 0.2%

AWS Rekognition

Age 22-30
Gender Male, 95.1%
Calm 98.1%
Happy 0.5%
Surprised 0.5%
Sad 0.3%
Disgusted 0.2%
Fear 0.2%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 21-29
Gender Male, 72.1%
Calm 97.9%
Sad 0.9%
Happy 0.5%
Disgusted 0.2%
Angry 0.1%
Confused 0.1%
Fear 0.1%
Surprised 0.1%

Feature analysis

Amazon

Person
Person 91.5%
Person 89.6%
Person 88%
Person 81.3%
Person 80.4%
Person 77.6%
Person 75.3%
Person 70.7%
Person 69.7%
Person 51.8%
Person 47.2%
Person 43.9%

Captions

Microsoft
created on 2022-01-30

a vintage photo of an old building 86.9%
a vintage photo of a house 86.8%
a vintage photo of a building 86.7%

Text analysis

Amazon

the