Human Generated Data

Title

Untitled (Marymount School graduating class)

Date

1940

People

Artist: Curtis Studio, American active 1891 - 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.13017

Human Generated Data

Title

Untitled (Marymount School graduating class)

People

Artist: Curtis Studio, American active 1891 - 1935

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Person 99.1
Human 99.1
Apparel 96.1
Clothing 96.1
Person 95.7
Plant 90.9
Person 89.7
Person 84.1
Tree 82.5
Crowd 79.3
People 78.3
Person 77.3
Stage 76.8
Person 75.6
Dress 74.7
Gown 74.5
Fashion 74.5
Wedding 72
Person 71.8
Robe 71.4
Person 66
Grass 64.6
Person 64.5
Person 62.7
Person 62.7
Person 61.5
Flower 60.1
Blossom 60.1
Person 59.8
Wedding Gown 59.8
Festival 59
Female 57.9
Outdoors 56
Person 52
Person 46.3

Imagga
created on 2022-02-05

fountain 35.8
structure 32.9
cemetery 24
landscape 22.3
tree 20.8
park 18.9
black 17.4
rock 16.5
stone 15.9
sky 15.3
mountain 15.3
old 13.9
snow 13.5
light 13.4
fence 13.3
picket fence 13.3
winter 12.8
travel 12.7
dark 12.5
scene 12.1
grunge 11.9
art 11.9
silhouette 11.6
tourism 11.5
cold 11.2
boutique 10.6
sun 10.5
texture 10.4
natural 10
water 10
outdoor 9.9
scenery 9.9
environment 9.9
night 9.8
world 9.7
rural 9.7
scenic 9.6
forest 9.6
ice 9.5
season 9.3
vintage 9.1
dirty 9
design 9
summer 9
group 8.9
antique 8.7
holiday 8.6
decoration 8.4
people 8.4
mountains 8.3
sand 8
barrier 7.9
crowd 7.7
walking 7.6
peaceful 7.3
rough 7.3
aged 7.2
religion 7.2
weather 7.1
trees 7.1
cool 7.1
sea 7
country 7

Google
created on 2022-02-05

Microsoft
created on 2022-02-05

christmas tree 98.2
text 95.1
black and white 82.5
tree 77.6
black 74.8
white 72.3
christmas 52.5
old 52
picture frame 10.5

Face analysis

Amazon

Google

AWS Rekognition

Age 19-27
Gender Male, 99.8%
Calm 63.2%
Confused 12.6%
Fear 6.9%
Happy 6.6%
Surprised 5.9%
Sad 2.4%
Angry 1.2%
Disgusted 1.1%

AWS Rekognition

Age 47-53
Gender Male, 87.3%
Fear 61.5%
Calm 18.6%
Happy 18%
Confused 1.1%
Sad 0.3%
Surprised 0.3%
Disgusted 0.2%
Angry 0.1%

AWS Rekognition

Age 12-20
Gender Female, 56.6%
Happy 87%
Sad 2.8%
Disgusted 2.8%
Angry 1.9%
Calm 1.5%
Confused 1.4%
Surprised 1.4%
Fear 1.1%

AWS Rekognition

Age 20-28
Gender Male, 99.9%
Calm 46.7%
Fear 43.6%
Happy 2.7%
Sad 2.3%
Surprised 1.7%
Confused 1.4%
Angry 0.9%
Disgusted 0.7%

AWS Rekognition

Age 21-29
Gender Male, 87.5%
Calm 99.6%
Happy 0.1%
Sad 0.1%
Confused 0%
Surprised 0%
Disgusted 0%
Fear 0%
Angry 0%

AWS Rekognition

Age 23-31
Gender Male, 99.9%
Calm 56.3%
Sad 13.7%
Happy 11.5%
Surprised 5.3%
Fear 4.7%
Confused 4.6%
Disgusted 2.7%
Angry 1.2%

AWS Rekognition

Age 19-27
Gender Male, 92.3%
Calm 72%
Fear 11.6%
Sad 9.4%
Happy 3.5%
Angry 1.8%
Disgusted 1%
Surprised 0.4%
Confused 0.4%

AWS Rekognition

Age 37-45
Gender Male, 99.8%
Calm 72.7%
Happy 20.2%
Fear 2.2%
Sad 1.5%
Surprised 1.2%
Disgusted 0.8%
Confused 0.6%
Angry 0.6%

AWS Rekognition

Age 36-44
Gender Female, 50.7%
Calm 53.4%
Happy 32.2%
Confused 4.8%
Sad 3.7%
Disgusted 2.2%
Surprised 2%
Angry 0.9%
Fear 0.9%

AWS Rekognition

Age 29-39
Gender Male, 93.4%
Calm 95.1%
Disgusted 1.2%
Confused 0.8%
Angry 0.8%
Sad 0.7%
Happy 0.6%
Fear 0.4%
Surprised 0.4%

AWS Rekognition

Age 30-40
Gender Male, 100%
Calm 82.6%
Fear 11.3%
Happy 3.3%
Sad 0.9%
Confused 0.6%
Angry 0.5%
Disgusted 0.4%
Surprised 0.4%

AWS Rekognition

Age 18-26
Gender Female, 81%
Calm 78%
Sad 16.6%
Fear 2.8%
Surprised 0.9%
Happy 0.8%
Disgusted 0.5%
Angry 0.4%
Confused 0.2%

AWS Rekognition

Age 25-35
Gender Male, 99.2%
Calm 56.3%
Happy 34.9%
Surprised 4%
Angry 2.2%
Confused 1.2%
Fear 0.9%
Disgusted 0.3%
Sad 0.2%

AWS Rekognition

Age 26-36
Gender Male, 99.8%
Calm 64.4%
Fear 17.2%
Confused 14.2%
Sad 2.3%
Happy 0.9%
Surprised 0.5%
Disgusted 0.2%
Angry 0.2%

AWS Rekognition

Age 23-31
Gender Male, 99%
Calm 54.8%
Happy 35.3%
Fear 4.1%
Sad 4.1%
Angry 0.6%
Surprised 0.5%
Disgusted 0.5%
Confused 0.2%

AWS Rekognition

Age 29-39
Gender Male, 83.1%
Calm 98.1%
Confused 1.1%
Sad 0.5%
Happy 0.1%
Disgusted 0.1%
Angry 0.1%
Surprised 0%
Fear 0%

AWS Rekognition

Age 19-27
Gender Female, 93.7%
Calm 72.5%
Happy 24.1%
Surprised 0.8%
Confused 0.7%
Angry 0.6%
Sad 0.6%
Disgusted 0.4%
Fear 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%

Captions

Microsoft

a vintage photo of a group of people standing in front of a building 58.6%
a vintage photo of some people that are standing in the grass 57.1%
a vintage photo of some people that are standing in front of a building 51.1%

Text analysis

Amazon

7