Human Generated Data

Title

Untitled (group portrait of teenage students wearing formal wear outside building with women hoding bouquets)

Date

1936

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9117

Human Generated Data

Title

Untitled (group portrait of teenage students wearing formal wear outside building with women hoding bouquets)

People

Artist: Martin Schweig, American 20th century

Date

1936

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 94.1
Human 94.1
Person 93
Person 92.4
Person 91
Person 90.3
Person 89.4
People 86.5
Person 80.8
Art 79.2
Person 78.7
Person 77.7
Clothing 76.2
Apparel 76.2
Poster 70.6
Advertisement 70.6
Person 70.1
Person 63.2
Person 62.4
Person 59.8

Imagga
created on 2022-01-23

cemetery 100
stone 26.3
landscape 26
travel 23.2
sky 20.4
old 20.2
tourism 19.8
water 19.3
rock 19.1
architecture 18
park 16.5
ancient 16.4
scene 15.6
gravestone 14.5
city 14.1
structure 14
building 13.5
history 13.4
river 13.3
rural 13.2
scenic 13.2
tree 13.1
outdoor 13
scenery 12.6
sea 12.5
memorial 11.7
summer 11.6
historical 11.3
church 11.1
ocean 10.8
coast 10.8
trees 10.7
grass 10.3
historic 10.1
countryside 10
landmark 9.9
environment 9.9
outdoors 9.7
country 9.7
clouds 9.3
town 9.3
field 9.2
tourist 9.1
religion 9
mountain 8.9
sand 8.7
castle 8.7
england 8.6
skyline 8.5
capital 8.5
house 8.5
monument 8.4
wall 8.3
island 8.2
national 8.2
tower 8.1
sun 8.1
farm 8
urban 7.9
day 7.8
erosion 7.8
cold 7.7
sunny 7.7
shore 7.4
vacation 7.4
natural 7.4
snow 7.4
lake 7.3
black 7.2
horizon 7.2

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

text 99
old 70.4
clothing 58.4

Face analysis

Amazon

AWS Rekognition

Age 19-27
Gender Male, 97.2%
Calm 98.6%
Sad 0.5%
Surprised 0.3%
Happy 0.2%
Angry 0.1%
Confused 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 29-39
Gender Male, 98.4%
Happy 58.7%
Calm 29.2%
Surprised 4.5%
Confused 1.9%
Disgusted 1.8%
Angry 1.7%
Sad 1.5%
Fear 0.8%

AWS Rekognition

Age 33-41
Gender Male, 99.5%
Calm 98%
Happy 0.7%
Sad 0.5%
Confused 0.2%
Surprised 0.2%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 49-57
Gender Male, 55.6%
Happy 95.1%
Calm 1.6%
Sad 1.5%
Fear 0.5%
Surprised 0.4%
Angry 0.3%
Disgusted 0.3%
Confused 0.2%

AWS Rekognition

Age 34-42
Gender Female, 88.6%
Calm 59.6%
Sad 23.6%
Happy 12.8%
Confused 1.8%
Disgusted 0.8%
Surprised 0.5%
Fear 0.5%
Angry 0.5%

AWS Rekognition

Age 23-31
Gender Male, 96.9%
Calm 88.1%
Happy 8.3%
Surprised 1%
Fear 0.6%
Disgusted 0.6%
Confused 0.6%
Angry 0.5%
Sad 0.3%

AWS Rekognition

Age 23-31
Gender Male, 87%
Calm 88.4%
Happy 4.9%
Sad 3.6%
Angry 1.8%
Disgusted 0.6%
Confused 0.3%
Surprised 0.3%
Fear 0.2%

AWS Rekognition

Age 39-47
Gender Male, 87.7%
Calm 91.2%
Happy 2.7%
Angry 2.4%
Surprised 1.5%
Disgusted 0.9%
Sad 0.6%
Confused 0.5%
Fear 0.2%

AWS Rekognition

Age 25-35
Gender Male, 98.3%
Calm 98%
Sad 1%
Disgusted 0.6%
Angry 0.2%
Happy 0.1%
Confused 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 31-41
Gender Male, 98.1%
Calm 98.7%
Sad 0.5%
Happy 0.3%
Surprised 0.2%
Disgusted 0.1%
Fear 0.1%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 35-43
Gender Female, 52.7%
Happy 87.6%
Calm 4.8%
Sad 3.2%
Fear 1.1%
Confused 1%
Angry 1%
Surprised 0.7%
Disgusted 0.6%

AWS Rekognition

Age 40-48
Gender Male, 98.2%
Happy 63.6%
Calm 26.7%
Sad 6.4%
Surprised 1%
Fear 0.7%
Angry 0.6%
Confused 0.5%
Disgusted 0.4%

AWS Rekognition

Age 31-41
Gender Male, 97.6%
Calm 88%
Happy 3.4%
Angry 2.5%
Surprised 2.2%
Disgusted 2%
Sad 1.4%
Confused 0.4%
Fear 0.3%

AWS Rekognition

Age 45-51
Gender Male, 99.6%
Calm 99.2%
Sad 0.2%
Angry 0.2%
Happy 0.1%
Surprised 0.1%
Disgusted 0.1%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 25-35
Gender Female, 68.3%
Calm 77.2%
Sad 22.8%
Confused 0%
Happy 0%
Surprised 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 42-50
Gender Female, 65.9%
Calm 89.9%
Happy 4.1%
Sad 2.4%
Angry 1.8%
Disgusted 0.6%
Confused 0.6%
Surprised 0.5%
Fear 0.2%

AWS Rekognition

Age 18-26
Gender Female, 50.7%
Angry 39.9%
Calm 34.9%
Sad 16.8%
Surprised 2.4%
Happy 1.9%
Confused 1.6%
Disgusted 1.5%
Fear 1.1%

AWS Rekognition

Age 22-30
Gender Female, 60.8%
Calm 81.4%
Sad 9.4%
Happy 3.9%
Surprised 1.5%
Fear 1.4%
Angry 1.1%
Confused 0.6%
Disgusted 0.5%

AWS Rekognition

Age 18-26
Gender Female, 53%
Happy 33.3%
Sad 29.5%
Calm 21.1%
Disgusted 5.3%
Fear 5.1%
Angry 3.6%
Surprised 1.3%
Confused 0.9%

AWS Rekognition

Age 41-49
Gender Male, 97.4%
Calm 59%
Happy 19.3%
Sad 13%
Surprised 3.6%
Confused 1.9%
Fear 1.6%
Disgusted 0.9%
Angry 0.7%

AWS Rekognition

Age 41-49
Gender Male, 93.9%
Calm 95.8%
Happy 3.2%
Sad 0.4%
Surprised 0.2%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 27-37
Gender Female, 54.2%
Calm 77.4%
Happy 12.7%
Sad 3.3%
Angry 2.1%
Fear 1.9%
Disgusted 1%
Confused 0.9%
Surprised 0.6%

AWS Rekognition

Age 49-57
Gender Male, 99.7%
Calm 99.9%
Sad 0%
Confused 0%
Angry 0%
Happy 0%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 18-26
Gender Male, 99.9%
Calm 95.3%
Sad 2.6%
Confused 0.7%
Happy 0.6%
Surprised 0.4%
Disgusted 0.2%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 34-42
Gender Male, 99.3%
Calm 96.4%
Surprised 0.9%
Angry 0.9%
Fear 0.8%
Happy 0.6%
Disgusted 0.2%
Sad 0.2%
Confused 0.1%

AWS Rekognition

Age 33-41
Gender Male, 88.9%
Happy 62.6%
Calm 32.8%
Sad 3%
Angry 0.7%
Confused 0.3%
Disgusted 0.2%
Fear 0.2%
Surprised 0.2%

AWS Rekognition

Age 37-45
Gender Male, 99.9%
Calm 97.1%
Happy 1.9%
Surprised 0.3%
Sad 0.2%
Disgusted 0.2%
Angry 0.1%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 22-30
Gender Male, 92.5%
Happy 63.7%
Calm 13.5%
Surprised 11.3%
Sad 4.1%
Fear 2.6%
Angry 2.1%
Confused 1.7%
Disgusted 1.1%

AWS Rekognition

Age 47-53
Gender Male, 93.3%
Calm 98%
Happy 0.8%
Sad 0.4%
Confused 0.2%
Disgusted 0.2%
Surprised 0.2%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 43-51
Gender Male, 99.9%
Calm 97.4%
Sad 1.7%
Happy 0.2%
Surprised 0.2%
Disgusted 0.2%
Confused 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 45-53
Gender Male, 99.8%
Calm 99.3%
Happy 0.4%
Surprised 0.1%
Sad 0.1%
Confused 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 18-26
Gender Male, 93%
Calm 99.8%
Angry 0%
Sad 0%
Surprised 0%
Happy 0%
Disgusted 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 25-35
Gender Female, 65.3%
Calm 100%
Surprised 0%
Happy 0%
Sad 0%
Confused 0%
Disgusted 0%
Fear 0%
Angry 0%

AWS Rekognition

Age 30-40
Gender Male, 65.4%
Calm 99%
Sad 0.7%
Confused 0.1%
Happy 0.1%
Surprised 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 40-48
Gender Male, 99.2%
Calm 95%
Sad 2.7%
Happy 1.3%
Confused 0.3%
Angry 0.2%
Surprised 0.2%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 40-48
Gender Male, 99.8%
Calm 38.7%
Sad 24.3%
Happy 15.5%
Angry 5.7%
Disgusted 5%
Surprised 5%
Confused 4.1%
Fear 1.8%

AWS Rekognition

Age 19-27
Gender Male, 66.4%
Calm 31.2%
Happy 29.3%
Surprised 22.2%
Sad 5.8%
Angry 4.2%
Disgusted 3.8%
Confused 2%
Fear 1.5%

AWS Rekognition

Age 43-51
Gender Male, 95.7%
Calm 94.3%
Happy 2.2%
Sad 0.9%
Disgusted 0.6%
Angry 0.6%
Confused 0.5%
Surprised 0.5%
Fear 0.4%

AWS Rekognition

Age 28-38
Gender Male, 98.6%
Happy 49.1%
Sad 23.7%
Calm 17.5%
Angry 2.7%
Disgusted 2.6%
Fear 1.7%
Confused 1.4%
Surprised 1.2%

AWS Rekognition

Age 27-37
Gender Female, 63.9%
Happy 56%
Calm 33.2%
Sad 6.1%
Fear 1.2%
Angry 1.2%
Confused 1%
Disgusted 0.9%
Surprised 0.5%

AWS Rekognition

Age 33-41
Gender Male, 99.8%
Calm 34.7%
Sad 26.2%
Angry 15.3%
Happy 12%
Disgusted 3.8%
Fear 2.9%
Surprised 2.6%
Confused 2.6%

AWS Rekognition

Age 22-30
Gender Female, 75.5%
Happy 46.2%
Sad 20.1%
Calm 10.7%
Angry 9.6%
Fear 5.6%
Disgusted 2.9%
Surprised 2.8%
Confused 2.1%

AWS Rekognition

Age 33-41
Gender Female, 56.2%
Calm 94%
Happy 1.6%
Surprised 1%
Confused 0.9%
Sad 0.8%
Disgusted 0.7%
Angry 0.7%
Fear 0.3%

AWS Rekognition

Age 29-39
Gender Male, 79.2%
Calm 97.8%
Sad 1.2%
Happy 0.5%
Surprised 0.2%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 43-51
Gender Female, 92.5%
Calm 99.5%
Sad 0.2%
Happy 0.1%
Confused 0%
Surprised 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 37-45
Gender Male, 98.2%
Calm 99.7%
Happy 0.1%
Surprised 0%
Disgusted 0%
Sad 0%
Fear 0%
Confused 0%
Angry 0%

AWS Rekognition

Age 27-37
Gender Female, 52.3%
Happy 70.9%
Calm 25.5%
Sad 1.3%
Surprised 1%
Angry 0.4%
Disgusted 0.4%
Fear 0.3%
Confused 0.2%

AWS Rekognition

Age 22-30
Gender Female, 56.4%
Calm 93.6%
Happy 2.1%
Surprised 1.2%
Disgusted 1.1%
Fear 0.7%
Sad 0.7%
Angry 0.5%
Confused 0.2%

AWS Rekognition

Age 37-45
Gender Male, 62.3%
Calm 99.4%
Sad 0.5%
Confused 0%
Angry 0%
Disgusted 0%
Surprised 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 40-48
Gender Male, 76.6%
Calm 92.3%
Sad 2.8%
Disgusted 1.3%
Happy 1.2%
Confused 0.7%
Surprised 0.7%
Fear 0.6%
Angry 0.4%

AWS Rekognition

Age 18-26
Gender Male, 99%
Calm 97.9%
Sad 1.2%
Happy 0.3%
Confused 0.1%
Surprised 0.1%
Fear 0.1%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 26-36
Gender Male, 92.2%
Calm 99.5%
Surprised 0.2%
Sad 0.1%
Confused 0.1%
Happy 0.1%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 27-37
Gender Male, 94.9%
Calm 98.7%
Sad 0.7%
Happy 0.1%
Confused 0.1%
Angry 0.1%
Fear 0.1%
Surprised 0.1%
Disgusted 0.1%

Feature analysis

Amazon

Person 94.1%
Poster 70.6%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 71.7%
a vintage photo of a group of people posing for a picture 71.6%
a vintage photo of a group of people standing in front of a crowd 70.4%