Human Generated Data

Title

Untitled (large group outside of church)

Date

1949

People

Artist: John Deusing, American active 1940s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1847

Human Generated Data

Title

Untitled (large group outside of church)

People

Artist: John Deusing, American active 1940s

Date

1949

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.5
Human 99.5
Person 98.8
Person 98.5
Person 98.3
Person 98.1
Person 96.6
Person 94.6
Person 94.2
Clothing 90.2
Apparel 90.2
Person 87.9
Building 84.8
Housing 84.8
Tree 82.4
Plant 82.4
Person 79.9
People 79.2
Person 78.8
Outdoors 76.6
Crowd 76
Person 73.4
Face 72.4
Nature 70.8
Person 69.8
Person 69.6
Female 68.1
House 68
Person 61.2
Gown 61
Fashion 61
Robe 60.6
Girl 59.8
Countryside 59.3
Wedding Gown 56.6
Wedding 56.6

Imagga
created on 2021-12-14

picket fence 100
fence 99.5
barrier 71.3
obstruction 47.9
architecture 46.5
house 38.8
structure 36.1
building 35.9
home 33.6
window 24.1
balcony 23.3
estate 20.9
residence 20.2
real 19.9
construction 18.8
residential 18.2
old 18.1
town 17.6
travel 16.9
sky 16.6
roof 16.2
church 15.7
flowers 15.6
historic 15.6
property 15.5
new 15.4
trees 15.1
brick 14.1
city 13.3
wall 13
exterior 12.9
street 12.9
door 12.4
winter 11.9
tree 11.6
windows 11.5
country 11.4
landscape 11.2
tourism 10.7
vacation 10.6
village 10.6
urban 10.5
summer 10.3
wood 10
history 9.8
snow 9.8
luxury 9.4
fountain 9.4
stone 9.3
garden 9.2
dwelling 9.1
facade 9
neighborhood 8.9
mortgage 8.8
living 8.5
buildings 8.5
flower 8.5
traditional 8.3
religion 8.1
suburban 7.9
mansion 7.8
outdoors 7.5
plant 7.4
plants 7.4
style 7.4
day 7.1
rural 7.1
wooden 7
season 7

Google
created on 2021-12-14

Window 94.1
Building 92.9
Plant 90.7
Dress 89.9
Black 89.6
Tree 86.2
Black-and-white 84.3
Style 84
House 84
Art 77
Monochrome photography 75
Event 73.5
Rectangle 73.3
Monochrome 72.4
Pole 71.6
Vintage clothing 69.8
Cottage 67.3
Room 66.5
Facade 65.9
Home 63.2

Microsoft
created on 2021-12-14

building 99.8
outdoor 98.8
wedding 94.2
text 90.5
house 87.7
white 79.4
church 53
old 44.5

Face analysis

Amazon

Google

AWS Rekognition

Age 6-16
Gender Male, 98.1%
Happy 51.8%
Angry 19.4%
Fear 12%
Sad 5.9%
Calm 4.8%
Surprised 3.5%
Confused 1.4%
Disgusted 1.3%

AWS Rekognition

Age 16-28
Gender Female, 77.6%
Sad 35%
Calm 28.4%
Fear 17.3%
Angry 10.2%
Happy 5%
Surprised 2.6%
Confused 1.1%
Disgusted 0.3%

AWS Rekognition

Age 31-47
Gender Male, 78.4%
Angry 36.8%
Calm 32%
Confused 15.2%
Happy 5.7%
Sad 4.3%
Disgusted 2.6%
Surprised 2.1%
Fear 1.3%

AWS Rekognition

Age 25-39
Gender Male, 79.9%
Calm 43.2%
Confused 30.9%
Sad 12.4%
Happy 8.3%
Angry 2.2%
Surprised 1.5%
Disgusted 1%
Fear 0.5%

AWS Rekognition

Age 17-29
Gender Male, 94.6%
Calm 47.8%
Sad 19.3%
Angry 12.8%
Confused 9%
Happy 5.3%
Fear 3.6%
Disgusted 1.2%
Surprised 1.1%

AWS Rekognition

Age 11-21
Gender Male, 97.4%
Calm 43.7%
Happy 35.4%
Angry 6.4%
Sad 5.5%
Confused 4.6%
Surprised 1.9%
Fear 1.4%
Disgusted 1.2%

AWS Rekognition

Age 25-39
Gender Female, 82.2%
Sad 34.5%
Calm 24.9%
Angry 15.4%
Fear 9%
Surprised 7.4%
Happy 4.1%
Confused 2.8%
Disgusted 2%

AWS Rekognition

Age 13-25
Gender Female, 86.9%
Calm 76.4%
Sad 14.9%
Happy 6.9%
Confused 0.6%
Angry 0.4%
Surprised 0.3%
Fear 0.3%
Disgusted 0.2%

AWS Rekognition

Age 18-30
Gender Female, 58.7%
Calm 53.4%
Sad 20.3%
Happy 10.7%
Surprised 4.2%
Fear 3.9%
Angry 3.4%
Confused 2.7%
Disgusted 1.4%

AWS Rekognition

Age 7-17
Gender Female, 68.2%
Calm 33%
Sad 27.3%
Angry 16.6%
Confused 9.1%
Disgusted 6.2%
Fear 3%
Happy 2.8%
Surprised 2%

AWS Rekognition

Age 21-33
Gender Female, 60.6%
Calm 56.4%
Happy 20.4%
Disgusted 7.7%
Surprised 5.4%
Sad 3.8%
Confused 2.6%
Angry 2.5%
Fear 1%

AWS Rekognition

Age 40-58
Gender Male, 84.5%
Calm 58.2%
Happy 24.5%
Confused 7.5%
Angry 3.9%
Sad 2.8%
Surprised 1.5%
Disgusted 1.2%
Fear 0.4%

AWS Rekognition

Age 30-46
Gender Male, 71.4%
Calm 89%
Happy 3.1%
Surprised 2.2%
Angry 2.1%
Fear 1.2%
Sad 1.2%
Disgusted 1.1%
Confused 0.2%

AWS Rekognition

Age 40-58
Gender Male, 90.1%
Disgusted 54%
Calm 37.7%
Happy 4.6%
Angry 1.3%
Sad 0.9%
Surprised 0.7%
Fear 0.5%
Confused 0.4%

AWS Rekognition

Age 18-30
Gender Male, 89.5%
Calm 62.5%
Confused 24.2%
Surprised 3.8%
Sad 3.2%
Happy 2.9%
Angry 1.8%
Disgusted 0.8%
Fear 0.7%

AWS Rekognition

Age 23-35
Gender Male, 90%
Calm 84.4%
Happy 5.7%
Angry 4.6%
Sad 3.3%
Confused 1.1%
Disgusted 0.4%
Surprised 0.3%
Fear 0.2%

AWS Rekognition

Age 23-35
Gender Female, 92.5%
Happy 41.7%
Calm 24.1%
Angry 16.8%
Sad 7%
Surprised 6.1%
Confused 1.9%
Disgusted 1.2%
Fear 1.1%

AWS Rekognition

Age 18-30
Gender Female, 57%
Calm 40.2%
Sad 19.8%
Surprised 17.8%
Confused 11.4%
Fear 3.8%
Angry 3.1%
Happy 2.5%
Disgusted 1.5%

AWS Rekognition

Age 42-60
Gender Female, 85%
Calm 85%
Happy 8.3%
Sad 5.5%
Angry 0.4%
Confused 0.4%
Surprised 0.2%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 35-51
Gender Female, 75.9%
Calm 53.5%
Sad 38%
Happy 8%
Angry 0.3%
Confused 0.1%
Surprised 0.1%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 0-4
Gender Female, 51.5%
Sad 34.6%
Angry 29.5%
Calm 21.5%
Happy 6.4%
Fear 3.1%
Disgusted 2.3%
Surprised 1.5%
Confused 1.1%

AWS Rekognition

Age 17-29
Gender Female, 76.5%
Calm 87.9%
Sad 10.2%
Happy 0.9%
Fear 0.3%
Angry 0.2%
Confused 0.2%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 34-50
Gender Male, 59.7%
Calm 58.2%
Happy 29.5%
Sad 5.6%
Angry 2.4%
Surprised 1.4%
Confused 1.3%
Fear 1.2%
Disgusted 0.6%

AWS Rekognition

Age 31-47
Gender Male, 92.5%
Happy 40.7%
Calm 27.1%
Angry 13%
Confused 6.1%
Disgusted 5.6%
Sad 3.7%
Surprised 2.4%
Fear 1.5%

AWS Rekognition

Age 23-35
Gender Female, 93.5%
Calm 49.1%
Sad 38.8%
Confused 5.1%
Happy 3.3%
Angry 1.3%
Surprised 1.3%
Fear 0.6%
Disgusted 0.5%

AWS Rekognition

Age 22-34
Gender Female, 50.4%
Calm 64.8%
Sad 17.3%
Happy 11%
Surprised 1.9%
Angry 1.9%
Fear 1.6%
Confused 1.1%
Disgusted 0.4%

AWS Rekognition

Age 35-51
Gender Male, 92%
Calm 96.7%
Happy 1.9%
Sad 0.6%
Angry 0.4%
Surprised 0.2%
Confused 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 34-50
Gender Female, 54.4%
Calm 62.5%
Happy 20.2%
Fear 7.4%
Surprised 4.2%
Sad 3.9%
Confused 1%
Angry 0.4%
Disgusted 0.2%

AWS Rekognition

Age 37-55
Gender Female, 59.9%
Calm 57.2%
Happy 24.3%
Sad 10.3%
Angry 3%
Confused 2.9%
Surprised 1.1%
Fear 0.6%
Disgusted 0.6%

AWS Rekognition

Age 3-9
Gender Female, 74.4%
Sad 57.1%
Calm 18.2%
Fear 12.1%
Happy 4.5%
Angry 2.8%
Surprised 2.7%
Confused 2.1%
Disgusted 0.4%

AWS Rekognition

Age 42-60
Gender Female, 90.8%
Calm 48.7%
Sad 25.2%
Angry 10.5%
Fear 5.2%
Surprised 3.4%
Confused 3.2%
Happy 2.2%
Disgusted 1.6%

AWS Rekognition

Age 28-44
Gender Male, 62.3%
Calm 60.6%
Happy 30.8%
Disgusted 4.1%
Sad 2.4%
Confused 0.6%
Angry 0.6%
Fear 0.4%
Surprised 0.4%

AWS Rekognition

Age 36-54
Gender Female, 77.5%
Confused 30.6%
Calm 25.4%
Sad 24.8%
Angry 10.7%
Happy 2.8%
Disgusted 2.4%
Fear 1.9%
Surprised 1.3%

AWS Rekognition

Age 26-40
Gender Male, 97.7%
Happy 45%
Calm 24%
Fear 15.2%
Confused 6.8%
Sad 4.4%
Angry 2.5%
Surprised 1.5%
Disgusted 0.5%

AWS Rekognition

Age 35-51
Gender Male, 70.9%
Calm 38%
Happy 27.4%
Confused 11.4%
Angry 11.1%
Sad 6.1%
Surprised 3.2%
Disgusted 1.8%
Fear 1.1%

AWS Rekognition

Age 12-22
Gender Male, 56.7%
Fear 80.6%
Surprised 8.5%
Angry 5.8%
Calm 1.9%
Confused 1%
Sad 1%
Disgusted 0.6%
Happy 0.6%

AWS Rekognition

Age 13-25
Gender Female, 93.3%
Calm 47.8%
Sad 26.4%
Happy 22.6%
Confused 0.8%
Angry 0.8%
Disgusted 0.6%
Fear 0.6%
Surprised 0.3%

AWS Rekognition

Age 20-32
Gender Female, 82.8%
Happy 47%
Calm 19.4%
Sad 9.7%
Surprised 6.8%
Angry 6.3%
Confused 6.1%
Fear 2.8%
Disgusted 2%

AWS Rekognition

Age 23-35
Gender Male, 85.3%
Calm 89.8%
Sad 4.3%
Surprised 2.9%
Confused 1%
Angry 0.9%
Happy 0.5%
Fear 0.4%
Disgusted 0.2%

AWS Rekognition

Age 2-8
Gender Female, 65.6%
Calm 47%
Happy 44.3%
Sad 5.1%
Angry 2.1%
Fear 0.6%
Surprised 0.3%
Disgusted 0.3%
Confused 0.2%

AWS Rekognition

Age 46-64
Gender Male, 79.5%
Calm 97.4%
Happy 1.8%
Sad 0.3%
Angry 0.2%
Fear 0.1%
Surprised 0.1%
Disgusted 0.1%
Confused 0%

AWS Rekognition

Age 43-61
Gender Male, 80.2%
Calm 55.3%
Happy 21.9%
Sad 17.4%
Angry 2%
Confused 1.9%
Disgusted 0.6%
Fear 0.4%
Surprised 0.4%

AWS Rekognition

Age 6-16
Gender Male, 98.2%
Happy 52.6%
Calm 34%
Sad 3.1%
Surprised 3.1%
Confused 2.9%
Fear 2%
Angry 1.9%
Disgusted 0.5%

AWS Rekognition

Age 21-33
Gender Female, 59.6%
Calm 84.7%
Happy 10.9%
Sad 2.3%
Confused 0.6%
Surprised 0.6%
Angry 0.5%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 35-51
Gender Female, 56.6%
Calm 57.5%
Happy 33.6%
Sad 4.1%
Surprised 2%
Confused 1.1%
Angry 0.7%
Disgusted 0.5%
Fear 0.4%

AWS Rekognition

Age 30-46
Gender Male, 64.2%
Calm 86.9%
Happy 9.1%
Sad 2.3%
Confused 1%
Angry 0.3%
Surprised 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 50-68
Gender Male, 78.8%
Calm 76.7%
Happy 9.9%
Sad 9.8%
Confused 2%
Angry 1.2%
Surprised 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 34-50
Gender Male, 76.2%
Happy 27.7%
Fear 23.7%
Calm 21.1%
Angry 8.2%
Confused 6.6%
Sad 6.2%
Surprised 5.2%
Disgusted 1.2%

AWS Rekognition

Age 23-37
Gender Male, 95.2%
Happy 54.9%
Calm 28.8%
Fear 7.9%
Sad 3.5%
Surprised 2.2%
Angry 1.3%
Confused 0.9%
Disgusted 0.5%

AWS Rekognition

Age 46-64
Gender Male, 97.3%
Calm 95.9%
Angry 2.1%
Surprised 0.8%
Sad 0.4%
Fear 0.4%
Happy 0.2%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 23-35
Gender Male, 67.5%
Calm 89.9%
Surprised 2.8%
Confused 2.7%
Happy 2.1%
Sad 1.4%
Angry 0.7%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 27-43
Gender Female, 56.6%
Calm 87.7%
Sad 7.4%
Happy 1.4%
Confused 1.3%
Disgusted 0.9%
Angry 0.6%
Surprised 0.4%
Fear 0.4%

AWS Rekognition

Age 46-64
Gender Male, 94.2%
Calm 83.3%
Sad 11.5%
Angry 1.9%
Happy 1.1%
Disgusted 1%
Surprised 0.6%
Confused 0.5%
Fear 0.1%

AWS Rekognition

Age 34-50
Gender Male, 91.9%
Calm 49.9%
Happy 36.7%
Confused 4.6%
Sad 2.6%
Surprised 2.6%
Angry 2.6%
Disgusted 0.7%
Fear 0.3%

AWS Rekognition

Age 31-47
Gender Female, 77%
Happy 56.8%
Calm 38.5%
Sad 3.1%
Confused 0.5%
Angry 0.5%
Disgusted 0.3%
Fear 0.2%
Surprised 0.2%

AWS Rekognition

Age 18-30
Gender Male, 78.9%
Happy 61.6%
Calm 20.9%
Surprised 6.2%
Angry 5.4%
Sad 2%
Fear 1.8%
Confused 1.7%
Disgusted 0.5%

AWS Rekognition

Age 22-34
Gender Male, 95.1%
Calm 40%
Happy 23.4%
Sad 9.7%
Confused 9.6%
Angry 9.2%
Surprised 4.6%
Disgusted 1.8%
Fear 1.7%

AWS Rekognition

Age 20-32
Gender Female, 50.9%
Happy 38.6%
Surprised 21.2%
Calm 17.8%
Fear 9.6%
Sad 5.8%
Angry 3.9%
Confused 2.4%
Disgusted 0.7%

AWS Rekognition

Age 22-34
Gender Female, 63.8%
Happy 45.3%
Calm 32.3%
Angry 8.7%
Sad 7.6%
Fear 2.5%
Confused 1.6%
Disgusted 1.2%
Surprised 0.8%

AWS Rekognition

Age 23-37
Gender Male, 89.6%
Fear 22.5%
Angry 15.4%
Confused 14.1%
Calm 12.6%
Happy 11.6%
Surprised 10.3%
Sad 9.9%
Disgusted 3.6%

AWS Rekognition

Age 33-49
Gender Male, 62.4%
Happy 45.5%
Surprised 27.9%
Calm 10.8%
Angry 7%
Fear 4.1%
Sad 2.6%
Confused 1.3%
Disgusted 0.6%

AWS Rekognition

Age 16-28
Gender Female, 97.7%
Calm 69.8%
Happy 22%
Surprised 2.1%
Sad 1.9%
Confused 1.7%
Disgusted 1.2%
Fear 0.7%
Angry 0.6%

AWS Rekognition

Age 49-67
Gender Male, 67.4%
Calm 56.9%
Surprised 20.4%
Happy 7.4%
Disgusted 6.6%
Sad 3.4%
Fear 2.3%
Angry 1.8%
Confused 1.1%

AWS Rekognition

Age 13-25
Gender Female, 53.7%
Calm 68.7%
Happy 19.7%
Confused 4.2%
Sad 4%
Disgusted 1.5%
Angry 1.3%
Surprised 0.4%
Fear 0.2%

AWS Rekognition

Age 36-54
Gender Female, 72.5%
Calm 60.7%
Happy 17.8%
Sad 11%
Surprised 4%
Angry 2.7%
Confused 1.7%
Fear 1.3%
Disgusted 0.8%

AWS Rekognition

Age 16-28
Gender Male, 90.5%
Sad 43.9%
Calm 24.4%
Confused 12.1%
Surprised 7%
Happy 6.4%
Disgusted 2.6%
Angry 1.8%
Fear 1.6%

AWS Rekognition

Age 26-42
Gender Male, 75.5%
Calm 39.5%
Sad 30.6%
Angry 9.1%
Fear 8.9%
Happy 7%
Surprised 3.1%
Confused 1.1%
Disgusted 0.7%

AWS Rekognition

Age 37-55
Gender Female, 55.3%
Sad 43.6%
Fear 18.2%
Calm 17%
Confused 11.6%
Happy 4.3%
Surprised 2.8%
Disgusted 1.4%
Angry 1.1%

AWS Rekognition

Age 13-25
Gender Female, 77.8%
Sad 46%
Calm 26.8%
Happy 20.9%
Confused 3%
Angry 2.1%
Surprised 0.5%
Fear 0.4%
Disgusted 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%

Captions

Microsoft

a group of people standing in front of a building 92.8%
a group of people in front of a building 92.7%
a group of people standing in front of a house 92.5%

Text analysis

Amazon

n
1
d