Human Generated Data

Title

Untitled (wedding party on a bridge)
Date

1860s
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2467

Human Generated Data

Title

Untitled (wedding party on a bridge)

People

Artist: Unidentified Artist,

Date

1860s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2467

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.3
Human 99.3
Person 99
Person 98.7
Person 95.9
Person 95.7
Clothing 95.5
Apparel 95.5
Funeral 91.8
People 81
Outdoors 77.5
Suit 77.4
Overcoat 77.4
Coat 77.4
Person 74.8
Person 66
Face 61.7
Military Uniform 60.9
Military 60.9
Person 47.8

Clarifai
created on 2023-10-25

people 99.9
child 99
group 98.8
adult 97.8
woman 97.3
group together 96.8
sepia 96.1
man 95.9
boy 93.4
girl 93.3
wedding 92.6
many 92.2
recreation 91.4
monochrome 90.8
street 85.8
son 83.5
vintage 82.1
wear 81.5
portrait 81.3
war 81.2

Imagga
created on 2021-12-15

old 21.6
grave 21.4
architecture 21.2
travel 21.1
ancient 20.8
sky 19.8
history 19.7
stone 19.4
tourism 19
child 15.7
sand 15.4
people 15.1
tourist 14.5
grunge 14.5
desert 14.1
landscape 14.1
monument 13.1
rock 13
outdoors 12.8
roof 12.8
man 12.8
outdoor 12.2
culture 12
vintage 11.6
antique 11.2
hill 11.2
building 11.2
famous 11.2
person 11
landmark 10.8
mountain 10.7
vacation 10.6
thatch 10.4
structure 10
plow 10
wall 9.9
park 9.9
scenic 9.7
summer 9.6
mountains 9.3
silhouette 9.1
texture 9
kin 9
earth 9
world 8.8
statue 8.7
sport 8.5
historical 8.5
tree 8.5
field 8.4
grain 8.3
historic 8.2
aged 8.1
work 8.1
rural 7.9
construction 7.7
city 7.5
brown 7.4
art 7.3
national 7.2
life 7.2
dirty 7.2
lifestyle 7.2
brick 7.2
tool 7

Google
created on 2021-12-15

Plant 90.2
Coat 87.3
Vintage clothing 76
Suit 74.6
Tree 70.4
Motor vehicle 70.2
Monochrome 69
Leisure 68.3
Landscape 68.3
Plantation 67.2
History 67.1
Classic 67
Stock photography 62.9
Monochrome photography 62.7
Paper product 57.4
Family 53.6
Formal wear 52.6
Retro style 51.2
Transport 50.4

Microsoft
created on 2021-12-15

tree 99.1
outdoor 98.8
clothing 98
person 96.4
woman 92
man 88.4
wedding dress 86.2
text 86
bride 78.3
dress 77.2
people 72.3
posing 71.7
old 62.9
smile 53.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 45-63
Gender Male, 97.4%
Calm 81.5%
Angry 18%
Sad 0.3%
Fear 0%
Happy 0%
Confused 0%
Surprised 0%
Disgusted 0%

AWS Rekognition

Age 45-63
Gender Male, 78.3%
Calm 98%
Happy 0.5%
Sad 0.4%
Angry 0.3%
Confused 0.3%
Surprised 0.2%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 50-68
Gender Female, 57.2%
Calm 69.3%
Happy 13.3%
Sad 5.8%
Angry 3.5%
Surprised 2.2%
Disgusted 2.1%
Confused 2%
Fear 1.8%

AWS Rekognition

Age 48-66
Gender Female, 95.3%
Calm 55%
Happy 39.4%
Confused 1.8%
Surprised 1.3%
Sad 1.2%
Disgusted 0.7%
Fear 0.4%
Angry 0.3%

AWS Rekognition

Age 20-32
Gender Male, 97.6%
Calm 98%
Angry 1.1%
Sad 0.3%
Happy 0.2%
Disgusted 0.2%
Fear 0.1%
Surprised 0.1%
Confused 0%

AWS Rekognition

Age 41-59
Gender Male, 91%
Calm 77.7%
Angry 13%
Happy 2.9%
Sad 2.6%
Disgusted 1.4%
Fear 1.3%
Confused 0.7%
Surprised 0.4%

AWS Rekognition

Age 31-47
Gender Male, 58.4%
Calm 53.9%
Sad 23.2%
Disgusted 8.2%
Fear 3.5%
Confused 3.5%
Happy 3.3%
Angry 2.5%
Surprised 1.8%

AWS Rekognition

Age 27-43
Gender Female, 52.7%
Calm 69.4%
Sad 18.5%
Happy 4.4%
Surprised 1.9%
Angry 1.9%
Confused 1.8%
Fear 1.6%
Disgusted 0.3%

AWS Rekognition

Age 24-38
Gender Female, 73.5%
Calm 89.3%
Sad 2.9%
Happy 2.5%
Angry 1.9%
Confused 1.3%
Fear 1.1%
Surprised 0.6%
Disgusted 0.4%

AWS Rekognition

Age 23-35
Gender Female, 58.7%
Sad 92.6%
Calm 4.9%
Happy 0.8%
Fear 0.6%
Surprised 0.4%
Angry 0.3%
Confused 0.3%
Disgusted 0.1%

AWS Rekognition

Age 22-34
Gender Female, 67.3%
Disgusted 40.7%
Happy 19.9%
Calm 16.7%
Angry 13%
Sad 4.6%
Confused 2.6%
Fear 1.4%
Surprised 1.3%

AWS Rekognition

Age 38-56
Gender Female, 61.2%
Fear 80.2%
Surprised 6.3%
Happy 4.7%
Sad 2.6%
Angry 1.8%
Disgusted 1.7%
Calm 1.5%
Confused 1.3%

AWS Rekognition

Age 27-43
Gender Male, 93.2%
Calm 41.4%
Sad 32%
Angry 8.9%
Disgusted 7.4%
Confused 5.1%
Fear 2.6%
Happy 1.6%
Surprised 0.8%

AWS Rekognition

Age 46-64
Gender Male, 99.7%
Calm 76.4%
Angry 13.4%
Sad 8.5%
Confused 1.4%
Surprised 0.2%
Disgusted 0.1%
Fear 0.1%
Happy 0%

AWS Rekognition

Age 11-21
Gender Male, 85.7%
Calm 77.2%
Surprised 7.7%
Angry 4.6%
Confused 3.8%
Sad 2.1%
Disgusted 1.9%
Happy 1.8%
Fear 1%

AWS Rekognition

Age 24-38
Gender Male, 84.5%
Calm 68.4%
Happy 15.7%
Angry 6.3%
Disgusted 3.7%
Sad 2.3%
Confused 2.1%
Surprised 1%
Fear 0.4%

AWS Rekognition

Age 50-68
Gender Male, 99%
Calm 81%
Angry 17.7%
Sad 0.9%
Confused 0.1%
Surprised 0.1%
Disgusted 0.1%
Happy 0.1%
Fear 0%

AWS Rekognition

Age 7-17
Gender Female, 53.8%
Calm 56.7%
Sad 19.6%
Angry 9.6%
Fear 5.8%
Surprised 2.7%
Happy 2.4%
Confused 2.3%
Disgusted 0.9%

AWS Rekognition

Age 31-47
Gender Male, 57.7%
Disgusted 94.8%
Sad 1.6%
Calm 1.5%
Angry 0.6%
Happy 0.6%
Confused 0.3%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 13-25
Gender Female, 76%
Disgusted 33.2%
Calm 21.3%
Sad 17.2%
Fear 7.7%
Angry 6.2%
Confused 5.9%
Happy 5.7%
Surprised 2.9%

AWS Rekognition

Age 23-35
Gender Male, 85.4%
Calm 89.8%
Surprised 5.9%
Angry 1.4%
Sad 1.1%
Confused 0.8%
Fear 0.7%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 50-68
Gender Male, 86.9%
Happy 93.7%
Calm 3.9%
Sad 1.1%
Angry 0.6%
Disgusted 0.2%
Surprised 0.2%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 23-35
Gender Male, 93.2%
Sad 50.5%
Calm 35.6%
Angry 7%
Happy 2.2%
Confused 1.8%
Fear 1.5%
Surprised 1.1%
Disgusted 0.3%

AWS Rekognition

Age 15-27
Gender Male, 94.5%
Happy 60.7%
Disgusted 11.6%
Angry 10%
Sad 6.3%
Fear 4.8%
Calm 4.7%
Surprised 1.3%
Confused 0.8%

AWS Rekognition

Age 49-67
Gender Male, 61.8%
Calm 80.9%
Happy 8.4%
Surprised 5%
Confused 1.5%
Sad 1.4%
Disgusted 1.3%
Angry 0.9%
Fear 0.5%

AWS Rekognition

Age 23-35
Gender Male, 81.5%
Calm 96%
Happy 2.5%
Sad 0.5%
Surprised 0.4%
Angry 0.3%
Confused 0.2%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 23-35
Gender Female, 74.1%
Calm 57.2%
Confused 24.2%
Sad 7.9%
Surprised 3.2%
Happy 2.6%
Angry 2.4%
Disgusted 1.8%
Fear 0.7%

AWS Rekognition

Age 10-20
Gender Female, 50.3%
Calm 62%
Happy 18.8%
Sad 5.9%
Disgusted 5.3%
Angry 4%
Confused 1.5%
Surprised 1.4%
Fear 1.2%

AWS Rekognition

Age 24-38
Gender Male, 90.4%
Calm 75.6%
Sad 8.1%
Confused 7%
Angry 2.6%
Fear 2.3%
Happy 1.8%
Disgusted 1.7%
Surprised 1%

AWS Rekognition

Age 22-34
Gender Male, 98%
Calm 45%
Angry 32.4%
Sad 15.6%
Surprised 3.8%
Confused 1.9%
Happy 0.6%
Disgusted 0.4%
Fear 0.3%

AWS Rekognition

Age 12-22
Gender Female, 93.2%
Surprised 77.7%
Calm 7.5%
Fear 6.9%
Happy 3.3%
Angry 1.7%
Sad 1.4%
Disgusted 0.9%
Confused 0.5%

AWS Rekognition

Age 21-33
Gender Male, 88.6%
Calm 78.8%
Confused 10%
Sad 6%
Angry 2.2%
Disgusted 1.5%
Fear 0.7%
Surprised 0.5%
Happy 0.3%

AWS Rekognition

Age 26-40
Gender Female, 52.6%
Calm 43.5%
Sad 35.7%
Happy 7.8%
Angry 5%
Confused 3.8%
Fear 1.6%
Surprised 1.6%
Disgusted 0.9%

AWS Rekognition

Age 22-34
Gender Male, 95.5%
Calm 62.2%
Happy 32.5%
Disgusted 1.1%
Surprised 1.1%
Angry 1%
Sad 0.9%
Fear 0.6%
Confused 0.5%

AWS Rekognition

Age 38-56
Gender Male, 64.1%
Calm 78.9%
Sad 7.3%
Happy 4.7%
Angry 3.8%
Surprised 2%
Confused 1.7%
Fear 1.4%
Disgusted 0.2%

AWS Rekognition

Age 18-30
Gender Male, 60.4%
Disgusted 58%
Happy 15.2%
Calm 10.8%
Sad 8%
Fear 4.5%
Angry 2.6%
Confused 0.5%
Surprised 0.3%

AWS Rekognition

Age 49-67
Gender Male, 99.1%
Calm 98.5%
Angry 0.5%
Sad 0.4%
Surprised 0.3%
Happy 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 43-61
Gender Male, 81.3%
Calm 96.8%
Angry 1.3%
Sad 0.9%
Happy 0.3%
Confused 0.3%
Disgusted 0.2%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 31-47
Gender Male, 86.5%
Calm 84.2%
Sad 6%
Happy 4.3%
Surprised 2.5%
Angry 1.7%
Confused 0.7%
Disgusted 0.5%
Fear 0.1%

AWS Rekognition

Age 26-42
Gender Male, 73.1%
Calm 69.8%
Happy 17.3%
Sad 5.7%
Fear 2.4%
Angry 2.3%
Confused 1.4%
Surprised 0.6%
Disgusted 0.5%

AWS Rekognition

Age 15-27
Gender Male, 60.9%
Calm 68.5%
Sad 16.7%
Fear 4.9%
Angry 3.9%
Happy 2.5%
Surprised 1.9%
Disgusted 0.9%
Confused 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%

Categories

Imagga

people portraits 48.7%
nature landscape 24.8%
pets animals 15.9%
paintings art 6.1%
beaches seaside 3.1%