Human Generated Data

Title

Students in front of Gore Hall
Date

1861-1866
People

Artist: George Kendall Warren, American 1824 - 1884
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of David B. Walters, P2003.169

Human Generated Data

Title

Students in front of Gore Hall

People

Artist: George Kendall Warren, American 1824 - 1884

Date

1861-1866

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-05-27

Person 99.3
Human 99.3
Person 98.9
Person 98.1
Person 98.1
Person 97.9
Person 97.3
Person 97.3
Person 96.1
Person 95.6
Person 95.5
Person 90.9
Person 90.9
Person 86.1
Funeral 82.4
People 81.6
Person 79.2
Art 77.8
Face 77
Brass Section 60.2
Musical Instrument 60.2
Horn 56.4
Photography 55.8
Photo 55.8
Drawing 55.7
Person 48.5
Person 43.7

Imagga
created on 2022-05-27

light bulb 24.7
cup 24.2
currency 22.4
container 21.7
money 21.3
coin 21
close 20
electric lamp 19.8
food 17.8
brown 16.2
closeup 16.2
finance 16.1
hat 14.8
lamp 14.7
lampshade 14.1
financial 13.4
tableware 13.3
banking 12.9
shade 12.8
cash 12.8
sombrero 12.7
bank 12.5
object 11.7
ingot 11.3
headdress 10.7
healthy 10.7
coins 10.6
metal 10.5
one 10.5
ball 10.4
source of illumination 10.1
wealth 9.9
business 9.7
black 9.6
natural 9.4
dollar 9.3
covering 9.3
stone 9.3
eat 9.2
tasty 9.2
vintage 9.1
breakfast 8.8
protective covering 8.7
block 8.7
shiny 8.7
rock 8.7
ware 8.6
round 8.6
exchange 8.6
toiletry 8.6
old 8.4
economy 8.3
delicious 8.3
gray 8.1
silver 8
pebble 7.8
texture 7.6
clothing 7.5
investment 7.3
face powder 7.2
spa 7.2
sweet 7.1

Google
created on 2022-05-27

Art 85
Font 81.2
Oval 80.8
Tints and shades 77.2
Circle 75.9
Wood 68.1
Visual arts 67.5
Monochrome 66.8
Illustration 62.2
Graphics 61.9
History 61.8
Metal 60
Sphere 59.9
Painting 56.7
Pattern 56
Symmetry 53.4

Microsoft
created on 2022-05-27

person 97
text 95.3
clothing 88.9
man 69.5
old 59.3

Face analysis

Amazon

Google

AWS Rekognition

Age 24-34
Gender Male, 99.8%
Disgusted 40.3%
Fear 21.9%
Calm 14.2%
Surprised 12.1%
Happy 7.2%
Sad 3.9%
Angry 2.6%
Confused 0.7%

AWS Rekognition

Age 22-30
Gender Male, 99.1%
Calm 99.7%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Disgusted 0.1%
Confused 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 19-27
Gender Male, 99.5%
Disgusted 37.2%
Angry 18.9%
Surprised 14.1%
Calm 11.6%
Sad 9.7%
Fear 7.2%
Confused 4.7%
Happy 2.8%

AWS Rekognition

Age 29-39
Gender Male, 100%
Disgusted 38.8%
Confused 20.1%
Calm 18.7%
Angry 9.9%
Surprised 9.4%
Fear 6.3%
Sad 4.2%
Happy 1.3%

AWS Rekognition

Age 23-31
Gender Male, 100%
Sad 75.5%
Calm 50%
Angry 7.2%
Surprised 7.1%
Fear 6.3%
Confused 3%
Disgusted 1.4%
Happy 1.1%

AWS Rekognition

Age 24-34
Gender Male, 100%
Calm 80.1%
Angry 10.1%
Surprised 6.7%
Fear 6.2%
Sad 4.5%
Confused 1.5%
Disgusted 0.7%
Happy 0.6%

AWS Rekognition

Age 22-30
Gender Male, 99.6%
Calm 96%
Surprised 6.5%
Fear 5.9%
Sad 2.4%
Disgusted 1.2%
Angry 0.7%
Confused 0.5%
Happy 0.3%

AWS Rekognition

Age 24-34
Gender Male, 99.9%
Calm 97.1%
Surprised 6.3%
Fear 5.9%
Disgusted 2.3%
Sad 2.2%
Confused 0.2%
Angry 0.1%
Happy 0.1%

AWS Rekognition

Age 27-37
Gender Male, 98.1%
Angry 70.5%
Calm 21.4%
Surprised 7%
Fear 6%
Confused 3.5%
Sad 2.5%
Disgusted 1.3%
Happy 0.5%

AWS Rekognition

Age 16-24
Gender Female, 91%
Sad 100%
Fear 6.9%
Surprised 6.4%
Calm 6.4%
Confused 1.4%
Disgusted 0.7%
Angry 0.7%
Happy 0.2%

AWS Rekognition

Age 35-43
Gender Male, 100%
Calm 81%
Sad 10.6%
Surprised 6.5%
Fear 6.1%
Confused 2.4%
Disgusted 2.2%
Angry 1.1%
Happy 0.5%

AWS Rekognition

Age 22-30
Gender Male, 100%
Calm 67.8%
Sad 22.7%
Surprised 8.1%
Fear 6.7%
Confused 6.7%
Happy 1.1%
Disgusted 0.7%
Angry 0.2%

AWS Rekognition

Age 13-21
Gender Male, 76.7%
Calm 70%
Confused 14.3%
Angry 7.5%
Surprised 6.6%
Fear 6%
Sad 3.5%
Disgusted 2.1%
Happy 1.5%

AWS Rekognition

Age 24-34
Gender Male, 85%
Calm 98.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Disgusted 0.2%
Angry 0.2%
Confused 0.2%
Happy 0.1%

AWS Rekognition

Age 24-34
Gender Male, 100%
Disgusted 76.7%
Sad 13.3%
Surprised 6.9%
Fear 6.2%
Angry 4%
Calm 1.4%
Confused 1.1%
Happy 1%

AWS Rekognition

Age 21-29
Gender Male, 99.9%
Angry 44.9%
Confused 24.4%
Sad 24.1%
Surprised 8.1%
Fear 6.4%
Calm 4.1%
Disgusted 2.4%
Happy 1%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Calm 93.3%
Surprised 6.3%
Fear 6%
Sad 3%
Confused 2.2%
Angry 1%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 25-35
Gender Male, 100%
Sad 99.4%
Calm 28.4%
Surprised 6.6%
Fear 6.2%
Disgusted 5.3%
Angry 1.1%
Happy 0.6%
Confused 0.6%

AWS Rekognition

Age 23-33
Gender Female, 56.4%
Calm 76.8%
Sad 12.9%
Surprised 6.6%
Fear 6.3%
Angry 2.9%
Disgusted 2.3%
Confused 1.8%
Happy 1%

AWS Rekognition

Age 23-33
Gender Male, 97%
Sad 46.7%
Calm 37.9%
Angry 17.7%
Surprised 10.5%
Fear 7.3%
Disgusted 3.9%
Confused 2.6%
Happy 2.2%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Calm 99.1%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Disgusted 0.3%
Confused 0.1%
Happy 0.1%
Angry 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Feature analysis

Amazon

Person 99.3%

Captions

Microsoft

an old photo of a cake 40.8%