Human Generated Data

Title

Arrest of Christ
Date

1612
People

Artist: Nicolaes de Bruyn, Flemish 1571 - 1656
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R5802

Human Generated Data

Title

Arrest of Christ

People

Artist: Nicolaes de Bruyn, Flemish 1571 - 1656

Date

1612

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Human 99.3
Person 99.3
Person 99.2
Painting 98.9
Art 98.9
Person 96.7
Person 94.9
Person 92.5
Person 91.4
Person 91.1
Person 90.4
Person 81.4
Person 79.8
Military 77.7
Military Uniform 76.2
Person 73.8
Person 71.4
People 66.7
Person 66.1
Person 62
Armored 61.1
Army 61.1
Crowd 60.6

Imagga
created on 2022-02-26

tree 52.1
landscape 40.2
sand 28.1
trees 24.9
woody plant 24.9
sky 23.6
stone wall 23.3
rock 22.6
travel 21.8
desert 21.7
vascular plant 21.3
snow 21
fence 19.4
park 18.9
plant 18.3
bonsai 17.2
scenic 16.7
water 15.3
soil 15
outdoors 14.9
natural 14.7
winter 14.5
barrier 14.3
mountain 14.2
beach 14
forest 13.9
outdoor 13.8
canyon 12.8
scenery 12.6
weather 12.6
field 12.5
rural 12.3
cold 12.1
tourism 11.6
environment 11.5
wilderness 11.5
ice 11.4
wild 11.3
wall 11.3
cemetery 11.1
summer 10.9
ocean 10.9
river 10.7
country 10.5
sun 10.5
structure 10.4
scene 10.4
rocks 10.4
dry 10.2
day 10.2
sea 10.2
clouds 10.1
stone 9.9
geology 9.7
earth 9.6
obstruction 9.6
cloud 9.5
season 9.4
lake 9.2
national 9.1
tranquil 9.1
erosion 8.8
shore 8.6
land 8.6
old 8.4
wood 8.3
vacation 8.2
road 8.1
animal 8.1
grass 7.9
arid 7.8
valley 7.8
sunny 7.7
frost 7.7
yucca 7.6
hot 7.5
palm 7.5
mountains 7.4
horizon 7.2
art 7.2
sunset 7.2
agriculture 7

Google
created on 2022-02-26

Tree 86.2
Art 84
Military organization 75.2
Vintage clothing 75
Event 72.1
Infantry 67.8
Plant 66.1
Visual arts 65.9
Uniform 65.6
Paper product 64
Pole 64
Plantation 63.6
History 62.4
Illustration 61.9
Troop 59.8
Soldier 59.7
Painting 58.4
Collection 56.8
Monochrome 51.9

Microsoft
created on 2022-02-26

tree 99.7
outdoor 98.8
text 90.3
old 84.8
person 84.5
drawing 79.2
clothing 73.1
group 70.8
black 65.9
fabric 13.9

Face analysis

Amazon

AWS Rekognition

Age 36-44
Gender Female, 53.8%
Calm 47.3%
Angry 35.3%
Surprised 4.4%
Disgusted 4.1%
Happy 4%
Sad 1.8%
Confused 1.8%
Fear 1.3%

AWS Rekognition

Age 21-29
Gender Female, 69.5%
Calm 86.5%
Happy 3%
Angry 2.9%
Sad 2.2%
Disgusted 2.2%
Fear 1.6%
Confused 0.9%
Surprised 0.7%

AWS Rekognition

Age 36-44
Gender Male, 98.5%
Calm 89.1%
Disgusted 6%
Fear 1.4%
Sad 1.1%
Confused 0.7%
Happy 0.7%
Angry 0.6%
Surprised 0.5%

AWS Rekognition

Age 33-41
Gender Female, 98.4%
Calm 97.5%
Happy 1.2%
Fear 0.3%
Confused 0.3%
Sad 0.3%
Disgusted 0.2%
Angry 0.2%
Surprised 0.1%

AWS Rekognition

Age 24-34
Gender Male, 92.8%
Calm 99.7%
Sad 0.1%
Confused 0.1%
Happy 0.1%
Fear 0.1%
Disgusted 0%
Surprised 0%
Angry 0%

AWS Rekognition

Age 16-22
Gender Male, 88.8%
Calm 84.3%
Happy 4.4%
Fear 3.4%
Sad 3.1%
Angry 2%
Disgusted 1.2%
Surprised 0.9%
Confused 0.8%

AWS Rekognition

Age 30-40
Gender Male, 99.8%
Calm 95.7%
Angry 1%
Happy 0.8%
Confused 0.7%
Fear 0.6%
Sad 0.5%
Surprised 0.4%
Disgusted 0.3%

AWS Rekognition

Age 27-37
Gender Male, 98.2%
Disgusted 86.9%
Calm 6.1%
Sad 2%
Angry 1.7%
Confused 1.2%
Surprised 0.9%
Fear 0.8%
Happy 0.4%

AWS Rekognition

Age 23-31
Gender Male, 98.8%
Calm 88%
Disgusted 4.1%
Happy 3.2%
Angry 1.6%
Sad 1.6%
Surprised 0.7%
Confused 0.5%
Fear 0.4%

AWS Rekognition

Age 23-31
Gender Male, 83.5%
Fear 45%
Calm 22.1%
Disgusted 18%
Confused 4%
Angry 3.8%
Happy 2.9%
Surprised 2.7%
Sad 1.5%

AWS Rekognition

Age 27-37
Gender Male, 95.1%
Calm 86.8%
Sad 6.8%
Confused 1.8%
Angry 1.5%
Happy 1.1%
Disgusted 1.1%
Surprised 0.6%
Fear 0.3%

AWS Rekognition

Age 28-38
Gender Female, 90.7%
Calm 62.3%
Happy 9.5%
Confused 7.6%
Disgusted 6.6%
Surprised 5.1%
Angry 4.9%
Fear 2%
Sad 1.9%

AWS Rekognition

Age 37-45
Gender Female, 96.6%
Calm 57.3%
Happy 21.8%
Disgusted 8.2%
Angry 4.8%
Surprised 2.4%
Confused 1.9%
Fear 1.9%
Sad 1.8%

AWS Rekognition

Age 51-59
Gender Male, 98%
Calm 99.8%
Fear 0.1%
Happy 0.1%
Disgusted 0%
Surprised 0%
Sad 0%
Angry 0%
Confused 0%

AWS Rekognition

Age 21-29
Gender Male, 99.8%
Calm 77%
Happy 20%
Sad 1.3%
Confused 0.6%
Disgusted 0.5%
Fear 0.3%
Angry 0.2%
Surprised 0.2%

AWS Rekognition

Age 23-33
Gender Male, 100%
Calm 98.7%
Disgusted 0.5%
Happy 0.4%
Surprised 0.1%
Angry 0.1%
Fear 0.1%
Confused 0.1%
Sad 0.1%

AWS Rekognition

Age 43-51
Gender Male, 98.3%
Calm 98.5%
Happy 0.6%
Angry 0.5%
Surprised 0.1%
Sad 0.1%
Fear 0.1%
Confused 0.1%
Disgusted 0%

AWS Rekognition

Age 20-28
Gender Male, 99.8%
Sad 53%
Calm 21.8%
Fear 13.4%
Angry 4.4%
Confused 3.1%
Happy 2.4%
Disgusted 1.3%
Surprised 0.7%

AWS Rekognition

Age 24-34
Gender Male, 98.2%
Calm 82.5%
Sad 14.4%
Confused 1.1%
Happy 0.9%
Disgusted 0.4%
Fear 0.3%
Angry 0.2%
Surprised 0.1%

AWS Rekognition

Age 20-28
Gender Female, 92.3%
Calm 92.2%
Angry 2.4%
Disgusted 2.3%
Sad 1%
Happy 0.9%
Confused 0.5%
Fear 0.4%
Surprised 0.3%

AWS Rekognition

Age 57-65
Gender Male, 99.5%
Calm 98.6%
Disgusted 0.4%
Fear 0.3%
Angry 0.2%
Surprised 0.2%
Confused 0.1%
Happy 0.1%
Sad 0.1%

AWS Rekognition

Age 25-35
Gender Male, 90.5%
Calm 84.3%
Happy 6.3%
Disgusted 4.6%
Confused 1.9%
Angry 0.9%
Sad 0.7%
Surprised 0.7%
Fear 0.6%

Feature analysis

Amazon

Person 99.3%
Painting 98.9%

Captions

Microsoft

an old photo of a group of people 80.1%
a group of people in an old photo of a person 66.6%
an old photo of a group of people in a field 66.5%

Text analysis

Amazon

BIZ