Human Generated Data

Title

The Arrest of Christ

Date

c. 1520

People

Artist: Unidentified Artist,

Artist: Herri met de Bles, Netherlandish c. 1550

Classification

Paintings

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Charles L. Kuhn, BR52.15

Human Generated Data

Title

The Arrest of Christ

People

Artist: Unidentified Artist,

Artist: Herri met de Bles, Netherlandish c. 1550

Date

c. 1520

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Person 98.6
Human 98.6
Person 96
Person 95.7
Person 95.5
Person 95.3
Art 95
Person 87.6
Person 83.2
Painting 52.7

Clarifai
created on 2020-04-24

people 99.5
man 94.4
adult 94.3
group 92.5
art 90.7
veil 86.6
wear 86.2
group together 86.2
family 84
war 81.6
woman 80.4
watercraft 80
vintage 78.8
child 78.6
military 78
portrait 75.5
soldier 75.4
two 75.1
uniform 73.3
furniture 73.2

Imagga
created on 2020-04-24

fountain 75.1
structure 52
statue 51.5
sculpture 47.4
column 45.5
architecture 29
art 28.6
old 25.1
monument 24.3
ancient 24.2
stone 23.8
history 23.3
tourism 22.3
travel 21.1
building 21
marble 20.9
landmark 20.8
religion 19.7
famous 18.6
culture 18
god 17.2
temple 16.2
historic 14.7
decoration 14.4
city 14.1
religious 14.1
carving 13
water 12
spiritual 11.5
drawing 11.3
historical 11.3
detail 11.3
antique 11.3
bronze 10.9
church 10.2
sketch 9.8
holy 9.6
sky 9.6
man 9.4
face 9.2
tourist 9.1
people 8.9
statues 8.9
worship 8.7
palace 8.7
facade 8.7
spirituality 8.6
figure 8.4
traditional 8.3
exterior 8.3
vintage 8.3
baroque 7.8
roman 7.8
representation 7.8
catholic 7.8
heritage 7.7
style 7.4
design 7.4
black 7.2

Google
created on 2020-04-24

Microsoft
created on 2020-04-24

bench 99
text 98.9
black and white 90.9
wooden 89.1
person 79.9
clothing 63.6
wood 32.4
picture frame 9.3

Face analysis

Amazon

AWS Rekognition

Age 38-56
Gender Male, 54.7%
Angry 45%
Surprised 45%
Happy 45.2%
Fear 45%
Disgusted 45%
Calm 54.7%
Sad 45.1%
Confused 45%

AWS Rekognition

Age 38-56
Gender Male, 53%
Disgusted 45%
Fear 45%
Sad 48%
Happy 45%
Angry 45.5%
Surprised 45.1%
Calm 50.7%
Confused 45.6%

AWS Rekognition

Age 23-35
Gender Male, 54.7%
Happy 45.4%
Surprised 45.7%
Sad 45.9%
Calm 50.1%
Fear 45.2%
Angry 46.2%
Disgusted 46.1%
Confused 45.3%

AWS Rekognition

Age 41-59
Gender Female, 50%
Fear 49.6%
Confused 49.5%
Angry 49.5%
Surprised 49.5%
Disgusted 49.5%
Calm 50%
Happy 49.5%
Sad 49.9%

AWS Rekognition

Age 23-35
Gender Female, 50.3%
Calm 51.3%
Fear 45.1%
Surprised 45.1%
Angry 45.5%
Sad 47.7%
Disgusted 45%
Confused 45.1%
Happy 45.1%

AWS Rekognition

Age 13-25
Gender Male, 54.7%
Fear 45.1%
Happy 45.1%
Sad 54%
Angry 45.1%
Surprised 45%
Confused 45%
Disgusted 45%
Calm 45.6%

AWS Rekognition

Age 21-33
Gender Male, 50.4%
Happy 49.5%
Fear 49.5%
Calm 49.5%
Angry 50.3%
Confused 49.5%
Surprised 49.5%
Disgusted 49.5%
Sad 49.6%

AWS Rekognition

Age 29-45
Gender Female, 50.1%
Surprised 49.5%
Sad 49.8%
Happy 49.6%
Calm 50%
Angry 49.6%
Fear 49.5%
Confused 49.5%
Disgusted 49.5%

AWS Rekognition

Age 29-45
Gender Male, 54.6%
Calm 53.5%
Disgusted 45%
Surprised 46.3%
Fear 45%
Happy 45%
Angry 45%
Sad 45%
Confused 45%

AWS Rekognition

Age 23-37
Gender Male, 53.6%
Fear 45%
Confused 45%
Calm 54.6%
Angry 45.1%
Surprised 45%
Sad 45.3%
Disgusted 45%
Happy 45%

Feature analysis

Amazon

Person 98.6%
Painting 52.7%

Captions

Microsoft

a group of people sitting on a wooden bench 75.9%
a group of people sitting at a wooden bench 75.8%
a group of people sitting on a bench 75.7%