Human Generated Data

Title

Officers and Sergeants of the St. Hadrian Civic Guard, after Hals

Date

1903

People

Artist: Robert David Gauley, American 1875 - 1943

Artist after: Frans Hals, Dutch 1581 - 1666

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Denman W. Ross, Class of 1875, 1936.150.675

Human Generated Data

Title

Officers and Sergeants of the St. Hadrian Civic Guard, after Hals

People

Artist: Robert David Gauley, American 1875 - 1943

Artist after: Frans Hals, Dutch 1581 - 1666

Date

1903

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-11-10

Human 99.1
Person 99.1
Person 98.9
Art 98.3
Painting 98.3
Person 96.6
Person 96.4
Person 94.6
Person 94.5
Person 93.5
Person 91.9
Person 89.5
Person 87.6
Person 83.4
Person 82.5
Person 68.5
Person 68.2
Person 55.3

Clarifai
created on 2019-11-10

people 99.6
art 98.5
group 98.4
religion 97.4
wear 97.1
woman 97
adult 96.4
painting 95.5
dancing 95
illustration 94.1
performance 94.1
many 93.8
man 93.2
music 92.7
child 91.7
veil 89.7
opera 88.7
stage 86
theater 85.7
outfit 85.2

Imagga
created on 2019-11-10

dancer 42.8
performer 41.6
person 35.2
entertainer 30.1
dark 26.7
art 24.3
light 22.8
people 21.2
night 19.5
dance 18.6
black 18.1
silhouette 16.5
man 15.4
fire 15
old 13.2
male 12.8
design 12.6
passion 12.2
body 12
adult 12
fantasy 11.7
hot 10.9
orange 10.7
horror 10.7
sexy 10.4
grunge 10.2
evil 9.7
death 9.6
mystery 9.6
color 9.5
smoke 9.3
disco 8.8
scary 8.7
fear 8.7
party 8.6
model 8.6
comic book 8.5
stage 8.4
figure 8.4
fashion 8.3
religion 8.1
witch 7.9
face 7.8
ancient 7.8
dancing 7.7
texture 7.6
cave 7.6
erotic 7.6
house 7.5
flame 7.5
one 7.5
lights 7.4
style 7.4
lantern 7.4
world 7.4
water 7.3
group 7.3
dress 7.2
music 7.2
holiday 7.2
portrait 7.1
posing 7.1

Google
created on 2019-11-10

Microsoft
created on 2019-11-10

text 94.2
human face 94.1
person 91.7
painting 87.8
clothing 76.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 32-48
Gender Male, 53.3%
Fear 45%
Calm 45.1%
Happy 45%
Confused 45%
Sad 54.9%
Surprised 45%
Angry 45%
Disgusted 45%

AWS Rekognition

Age 22-34
Gender Male, 54.7%
Surprised 45.4%
Angry 45.1%
Disgusted 45.1%
Fear 47.1%
Confused 45.1%
Calm 45.4%
Happy 45.1%
Sad 51.7%

AWS Rekognition

Age 37-55
Gender Male, 54.5%
Angry 45.1%
Sad 45.4%
Disgusted 45.1%
Fear 45.1%
Surprised 46.1%
Confused 45.2%
Happy 51%
Calm 47.2%

AWS Rekognition

Age 24-38
Gender Male, 54.8%
Calm 45.4%
Surprised 45%
Angry 45.2%
Sad 54.3%
Fear 45.1%
Confused 45%
Happy 45%
Disgusted 45%

AWS Rekognition

Age 24-38
Gender Male, 54.5%
Angry 47.7%
Fear 46.4%
Confused 46.1%
Sad 46.4%
Happy 45.4%
Calm 45.5%
Surprised 47.2%
Disgusted 45.3%

AWS Rekognition

Age 26-42
Gender Male, 54.3%
Calm 54.1%
Sad 45.3%
Fear 45%
Disgusted 45%
Angry 45.4%
Happy 45.1%
Surprised 45%
Confused 45.1%

AWS Rekognition

Age 32-48
Gender Male, 54%
Surprised 45%
Calm 45.1%
Disgusted 45%
Angry 45%
Fear 45%
Happy 45%
Confused 45%
Sad 54.9%

AWS Rekognition

Age 29-45
Gender Male, 54%
Angry 49.5%
Calm 46.1%
Happy 45.5%
Fear 46%
Disgusted 45.3%
Surprised 46.6%
Confused 45.4%
Sad 45.8%

AWS Rekognition

Age 32-48
Gender Male, 53.5%
Angry 45.3%
Happy 45.1%
Disgusted 45%
Fear 45.3%
Calm 47.8%
Sad 51.4%
Confused 45.1%
Surprised 45%

AWS Rekognition

Age 23-35
Gender Male, 54.8%
Angry 50.8%
Happy 45.1%
Surprised 46.5%
Calm 46.8%
Sad 45.2%
Confused 45.2%
Disgusted 45.1%
Fear 45.2%

AWS Rekognition

Age 34-50
Gender Female, 53.1%
Fear 45.2%
Disgusted 45%
Calm 46.4%
Happy 45.1%
Sad 52.6%
Confused 45.3%
Angry 45.3%
Surprised 45.1%

AWS Rekognition

Age 35-51
Gender Male, 53.9%
Happy 45.8%
Calm 45.5%
Angry 45.7%
Fear 50.8%
Surprised 46.6%
Sad 45.3%
Confused 45.2%
Disgusted 45.1%

AWS Rekognition

Age 29-45
Gender Male, 55%
Angry 45.1%
Happy 49.6%
Fear 45.1%
Disgusted 45.1%
Calm 49.2%
Sad 45.5%
Confused 45.2%
Surprised 45.4%

AWS Rekognition

Age 32-48
Gender Male, 54.1%
Calm 49.8%
Sad 48.3%
Fear 45.6%
Disgusted 45.1%
Angry 45.1%
Happy 45.6%
Surprised 45.3%
Confused 45.1%

Microsoft Cognitive Services

Age 42
Gender Male

Microsoft Cognitive Services

Age 43
Gender Male

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 44
Gender Female

Microsoft Cognitive Services

Age 42
Gender Male

Microsoft Cognitive Services

Age 54
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Painting 98.3%

Captions

Microsoft

a group of people posing for a photo 52.3%
a group of people posing for a picture 52.2%
a group of people posing for the camera 52.1%