Human Generated Data

Title

Untitled (group of Christians?)

Date

c. 1860-1880

People

Artist: Willoughby Wallace Hooper, British 1837 - 1912

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2018.77

Human Generated Data

Title

Untitled (group of Christians?)

People

Artist: Willoughby Wallace Hooper, British 1837 - 1912

Date

c. 1860-1880

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2018.77

Machine Generated Data

Tags

Amazon
created on 2019-04-10

People 99.8
Human 99.8
Family 99.8
Person 99.5
Person 99.2
Person 99.1
Person 99
Person 98.9
Person 98.7
Person 98.7
Person 98.7
Person 98.5
Person 98.4
Person 98
Person 96.4
Art 96.4
Painting 96.4
Person 93.7

Clarifai
created on 2018-10-18

people 100
group 99.9
many 99.7
wear 99.2
adult 99.1
woman 98.5
child 98.2
portrait 98
veil 96.7
group together 96.6
leader 95.5
outfit 95
man 94.4
several 94.3
music 90.4
administration 90.3
five 89.6
elderly 88.8
offspring 88.7
religion 88.1

Imagga
created on 2018-10-18

kin 56.6
statue 31
religion 25.1
art 23.9
sculpture 22.6
old 20.2
dress 19
person 17.9
people 17.8
religious 17.8
god 17.2
history 15.2
ancient 14.7
costume 14.5
man 14.1
monument 14
church 13.9
faith 13.4
culture 12.8
catholic 12.8
world 12.4
face 12.1
fashion 12
figure 11.9
holy 11.5
detail 11.3
black 11.2
style 11.1
clothing 11.1
attendant 11
dark 10.8
tourism 10.7
male 10.6
prayer 10.6
antique 10.5
architecture 10.1
stone 10.1
traditional 10
vintage 9.9
travel 9.8
theater 9.8
portrait 9.7
saint 9.6
cathedral 9.6
historical 9.4
famous 9.3
dance 9
adult 8.8
pray 8.7
spiritual 8.6
clothes 8.4
temple 8.3
historic 8.2
decoration 8
mask 7.9
love 7.9
marble 7.7
party 7.7
mystery 7.7
mother 7.6
new 7.3
night 7.1

Google
created on 2018-10-18

Microsoft
created on 2018-10-18

person 99.5
outdoor 97.8
old 97
posing 95.8
white 89.1
group 88
black 86.7
standing 83.7
people 57.2
vintage 41.1
team 26.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 76.4%
Disgusted 0.2%
Angry 0.2%
Confused 0.1%
Happy 0.2%
Calm 0.4%
Surprised 0.1%
Sad 98.9%

AWS Rekognition

Age 35-52
Gender Male, 99.8%
Confused 10.5%
Disgusted 1.8%
Calm 27.2%
Sad 3.3%
Surprised 2.3%
Happy 0.5%
Angry 54.4%

AWS Rekognition

Age 35-52
Gender Male, 95.7%
Disgusted 25%
Angry 4.2%
Sad 7.2%
Surprised 2.9%
Confused 1.7%
Happy 4.1%
Calm 54.9%

AWS Rekognition

Age 26-43
Gender Male, 95.3%
Confused 3.3%
Surprised 2.1%
Sad 3.3%
Calm 87.5%
Angry 2.3%
Disgusted 0.6%
Happy 0.9%

AWS Rekognition

Age 35-52
Gender Male, 99.7%
Confused 5.9%
Disgusted 0.2%
Calm 88%
Sad 2.8%
Surprised 0.4%
Happy 0.2%
Angry 2.5%

AWS Rekognition

Age 26-43
Gender Male, 96.2%
Confused 1.9%
Angry 1.4%
Surprised 1.9%
Disgusted 0.3%
Happy 1.3%
Calm 90.4%
Sad 2.8%

AWS Rekognition

Age 20-38
Gender Male, 86.6%
Calm 49%
Surprised 2.3%
Disgusted 1%
Happy 1.1%
Confused 4.5%
Sad 39.1%
Angry 3.1%

AWS Rekognition

Age 26-43
Gender Female, 68.1%
Surprised 0%
Angry 0%
Sad 99.9%
Calm 0%
Confused 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 14-25
Gender Female, 96.2%
Angry 0.2%
Disgusted 0.1%
Sad 98.9%
Surprised 0.1%
Calm 0.3%
Happy 0.3%
Confused 0.1%

AWS Rekognition

Age 26-43
Gender Male, 63.5%
Confused 0.7%
Angry 0.8%
Happy 0.2%
Calm 1.4%
Disgusted 0.5%
Surprised 0.2%
Sad 96.2%

AWS Rekognition

Age 20-38
Gender Female, 72.1%
Surprised 1.6%
Disgusted 2%
Happy 1.2%
Angry 2.8%
Calm 44.9%
Sad 45.8%
Confused 1.8%

AWS Rekognition

Age 35-53
Gender Male, 84.6%
Angry 34.8%
Disgusted 2.1%
Happy 3.1%
Calm 47.1%
Sad 5.5%
Confused 2.9%
Surprised 4.5%

AWS Rekognition

Age 26-43
Gender Female, 67.6%
Confused 0.6%
Angry 2.3%
Disgusted 0.8%
Sad 93.4%
Calm 2.2%
Happy 0.3%
Surprised 0.4%

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 31
Gender Female

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 42
Gender Female

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 32
Gender Female

Microsoft Cognitive Services

Age 25
Gender Female

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 26
Gender Female

Microsoft Cognitive Services

Age 20
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Painting 96.4%

Categories

Imagga

people portraits 99.9%
paintings art 0.1%