Human Generated Data

Title

Untitled (Brahmin scholars)
Date

1862-1863
People

Artist: Charles Shepherd and Arthur Robertson, British, English in partnership c. 1862-1863
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. R. Minturn Sedgwick in memory of R. Minturn Sedgwick, Class of 1921, P1981.62

Human Generated Data

Title

Untitled (Brahmin scholars)

People

Artist: Charles Shepherd and Arthur Robertson, British, English in partnership c. 1862-1863

Date

1862-1863

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. R. Minturn Sedgwick in memory of R. Minturn Sedgwick, Class of 1921, P1981.62

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.7
Human 99.7
Person 99.3
Person 99.2
Person 98.9
Chef 97.7
Helmet 86.3
Clothing 86.3
Apparel 86.3

Clarifai
created on 2023-10-26

people 100
adult 99.2
group 98.6
veil 98.2
two 97.6
man 96.5
lid 96.3
portrait 96
three 95.4
group together 94.9
military 94.2
wear 93.7
woman 92.4
four 89.6
several 86.5
outfit 86.2
uniform 85.8
leader 85.6
child 85.4
five 84.5

Imagga
created on 2022-01-23

kin 35
person 30
people 27.3
man 26.9
portrait 24.6
male 24.1
hat 21.1
adult 19.6
couple 18.3
love 17.3
dress 17.1
happy 16.9
ballplayer 15.8
player 14.9
face 14.2
happiness 14.1
men 13.7
attractive 13.3
black 13.2
athlete 13
clothing 12.7
romantic 12.5
smile 12.1
two 11.8
world 11.8
religion 11.6
married 11.5
costume 11.4
look 11.4
ruler 10.8
handsome 10.7
family 10.7
statue 10.6
fashion 10.5
bride 10.5
contestant 10.4
old 10.4
uniform 9.6
culture 9.4
tradition 9.2
wedding 9.2
traditional 9.1
father 9.1
child 9.1
sculpture 9
romance 8.9
lady 8.9
new 8.9
interior 8.8
sexy 8.8
celebration 8.8
husband 8.7
boy 8.7
lifestyle 8.7
sitting 8.6
pair 8.5
pretty 8.4
human 8.2
indoor 8.2
style 8.1
mother 8.1
guy 8.1
home 8
smiling 7.9
dad 7.9
prayer 7.7
wall 7.7
youth 7.7
worker 7.6
art 7.6
hand 7.6
wife 7.6
senior 7.5
religious 7.5
pose 7.2
success 7.2
decoration 7.2
looking 7.2
team 7.2
grandfather 7.1
businessman 7.1
architecture 7

Google
created on 2022-01-23

Hat 83.2
Cooking 79.3
Vintage clothing 74.2
Table 74
Event 69.4
Cook 68.2
Art 67.7
Sitting 66.1
History 65.8
Recreation 64.9
Room 62.3
Classic 60.6
Sun hat 56.8
Cuisine 54.1
Crew 54
Family 52.5
Team 52.4
Retro style 50.8

Microsoft
created on 2022-01-23

wall 97.1
text 96.7
old 96.5
person 95.2
sitting 94.8
clothing 93.3
man 92.4
hat 82
people 68
player 65.4
white 64.1
posing 56.9
vintage 33.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 13-21
Gender Female, 99.7%
Calm 72.5%
Sad 20.8%
Disgusted 1.6%
Surprised 1.6%
Confused 1.5%
Fear 0.8%
Angry 0.7%
Happy 0.4%

AWS Rekognition

Age 39-47
Gender Male, 99.6%
Calm 87.7%
Sad 7.9%
Confused 1.1%
Surprised 0.8%
Angry 0.7%
Disgusted 0.6%
Fear 0.6%
Happy 0.5%

AWS Rekognition

Age 23-31
Gender Male, 99.9%
Calm 61.2%
Surprised 16%
Fear 6.8%
Angry 4.6%
Disgusted 4%
Sad 2.7%
Happy 2.6%
Confused 2.2%

AWS Rekognition

Age 45-51
Gender Male, 100%
Calm 68.6%
Sad 20.3%
Happy 2.7%
Disgusted 2.1%
Angry 2%
Confused 1.5%
Surprised 1.3%
Fear 1.3%

Microsoft Cognitive Services

Age 45
Gender Male

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Helmet 86.3%

Categories

Imagga

people portraits 79.5%
paintings art 19.7%