Human Generated Data

Title

Untitled (Mughal family group)

Date

1862-1863

People

Artist: Charles Shepherd and Arthur Robertson, British, English in partnership c. 1862-1863

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. R. Minturn Sedgwick in memory of R. Minturn Sedgwick, Class of 1921, P1981.61

Human Generated Data

Title

Untitled (Mughal family group)

People

Artist: Charles Shepherd and Arthur Robertson, British, English in partnership c. 1862-1863

Date

1862-1863

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. R. Minturn Sedgwick in memory of R. Minturn Sedgwick, Class of 1921, P1981.61

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.3
Person 98.5
People 98.4
Person 98.3
Family 98.1
Person 98.1
Person 97.2
Person 95.8
Person 93.8
Painting 80.4
Art 80.4
Helmet 77.1
Clothing 77.1
Apparel 77.1
Person 58.5

Clarifai
created on 2023-10-26

people 100
group 99.9
adult 99.4
leader 98.2
man 97.9
many 96
child 95.6
several 95.4
uniform 95.4
group together 95.1
veil 95.1
wear 94.6
portrait 94.2
military 92.7
print 92.2
administration 91.9
five 90.8
woman 90.7
military uniform 89.9
monarch 89.2

Imagga
created on 2022-01-23

religion 28.7
statue 24
kin 23.6
person 23.6
old 19.5
art 19.3
culture 18.8
religious 18.7
sculpture 17.6
god 17.2
faith 16.3
man 16.1
ruler 16.1
catholic 15.3
church 14.8
dress 14.4
face 14.2
metropolitan 14.1
people 13.9
holy 13.5
traditional 13.3
vintage 13.2
black 13.2
ancient 13
history 12.5
antique 12.3
costume 12
fan 11.8
stone 11.8
portrait 11.6
spiritual 11.5
adult 11.5
prayer 10.6
monument 10.3
decoration 10.1
clothing 10.1
pray 9.7
love 9.5
historical 9.4
architecture 9.4
male 9.2
historic 9.2
fashion 9
retro 9
follower 8.8
bride 8.6
outdoor 8.4
detail 8
family 8
mother 7.9
couple 7.8
bible 7.8
scene 7.8
belief 7.8
worship 7.7
saint 7.7
two 7.6
tourism 7.4
mask 7.4
tradition 7.4
performer 7.3
peace 7.3
lady 7.3
color 7.2
holiday 7.2
to 7.1
travel 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

text 98.3
clothing 97.1
person 96.5
old 96
man 84.3
player 77.4
black 69.5
group 68.4
white 66.1
people 61.9
posing 55.7
sketch 51.8
vintage clothing 50.7
vintage 36

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-33
Gender Female, 95.5%
Confused 62.6%
Sad 20.4%
Calm 14.8%
Angry 0.9%
Surprised 0.6%
Disgusted 0.4%
Fear 0.3%
Happy 0.2%

AWS Rekognition

Age 18-26
Gender Female, 96%
Angry 85%
Calm 8.2%
Confused 3.6%
Sad 1.6%
Surprised 0.7%
Disgusted 0.4%
Fear 0.4%
Happy 0.2%

AWS Rekognition

Age 45-53
Gender Male, 100%
Calm 86.6%
Sad 6.9%
Confused 3.5%
Angry 0.9%
Fear 0.7%
Disgusted 0.5%
Happy 0.5%
Surprised 0.4%

AWS Rekognition

Age 18-26
Gender Female, 91.9%
Sad 54.8%
Calm 41.7%
Confused 2.6%
Disgusted 0.2%
Angry 0.2%
Surprised 0.2%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 22-30
Gender Male, 99.2%
Calm 63.6%
Sad 26.7%
Angry 3.4%
Confused 3.2%
Fear 1.3%
Surprised 1%
Disgusted 0.7%
Happy 0.2%

AWS Rekognition

Age 6-14
Gender Male, 91.1%
Calm 92.4%
Sad 3.9%
Angry 1.5%
Surprised 0.8%
Disgusted 0.5%
Fear 0.4%
Confused 0.3%
Happy 0.1%

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 49
Gender Male

Microsoft Cognitive Services

Age 8
Gender Female

Microsoft Cognitive Services

Age 18
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%
Painting 80.4%
Helmet 77.1%

Categories