Human Generated Data

Title

Untitled (Rajputs)
Date

1862-1863
People

Artist: Charles Shepherd and Arthur Robertson, British, English in partnership c. 1862-1863
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. R. Minturn Sedgwick in memory of R. Minturn Sedgwick, Class of 1921, P1981.58

Human Generated Data

Title

Untitled (Rajputs)

People

Artist: Charles Shepherd and Arthur Robertson, British, English in partnership c. 1862-1863

Date

1862-1863

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. R. Minturn Sedgwick in memory of R. Minturn Sedgwick, Class of 1921, P1981.58

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.6
Human 99.6
Person 98.9
Person 98.9
Art 90.6
Painting 90.6
Armor 74.9
Person 69.3
People 64.6
Person 60.5
Clothing 57.6
Apparel 57.6

Clarifai
created on 2023-10-27

people 100
adult 99.3
group 99
child 98.1
man 97.8
group together 97.1
woman 94.9
boy 93.3
five 89.5
soldier 87.2
three 87.2
wear 86.4
four 85.9
two 85.5
son 84.2
war 83.5
leader 82.9
street 82.5
several 82.2
military 81.9

Imagga
created on 2022-01-23

kin 46.3
old 21.6
musical instrument 19.6
man 18.8
person 18.6
people 17.3
male 14.9
adult 13.7
religion 12.5
stringed instrument 11.7
statue 11.4
culture 11.1
portrait 11
percussion instrument 10.8
family 10.7
art 10.4
ancient 10.4
home 10.4
architecture 10.1
vintage 9.9
sculpture 9.7
historical 9.4
senior 9.4
historic 9.2
fashion 9
device 9
warrior 8.8
couple 8.7
women 8.7
war 8.7
happiness 8.6
elderly 8.6
sitting 8.6
men 8.6
wall 8.5
religious 8.4
hand 8.3
tradition 8.3
traditional 8.3
weapon 8.2
mother 8.1
happy 8.1
aged 8.1
dirty 8.1
history 8
building 8
holiday 7.9
black 7.8
military 7.7
retirement 7.7
room 7.5
dark 7.5
pensioner 7.5
city 7.5
monument 7.5
work 7.3
clothing 7.2
dress 7.2
lifestyle 7.2
travel 7
indoors 7

Google
created on 2022-01-23

Hat 82.7
Musical instrument 78.4
Vintage clothing 78.1
Tints and shades 74.2
Picture frame 71.6
Door 68.7
Room 67.3
Art 66.5
Classic 65.3
History 63.2
Sitting 61.4
Visual arts 56.7
Suit 56.6
Sun hat 56.5
Retro style 53

Microsoft
created on 2022-01-23

building 99.4
outdoor 97.8
clothing 97.4
old 95.6
man 90.7
person 85.8
text 76.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 31-41
Gender Male, 99.8%
Happy 86.7%
Calm 4.9%
Surprised 2.1%
Confused 1.5%
Disgusted 1.3%
Sad 1.2%
Fear 1.1%
Angry 1.1%

AWS Rekognition

Age 27-37
Gender Male, 99.7%
Calm 99.8%
Sad 0.1%
Confused 0.1%
Angry 0%
Surprised 0%
Fear 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 29-39
Gender Male, 97.9%
Sad 61%
Calm 26.5%
Confused 9.2%
Happy 0.9%
Angry 0.7%
Disgusted 0.6%
Fear 0.6%
Surprised 0.5%

AWS Rekognition

Age 24-34
Gender Male, 91.8%
Calm 87%
Angry 3.7%
Fear 3.6%
Surprised 3.4%
Confused 0.8%
Disgusted 0.8%
Sad 0.5%
Happy 0.1%

Microsoft Cognitive Services

Age 53
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Painting 90.6%

Categories

Imagga

people portraits 96.9%
events parties 2.4%