Human Generated Data

Title

Untitled (Sadhs, Hindu sect, Rajasthan)
Date

1862-1863
People

Artist: Charles Shepherd and Arthur Robertson, British, English in partnership c. 1862-1863
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. R. Minturn Sedgwick in memory of R. Minturn Sedgwick, Class of 1921, P1981.63

Human Generated Data

Title

Untitled (Sadhs, Hindu sect, Rajasthan)

People

Artist: Charles Shepherd and Arthur Robertson, British, English in partnership c. 1862-1863

Date

1862-1863

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. R. Minturn Sedgwick in memory of R. Minturn Sedgwick, Class of 1921, P1981.63

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Clothing 99.9
Apparel 99.9
Coat 99.7
Human 99.4
Person 99.4
Person 99.3
Person 99.2
Person 98.4
Building 76.7
People 75.7
Urban 75.1
Hat 67.3
Shorts 56.9

Clarifai
created on 2023-10-26

people 100
adult 99.7
group 99.4
man 97.6
two 97.4
woman 97.1
three 95.6
veil 95.2
child 94.9
wear 94.9
four 93.9
elderly 92.7
several 92
five 91.9
group together 90.9
portrait 90.2
merchant 85.6
street 84.8
military 83.8
sit 83.3

Imagga
created on 2022-01-23

old 24.4
monk 21.7
man 16.8
architecture 16.4
building 16.3
religion 16.1
statue 15.2
people 14.5
city 14.1
monument 14
kin 13.6
male 13.6
ancient 13
person 12.6
mother 12.4
sculpture 12.4
history 11.6
religious 11.2
men 11.2
room 11.1
child 10.6
travel 10.6
hairdresser 10.4
house 10
tourism 9.9
family 9.8
art 9.8
wall 9.4
stretcher 9.4
stone 9.3
church 9.2
tradition 9.2
crutch 9.1
hospital 9
home 8.8
chair 8.7
scene 8.7
god 8.6
temple 8.5
vintage 8.3
historic 8.3
window 8.2
tourist 8.2
boy 7.8
portrait 7.8
sitting 7.7
litter 7.7
holy 7.7
traditional 7.5
dirty 7.2
landmark 7.2
staff 7

Google
created on 2022-01-23

Headgear 81.3
Adaptation 79.3
Art 78.1
Hat 73.5
Vintage clothing 72.7
Tints and shades 69.7
History 67
Stock photography 64.7
Visual arts 60.7
Room 52.1

Microsoft
created on 2022-01-23

person 99.9
building 99.6
clothing 98.7
outdoor 97.4
text 88.3
old 82.5
man 77.8
group 67.6
footwear 65.9
drawing 54.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 57-65
Gender Male, 53%
Sad 59.9%
Calm 32.4%
Angry 2.7%
Confused 2.4%
Disgusted 0.9%
Surprised 0.8%
Happy 0.4%
Fear 0.4%

AWS Rekognition

Age 51-59
Gender Male, 99.8%
Sad 73.4%
Happy 20.3%
Calm 4%
Confused 1.1%
Angry 0.4%
Disgusted 0.3%
Fear 0.3%
Surprised 0.3%

AWS Rekognition

Age 34-42
Gender Male, 98.9%
Calm 78.8%
Sad 20.2%
Confused 0.5%
Angry 0.1%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%
Happy 0%

AWS Rekognition

Age 26-36
Gender Male, 76.8%
Sad 99.8%
Fear 0.1%
Calm 0%
Confused 0%
Surprised 0%
Angry 0%
Disgusted 0%
Happy 0%

Microsoft Cognitive Services

Age 67
Gender Male

Microsoft Cognitive Services

Age 68
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Coat 99.7%
Person 99.4%

Categories

Imagga

people portraits 78.3%
events parties 12.9%
interior objects 4.4%
paintings art 2.2%

Text analysis

Amazon

1108
or
Photos