Human Generated Data

Title

Simla, A Group of Thugs

Date

1860s

People

Artist: Samuel Bourne and Charles Shepherd, British, English in partnership 1863-1870

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. R. Minturn Sedgwick in memory of R. Minturn Sedgwick, Class of 1921, P1981.30

Human Generated Data

Title

Simla, A Group of Thugs

People

Artist: Samuel Bourne and Charles Shepherd, British, English in partnership 1863-1870

Date

1860s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. R. Minturn Sedgwick in memory of R. Minturn Sedgwick, Class of 1921, P1981.30

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Clothing 100
Apparel 100
Human 99.5
Person 99.5
Person 99.4
Hat 99.3
Headband 99.3
Person 99
Turban 99
Person 98.4
Person 98.2
Person 97.1
Helmet 92.6
Helmet 80.3

Clarifai
created on 2023-10-26

people 99.9
group 98.5
child 98.3
veil 97.2
adult 97.1
wear 95.6
man 94.8
son 94.7
family 94.1
portrait 93.5
two 91.9
woman 91.5
lid 90.9
group together 90.4
military 89.4
sit 86.6
print 85.9
art 85.1
three 85
uniform 83.8

Imagga
created on 2022-01-23

ballplayer 100
player 100
athlete 100
contestant 74.6
person 46
people 19.5
man 18.8
sport 18.4
statue 16.1
ball 14.6
male 14.2
sculpture 13.6
kin 13.5
dark 13.3
fun 12.7
history 12.5
art 11.8
adult 11.6
base 11.6
play 11.2
old 10.4
portrait 10.3
black 10.2
outdoor 9.9
equipment 9.9
religion 9.8
team 9.8
family 9.8
home plate 9.7
symbol 9.4
historical 9.4
travel 9.1
uniform 9.1
helmet 9.1
clothing 9
summer 9
game 8.9
child 8.9
stadium 8.7
death 8.7
love 8.7
football 8.6
culture 8.5
stone 8.4
monument 8.4
silhouette 8.3
human 8.2
decoration 7.9
lifestyle 7.9
architecture 7.8
kick 7.8
antique 7.8
ancient 7.8
goal 7.7
baseball equipment 7.7
field 7.5
mother 7.4
style 7.4
world 7.4
exercise 7.3
life 7.2
face 7.1

Google
created on 2022-01-23

Headgear 82.6
Adaptation 79.2
Art 78.8
Vintage clothing 76.4
Crew 72.5
Smile 70.1
Sitting 66.3
History 65.6
Visual arts 64.1
Stock photography 63.6
Event 63.4
Team 63
Illustration 62.9
Painting 61.5
Child 61.1
Landscape 58
Monochrome 56.8
Wood 55.8
Family 53.7
Room 53.4

Microsoft
created on 2022-01-23

outdoor 95.1
player 93.6
person 74.6
old 70.6
clothing 68
man 65.2
white 64.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 41-49
Gender Male, 100%
Calm 62.1%
Confused 31.7%
Sad 4%
Surprised 0.7%
Fear 0.6%
Angry 0.5%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 39-47
Gender Male, 99.6%
Calm 91.7%
Confused 5.4%
Angry 1.5%
Sad 0.6%
Fear 0.3%
Disgusted 0.3%
Surprised 0.2%
Happy 0.1%

AWS Rekognition

Age 42-50
Gender Male, 100%
Calm 99.7%
Confused 0.1%
Fear 0%
Sad 0%
Disgusted 0%
Happy 0%
Surprised 0%
Angry 0%

AWS Rekognition

Age 31-41
Gender Male, 100%
Calm 60.5%
Angry 31.2%
Confused 6.5%
Sad 0.6%
Surprised 0.4%
Disgusted 0.4%
Fear 0.2%
Happy 0.2%

AWS Rekognition

Age 41-49
Gender Male, 100%
Calm 93.4%
Sad 4.1%
Confused 1%
Angry 0.8%
Disgusted 0.3%
Surprised 0.2%
Happy 0.2%
Fear 0.1%

AWS Rekognition

Age 33-41
Gender Male, 99.9%
Calm 98.3%
Confused 0.9%
Angry 0.3%
Happy 0.2%
Surprised 0.2%
Disgusted 0.1%
Sad 0%
Fear 0%

AWS Rekognition

Age 45-51
Gender Male, 100%
Calm 99.7%
Sad 0.1%
Happy 0.1%
Surprised 0%
Angry 0%
Confused 0%
Disgusted 0%
Fear 0%

Microsoft Cognitive Services

Age 60
Gender Male

Microsoft Cognitive Services

Age 51
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 45
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Helmet 92.6%

Categories

Imagga

paintings art 67.9%
people portraits 29.3%
pets animals 1.9%