Human Generated Data

Title

Simla, A Group of Thugs

Date

1860s

People

Artist: Samuel Bourne and Charles Shepherd, British, English in partnership 1863-1870

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. R. Minturn Sedgwick in memory of R. Minturn Sedgwick, Class of 1921, P1981.30

Human Generated Data

Title

Simla, A Group of Thugs

People

Artist: Samuel Bourne and Charles Shepherd, British, English in partnership 1863-1870

Date

1860s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Apparel 100
Clothing 100
Human 99.5
Person 99.5
Person 99.4
Hat 99.3
Headband 99.3
Person 99
Turban 99
Person 98.4
Person 98.2
Person 97.1
Helmet 92.6
Helmet 80.3

Imagga
created on 2022-01-23

player 100
ballplayer 100
athlete 100
contestant 74.6
person 46
people 19.5
man 18.8
sport 18.4
statue 16.1
ball 14.6
male 14.2
sculpture 13.6
kin 13.5
dark 13.3
fun 12.7
history 12.5
art 11.8
adult 11.6
base 11.6
play 11.2
old 10.4
portrait 10.3
black 10.2
outdoor 9.9
equipment 9.9
religion 9.8
team 9.8
family 9.8
home plate 9.7
symbol 9.4
historical 9.4
travel 9.1
uniform 9.1
helmet 9.1
clothing 9
summer 9
game 8.9
child 8.9
stadium 8.7
death 8.7
love 8.7
football 8.6
culture 8.5
stone 8.4
monument 8.4
silhouette 8.3
human 8.2
decoration 7.9
lifestyle 7.9
architecture 7.8
kick 7.8
antique 7.8
ancient 7.8
goal 7.7
baseball equipment 7.7
field 7.5
mother 7.4
style 7.4
world 7.4
exercise 7.3
life 7.2
face 7.1

Google
created on 2022-01-23

Headgear 82.6
Adaptation 79.2
Art 78.8
Vintage clothing 76.4
Crew 72.5
Smile 70.1
Sitting 66.3
History 65.6
Visual arts 64.1
Stock photography 63.6
Event 63.4
Team 63
Illustration 62.9
Painting 61.5
Child 61.1
Landscape 58
Monochrome 56.8
Wood 55.8
Family 53.7
Room 53.4

Microsoft
created on 2022-01-23

outdoor 95.1
player 93.6
person 74.6
old 70.6
clothing 68
man 65.2
white 64.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 41-49
Gender Male, 100%
Calm 62.1%
Confused 31.7%
Sad 4%
Surprised 0.7%
Fear 0.6%
Angry 0.5%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 39-47
Gender Male, 99.6%
Calm 91.7%
Confused 5.4%
Angry 1.5%
Sad 0.6%
Fear 0.3%
Disgusted 0.3%
Surprised 0.2%
Happy 0.1%

AWS Rekognition

Age 42-50
Gender Male, 100%
Calm 99.7%
Confused 0.1%
Fear 0%
Sad 0%
Disgusted 0%
Happy 0%
Surprised 0%
Angry 0%

AWS Rekognition

Age 31-41
Gender Male, 100%
Calm 60.5%
Angry 31.2%
Confused 6.5%
Sad 0.6%
Surprised 0.4%
Disgusted 0.4%
Fear 0.2%
Happy 0.2%

AWS Rekognition

Age 41-49
Gender Male, 100%
Calm 93.4%
Sad 4.1%
Confused 1%
Angry 0.8%
Disgusted 0.3%
Surprised 0.2%
Happy 0.2%
Fear 0.1%

AWS Rekognition

Age 33-41
Gender Male, 99.9%
Calm 98.3%
Confused 0.9%
Angry 0.3%
Happy 0.2%
Surprised 0.2%
Disgusted 0.1%
Sad 0%
Fear 0%

AWS Rekognition

Age 45-51
Gender Male, 100%
Calm 99.7%
Sad 0.1%
Happy 0.1%
Surprised 0%
Angry 0%
Confused 0%
Disgusted 0%
Fear 0%

Microsoft Cognitive Services

Age 60
Gender Male

Microsoft Cognitive Services

Age 51
Gender Male

Microsoft Cognitive Services

Age 45
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Helmet 92.6%

Captions

Microsoft

a group of people sitting around a baseball field 66.7%
a group of baseball players standing on top of each other 58.3%
a group of baseball players standing on top of a building 58.2%