Human Generated Data

Title

"Hindoo Parsee and his Wife" from a Group of Indian Ethnographic Figurines
Date

c. 1868
People
Classification

Recreational Artifacts
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of Mrs. William Hayes Fogg, 1895.583.A

Human Generated Data

Title

"Hindoo Parsee and his Wife" from a Group of Indian Ethnographic Figurines

People
Date

c. 1868

Classification

Recreational Artifacts

Machine Generated Data

Tags

Amazon
created on 2019-07-08

Apparel 100
Clothing 100
Coat 99.4
Silk 98.3
Sari 96.5
Person 95
Human 95
Person 90.8
Figurine 84.9
Overcoat 82

Clarifai
created on 2019-07-08

woman 98.4
wear 98
people 97.8
adult 97
portrait 96.3
girl 95.6
fashion 94.4
man 92.7
model 92.5
one 92.3
lid 92.2
veil 89.9
child 89.4
two 89.4
dress 87.4
winter 84.5
facial expression 81.6
son 80.7
sculpture 80.2
art 80.2

Imagga
created on 2019-07-08

monk 64.5
oriental 31.4
people 28.4
person 28.4
adult 25.4
happy 20.7
dress 19.9
man 19.5
fashion 18.8
male 18.6
smiling 17.3
smile 17.1
costume 16.8
lifestyle 16.6
walking 16.1
women 15.8
attractive 15.4
culture 15.4
portrait 14.9
holding 14.8
clothing 14.6
child 14.1
happiness 14.1
joy 13.4
pretty 13.3
cheerful 13
sexy 12.8
cute 12.2
clothes 12.2
lady 12.2
standing 12.2
shopping 11.9
model 11.7
religion 11.6
looking 11.2
holiday 10.7
walk 10.5
bag 10.4
boy 10.4
performer 10.3
traditional 10
suit 9.9
family 9.8
fun 9.7
together 9.6
couple 9.6
hair 9.5
friends 9.4
religious 9.4
youth 9.4
elegance 9.2
face 9.2
joyful 9.2
modern 9.1
human 9
bags 8.8
faith 8.6
gift 8.6
winter 8.5
outdoors 8.2
girls 8.2
snow 8
kid 8
hands 7.8
black 7.8
men 7.7
mother 7.7
two 7.6
beach 7.6
store 7.6
one 7.5
vacation 7.4
gorgeous 7.2
childhood 7.2
love 7.1
garment 7

Google
created on 2019-07-08

Figurine 94.2
Standing 85.3
Sculpture 75.5
Action figure 69.7
Art 62.5
Toy 59.7
Gesture 51.7

Microsoft
created on 2019-07-08

person 98.9
clothing 90.7
human face 77.4
coat 71.5
dancer 59.7

Face analysis

Amazon

Google

AWS Rekognition

Age 10-15
Gender Female, 99.1%
Confused 1.4%
Sad 4.8%
Angry 3.8%
Disgusted 0.1%
Surprised 1.4%
Happy 0.2%
Calm 88.3%

AWS Rekognition

Age 2-5
Gender Male, 68%
Happy 2.3%
Angry 5%
Surprised 15.7%
Disgusted 1.4%
Sad 19.5%
Confused 12.8%
Calm 43.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Coat 99.4%
Person 95%

Captions

Microsoft

a person wearing a costume 87%
a man and woman posing for a picture 81.6%
a man and a woman posing for a picture 81.5%