Human Generated Data

Title

"Hindoo Parsee and His Wife"

Date

19th century

People
Classification

Recreational Artifacts

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of Mrs. William Hayes Fogg, 1895.584.A-B

Human Generated Data

Title

"Hindoo Parsee and His Wife"

People
Date

19th century

Classification

Recreational Artifacts

Machine Generated Data

Tags

Amazon
created on 2019-07-08

Apparel 99.3
Clothing 99.3
Overcoat 96.8
Human 95.6
Person 95.6
Figurine 95.3
Person 89.6
Costume 73
Helmet 63.2
Coat 55.7

Clarifai
created on 2019-07-08

wear 98.6
woman 97.9
people 97.4
adult 96.6
portrait 94.7
fashion 94.5
one 94
veil 93.9
man 93.6
two 92.7
child 91.5
jewelry 87.8
lid 87.4
girl 85.4
dress 82.9
winter 82.5
sculpture 82.2
facial expression 82.1
art 81.9
retro 81

Imagga
created on 2019-07-08

clothing 24
adult 22.9
people 22.9
person 22.8
oriental 22.5
culture 21.4
fashion 20.3
ruler 19.6
costume 19.2
dress 19
attractive 18.2
happy 18.2
religion 17.9
traditional 17.4
smile 16.4
portrait 16.2
man 15.4
lady 15.4
pretty 15.4
smiling 15.2
cute 15.1
women 15
standing 14.8
garment 14.5
face 14.2
happiness 14.1
shopping 13.8
clothes 13.1
male 12.9
fur coat 12.3
coat 11.8
model 11.7
lifestyle 11.6
temple 11.4
walking 11.4
style 11.1
holding 10.7
together 10.5
ethnic 10.5
old 10.4
sexy 10.4
religious 10.3
hat 10.1
colorful 10
hand 9.9
gold 9.9
bags 9.7
bag 9.6
looking 9.6
mother 9.6
couple 9.6
gift 9.5
joy 9.2
joyful 9.2
performer 9.2
studio 9.1
human 9
fun 9
scarf 9
hair 8.7
boy 8.7
sculpture 8.7
holiday 8.6
friends 8.4
modern 8.4
child 8.2
cheerful 8.1
group 8.1
family 8
dancer 7.9
spiritual 7.7
expression 7.7
youth 7.7
god 7.6
statue 7.6
casual 7.6
laughing 7.6
art 7.5
church 7.4
present 7.3
gorgeous 7.2
white 7.2
history 7.2
travel 7
outfit 7

Google
created on 2019-07-08

Figurine 96.2
Standing 79.6
Sculpture 76.4
Beige 66.6
Miniature 65.5
Art 62.5
Action figure 59.6
Toy 55.8
Statue 54.1

Microsoft
created on 2019-07-08

clothing 88.6
person 87.7
toy 53.3
doll 44.2

Face analysis

Amazon

Google

AWS Rekognition

Age 17-27
Gender Female, 54.8%
Confused 46%
Happy 45.5%
Calm 49.4%
Disgusted 45.3%
Surprised 45.7%
Angry 46.4%
Sad 46.7%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Sad 25.7%
Angry 8.1%
Calm 33.9%
Disgusted 1.2%
Surprised 15.2%
Happy 9.2%
Confused 6.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 95.6%
Helmet 63.2%
Coat 55.7%

Captions

Microsoft

a group of people in costumes 81.4%
a person holding a doll 60.4%
a group of people posing for the camera 60.3%