Human Generated Data

Title

Bourgeois Family: Mirror Frieze

Date

2001

People

Artist: Vivan Sundaram, Indian born 1943

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kate, Maurice R. and Melvin R. Seiden Purchase Fund for Photographs, 2006.190

Copyright

© Vivan Sundaram, courtesy sepiaEYE

Human Generated Data

Title

Bourgeois Family: Mirror Frieze

People

Artist: Vivan Sundaram, Indian born 1943

Date

2001

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-06

Human 99.1
Person 99.1
Person 98.6
Person 98.5
Person 98.5
Person 98.5
Person 97.7
Apparel 97.4
Clothing 97.4
Hat 94.8
Indoors 91.8
Room 91.6
Person 86.8
People 86.1
Dress 77.6
Female 76.6
Dressing Room 73.2
Sleeve 64.3
Person 64
Girl 63
Suit 61.1
Overcoat 61.1
Coat 61.1
Hair 58.4
Face 56.2

Clarifai
created on 2018-04-19

people 100
group 99.4
adult 98.4
woman 96.5
wear 96.1
child 94.1
two 93
man 93
actress 92.4
room 92.2
music 91.2
group together 90.1
monochrome 89.1
furniture 87.1
four 87
administration 86.9
musician 85.7
several 85.5
singer 83.6
one 83.4

Imagga
created on 2018-04-19

seller 38.8
people 27.9
person 25.5
happy 23.8
adult 22.4
man 20.8
portrait 20.7
male 19.1
smiling 18.8
attractive 17.5
dress 16.3
pretty 16.1
fashion 15.1
smile 15
happiness 14.9
face 14.2
holding 14
groom 14
business 14
couple 13.9
women 13.4
bride 13.4
lifestyle 13
lady 13
clothing 12.2
hair 11.9
world 11.7
indoor 11
fun 10.5
home 10.4
gift 10.3
men 10.3
love 10.3
wedding 10.1
holiday 10
family 9.8
cheerful 9.7
indoors 9.7
brunette 9.6
standing 9.6
color 9.5
model 9.3
cute 9.3
traditional 9.1
confident 9.1
black 9
ethnic 8.6
mother 8.5
store 8.5
two 8.5
room 8.4
hand 8.4
joy 8.3
human 8.2
stall 8.2
girls 8.2
present 8.2
sexy 8
computer 8
celebration 8
work 8
working 7.9
boutique 7.8
life 7.8
ceremony 7.8
costume 7.7
sitting 7.7
old 7.7
professional 7.6
tradition 7.4
aged 7.2
looking 7.2
together 7

Google
created on 2018-04-19

Microsoft
created on 2018-04-19

person 99
standing 76.5
posing 72.2
dressed 43.2
clothes 22.7
crowd 0.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 10-15
Gender Female, 75.6%
Calm 1.6%
Disgusted 0.2%
Surprised 0.1%
Angry 0.3%
Confused 0.2%
Sad 97.3%
Happy 0.3%

AWS Rekognition

Age 15-25
Gender Female, 54.5%
Happy 45.5%
Disgusted 45.1%
Calm 46.3%
Surprised 45.2%
Angry 45.5%
Confused 45.3%
Sad 52%

AWS Rekognition

Age 26-43
Gender Female, 54.6%
Angry 45.2%
Happy 45.1%
Confused 45.3%
Sad 53.2%
Surprised 45.1%
Calm 46%
Disgusted 45.1%

AWS Rekognition

Age 23-38
Gender Female, 99.7%
Sad 10.4%
Surprised 0.4%
Calm 80.1%
Disgusted 1.4%
Confused 1.5%
Angry 2.4%
Happy 3.7%

AWS Rekognition

Age 4-9
Gender Female, 54.7%
Confused 45%
Disgusted 45%
Angry 45%
Calm 45%
Sad 55%
Happy 45%
Surprised 45%

AWS Rekognition

Age 35-55
Gender Female, 50.4%
Confused 45.5%
Calm 48.1%
Happy 45.4%
Disgusted 47.1%
Surprised 45.9%
Sad 47.2%
Angry 45.9%

Microsoft Cognitive Services

Age 12
Gender Male

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 14
Gender Male

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 22
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Hat 94.8%

Captions

Microsoft

a group of people posing for a photo 94.5%
a group of people posing for the camera 94.4%
a group of people posing for a picture 94.3%