Human Generated Data

Title

Marita Hinds with Daughters, Tesuque, NM

Date

2002

People

Artist: Andrea Modica, American born 1961

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Sidney and Shirley Singer, 2013.178.2

Copyright

© Andrea Modica

Human Generated Data

Title

Marita Hinds with Daughters, Tesuque, NM

People

Artist: Andrea Modica, American born 1961

Date

2002

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Human 99.2
Person 99.2
Face 98.9
Person 98.5
Female 98.3
Person 98
Blonde 96.3
Girl 96.3
Kid 96.3
Woman 96.3
Teen 96.3
Child 96.3
Hair 76.2
Advertisement 74.7
Poster 74.7
Smile 74.4
Photography 73.1
Portrait 73.1
Photo 73.1
Collage 73.1
People 72.6
Sitting 71.6
Cushion 70.4
Head 69.6
Clothing 68.2
Apparel 68.2
Text 64.8
Pillow 61.9
Word 59
Painting 58.4
Art 58.4
Baby 56.2
Newborn 55.1

Clarifai
created on 2018-02-09

people 98.9
portrait 98.7
love 97.2
woman 97.2
girl 97.1
monochrome 96.4
two 96.1
couple 95.4
family 93.8
man 93.4
adult 93.1
child 91.7
affection 87.7
three 84.7
ma 84.6
son 84.1
smile 83.7
beautiful 83.7
young 78.4
black and white 76.6

Imagga
created on 2018-02-09

necktie 59.5
people 32.4
garment 29.6
happy 29.5
adult 29.2
smiling 27.5
person 25
man 23.5
home 23.1
attractive 22.4
sitting 22.3
computer 21.7
smile 21.4
laptop 21.1
portrait 20.7
male 20
couple 19.2
happiness 18.8
mother 18.5
business 18.2
casual 17.8
sibling 17.3
table 16.5
work 16.5
parent 16.5
clothing 16.5
two 16.1
office 16.1
family 16
lifestyle 15.9
women 15.8
together 15.8
face 15.6
sofa 15.3
looking 15.2
pretty 14.7
indoor 14.6
businesswoman 14.6
buddy 14.5
love 14.2
indoors 14.1
child 14
room 13.8
cute 13.6
fun 13.5
working 13.3
brother 13.2
brunette 13.1
daughter 12.9
girls 12.8
professional 12.7
cheerful 12.2
relationship 12.2
education 12.1
expression 12
couch 11.6
job 11.5
businesspeople 11.4
desk 11.3
student 11.3
one 11.2
school 10.8
handsome 10.7
corporate 10.3
hair 10.3
youth 10.2
glasses 10.2
teen 10.1
holding 9.9
lady 9.7
interior 9.7
group 9.7
friends 9.4
learning 9.4
notebook 9.4
executive 9.2
house 9.2
teenager 9.1
modern 9.1
confident 9.1
father 9
businessman 8.8
eyes 8.6
college 8.5
learn 8.5
book 8.4
manager 8.4
emotion 8.3
success 8.1
sexy 8
black 8
kid 8
bright 7.9
living room 7.8
living 7.6
females 7.6
communication 7.6
joy 7.5
senior 7.5
human 7.5
technology 7.4
dad 7.3
suit 7.2

Google
created on 2018-02-09

Microsoft
created on 2018-02-09

wall 99.4
person 98.3
sitting 96.8
woman 93.1
indoor 88.2
posing 78.6
picture frame 15.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-59
Gender Female, 100%
Disgusted 3.1%
Happy 1.9%
Surprised 0.6%
Sad 8.6%
Calm 82.6%
Angry 0.9%
Confused 2.2%

AWS Rekognition

Age 26-43
Gender Female, 90.1%
Happy 1.1%
Disgusted 1%
Calm 7.2%
Surprised 1.1%
Angry 3.7%
Sad 78%
Confused 8%

AWS Rekognition

Age 11-18
Gender Male, 79.4%
Disgusted 3.1%
Confused 6.5%
Happy 2.4%
Angry 6.3%
Calm 30.5%
Surprised 1.7%
Sad 49.5%

Microsoft Cognitive Services

Age 42
Gender Female

Microsoft Cognitive Services

Age 14
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Painting 58.4%

Captions

Microsoft

a man and a woman sitting on a bed posing for the camera 76.3%
a man and woman sitting on a bed posing for the camera 72.7%
a person sitting on a bed posing for the camera 72.6%