Human Generated Data

Title

Untitled (portrait of girl in necktie with dog on her lap)

Date

c. 1940, printed later

People

Artist: Curtis Studio, American active 1891 - 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.13190

Human Generated Data

Title

Untitled (portrait of girl in necktie with dog on her lap)

People

Artist: Curtis Studio, American active 1891 - 1935

Date

c. 1940, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Person 99.3
Human 99.3
Clothing 92.4
Apparel 92.4
Art 78
Finger 74.7
Face 69.7
Portrait 65.9
Photo 65.9
Photography 65.9
Hat 62.8
Sleeve 60
Sitting 55.9
Bonnet 55.3

Clarifai
created on 2019-11-16

people 99.9
portrait 99.2
adult 97.6
one 97.4
woman 96.3
music 96
wear 95.2
musician 90.4
man 89.1
sit 87.2
two 85.7
actor 84.8
art 84.3
child 84.1
monochrome 82
singer 81.9
actress 81.2
facial expression 79.7
leader 76.4
outfit 75.2

Imagga
created on 2019-11-16

person 38.9
adult 31.8
portrait 28.5
people 27.9
black 25.8
model 24.9
attractive 23.8
fashion 23.4
sexy 23.3
face 22.7
man 21.3
lady 20.3
male 19.2
pretty 18.9
hair 18.2
human 18
love 17.4
dark 16.7
performer 15.8
brunette 14.8
lips 14.8
comedian 14.4
youth 13.6
looking 13.6
adolescent 13.5
style 13.4
posing 13.3
studio 12.9
expression 12.8
body 12.8
suit 12.8
sensuality 12.7
lifestyle 12.3
couple 12.2
skin 12
make 11.8
erotic 11.6
juvenile 11.5
entertainer 11.4
makeup 11.3
passion 11.3
business 10.9
dress 10.9
cute 10.8
holding 10.7
women 10.3
smile 10
one 9.7
desire 9.6
hands 9.6
elegant 9.4
modern 9.1
sensual 9.1
gun 9
retro 9
light 8.9
happy 8.8
look 8.8
glamor 8.6
sitting 8.6
hairstyle 8.6
hand 8.5
jacket 8.4
hot 8.4
vintage 8.3
pose 8.2
world 7.8
eyes 7.8
men 7.7
loving 7.6
art 7.4
emotion 7.4
child 7.1

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

human face 99.3
text 98.6
person 97.5
clothing 94.3
monitor 93.3
smile 92.3
portrait 78
screen 77.3
woman 76.9
black and white 73.6
electronics 70.3
picture frame 14.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 9-19
Gender Female, 99.9%
Angry 0.6%
Surprised 0.1%
Sad 0.1%
Happy 98.3%
Calm 0.4%
Fear 0.1%
Confused 0.2%
Disgusted 0.2%

Microsoft Cognitive Services

Age 10
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%

Captions

Microsoft

a person standing in front of a television 71.6%
a person standing in front of a television screen 68.5%
a person sitting in front of a television 63.7%