Human Generated Data

Title

Untitled (vignetted studio portrait of girl with hair bow and hands on chin)
Date

c. 1905-1910, printed later
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5976

Human Generated Data

Title

Untitled (vignetted studio portrait of girl with hair bow and hands on chin)

People

Artist: Durette Studio, American 20th century

Date

c. 1905-1910, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Clothing 100
Hat 100
Apparel 100
Human 99.3
Person 99.3
Person 98.5
Military 84.4
Officer 84.4
Military Uniform 84.4
Face 72.1
Finger 65.4
Overcoat 65.3
Coat 65.3
Soldier 57.4
Captain 55.1

Clarifai
created on 2019-11-16

people 99.9
portrait 99.4
lid 98.2
adult 97.8
monochrome 97.8
woman 97.7
man 97.3
child 95.3
wear 92.9
movie 92.6
boy 92.3
street 91
music 90.9
two 90.8
actor 90.1
musician 87.8
outfit 86.8
veil 86.6
group 85.9
one 85.8

Imagga
created on 2019-11-16

world 36.7
adult 31.7
person 30.1
sexy 28.9
body 28.8
model 28.8
black 27.9
portrait 27.8
people 26.8
man 26.2
attractive 24.5
face 24.2
male 23.6
one 21.7
hat 20.9
dark 20
bow tie 18.8
hair 18.2
skin 17.8
fashion 17.3
human 17.3
posing 16.9
sensuality 16.4
muscular 16.2
pretty 16.1
cowboy hat 15.6
naked 15.4
clothing 15.2
necktie 14.9
elevator 14.4
love 14.2
fitness 13.6
erotic 13.4
macho 12.8
torso 12.7
style 12.6
lifestyle 12.3
brunette 12.2
lady 12.2
looking 12
healthy 12
women 11.9
sensual 11.8
nude 11.6
lifting device 11.6
cute 11.5
hand 11.4
headdress 11.3
expression 11.1
studio 10.6
device 10.6
muscle 10.6
couple 10.5
passion 10.3
happy 10
guy 9.9
sexual 9.6
men 9.4
strong 9.4
slim 9.2
fit 9.2
health 9
athlete 8.7
athletic 8.6
smile 8.6
strength 8.4
training 8.3
garment 8.3
back 8.3
makeup 8.2
handsome 8
happiness 7.8
girlfriend 7.7
desire 7.7
youth 7.7
sport 7.5
relationship 7.5
lips 7.4
retro 7.4
water 7.3
girls 7.3
romantic 7.1
child 7

Google
created on 2019-11-16

Photograph 97.1
Black 94.5
Black-and-white 91.8
Snapshot 86.4
Monochrome photography 82
Photography 78.8
Photographic paper 78
Monochrome 74.2
Stock photography 66.6
Room 65.7
Portrait 65.1
Picture frame 61.8
Art 58.1
Style 53.5
Hat 52.2

Microsoft
created on 2019-11-16

hat 99.1
human face 98.7
fashion accessory 97.2
wall 95.9
person 95.8
fedora 95.7
clothing 95.4
text 92.1
standing 84.4
cowboy hat 83.9
man 72.2
portrait 70.7
black 68.2
sun hat 66.8
old 60.6
black and white 59.8
image 46.4
posing 38.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 17-29
Gender Female, 55.2%
Sad 0.4%
Disgusted 0%
Surprised 0.2%
Happy 0%
Angry 0.1%
Fear 0%
Confused 0.1%
Calm 99.2%

AWS Rekognition

Age 12-22
Gender Female, 96.6%
Confused 3.1%
Angry 0.9%
Surprised 2.1%
Calm 60.6%
Disgusted 2.1%
Fear 0.3%
Sad 1.4%
Happy 29.4%

Microsoft Cognitive Services

Age 15
Gender Female

Microsoft Cognitive Services

Age 25
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Hat 100%
Person 99.3%

Captions

Microsoft

a man standing in front of a mirror posing for the camera 84.1%
a man that is standing in front of a mirror posing for the camera 77.5%
a man standing in front of a mirror posing for the camera 77.4%