Human Generated Data

Title

Untitled (two photographs: studio portrait of nude child seated on steps, blurred)
Date

c. 1935, printed later
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6097

Human Generated Data

Title

Untitled (two photographs: studio portrait of nude child seated on steps, blurred)

People

Artist: Durette Studio, American 20th century

Date

c. 1935, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 99.9
Person 99.9
Person 99.8
Banister 96.3
Handrail 96.3
Vehicle 83.9
Transportation 83.9
Train Station 76.3
Terminal 76.3
Train 76.1
Clothing 70.6
Apparel 70.6
Shorts 70.6
Staircase 58.6
Floor 56.6
Railing 55.8
Subway 55.1

Clarifai
created on 2019-11-16

child 100
people 99.6
monochrome 99.3
two 98.9
boy 98
baby 97
portrait 96.7
group 95.7
son 95.7
little 95.6
street 95.2
indoors 95.1
three 94.2
family 93.4
subway system 92.5
girl 92
locomotive 90.5
sit 88.9
one 88.4
education 86.1

Imagga
created on 2019-11-16

passenger 41.3
windowsill 35.5
sill 29
man 28.9
people 24.5
happy 24.4
male 23.1
adult 22.6
sitting 22.3
structural member 21.8
child 20.1
lifestyle 18.1
happiness 18
smile 17.8
person 17.1
casual 16.9
portrait 16.8
attractive 16.8
mother 16.6
couple 16.5
swing 16.3
kin 16.1
sliding door 16.1
family 16
window 15.7
support 15.4
parent 15
together 14
smiling 13.7
indoor 13.7
office 13.7
computer 13.6
mechanical device 13.4
door 13.4
plaything 13.3
pretty 13.3
relaxing 12.7
father 12.7
businessman 12.4
lady 12.2
business 12.1
fun 12
home 12
laptop 11.8
couch 11.6
interior 11.5
modern 11.2
looking 11.2
men 11.2
love 11
daughter 10.9
leisure 10.8
cute 10.8
handsome 10.7
sofa 10.7
kid 10.6
fashion 10.6
boy 10.4
women 10.3
day 10.2
joy 10
mechanism 10
outdoor 9.9
cheerful 9.7
movable barrier 9.7
group 9.7
indoors 9.7
black 9.6
corporate 9.4
work 9.4
expression 9.4
youth 9.4
face 9.2
body 8.8
hair 8.7
glass 8.6
model 8.6
professional 8.4
relax 8.4
communication 8.4
device 8.4
dad 8.3
room 8.2
clothing 8.1
suit 8.1
activity 8.1
job 8
life 7.8
education 7.8
comfort 7.7
jeans 7.6
husband 7.6
relaxation 7.5
relaxed 7.5
outdoors 7.5
one 7.5
silhouette 7.4
rest 7.4
chair 7.3
sexy 7.2
color 7.2
childhood 7.2
building 7.1
working 7.1

Google
created on 2019-11-16

Photograph 96.9
Photographic paper 93.4
Snapshot 86.4
Picture frame 82.8
Black-and-white 82.7
Child 79.3
Photography 76.4
Room 71.4
Window 56.8
Monochrome 54.4

Microsoft
created on 2019-11-16

toddler 99.1
baby 98.5
child 97.5
boy 95.9
human face 93.1
black and white 91.5
person 86.8
window 80.1
playground 74
clothing 51.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 4-12
Gender Male, 93.1%
Fear 0%
Surprised 0%
Angry 0%
Happy 0%
Disgusted 0%
Confused 0.1%
Sad 99.7%
Calm 0.1%

AWS Rekognition

Age 5-15
Gender Male, 97.6%
Calm 0.1%
Surprised 0%
Happy 0%
Sad 14.8%
Confused 0%
Angry 0%
Fear 85.1%
Disgusted 0%

Microsoft Cognitive Services

Age 7
Gender Male

Microsoft Cognitive Services

Age 23
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%
Train 76.1%

Captions

Microsoft

a boy sitting in front of a window 66.7%
a boy is sitting in front of a window 63%
a boy standing in front of a window 62.9%