Human Generated Data

Title

Untitled (little boy on beach with lower portion of woman in beach chair, New York)
Date

1985
People

Artist: Ken Heyman, American born 1930
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Susan and Neal Yanofsky, 2011.554
Copyright

© Ken Heyman

Human Generated Data

Title

Untitled (little boy on beach with lower portion of woman in beach chair, New York)

People

Artist: Ken Heyman, American born 1930

Date

1985

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Human 97.8
Person 97.8
Apparel 85.2
Clothing 85.2
Art 76.2
Drawing 76.2
Turtle 76.2
Reptile 76.2
Sea Life 76.2
Animal 76.2
Skin 74.4
Shorts 62.6
Portrait 60.4
Photography 60.4
Face 60.4
Photo 60.4
Sleeve 57.4
Finger 56.1
Sketch 55.6
Person 54.2

Clarifai
created on 2018-02-10

people 99.7
one 98.3
adult 98.3
woman 95.2
monochrome 92.4
man 90.9
two 89.7
wear 88.9
portrait 87.7
street 87.5
music 84.7
group 82.5
art 82
actor 81.9
girl 79.4
vehicle 78.4
musician 75.7
administration 75.6
child 73.9
reclining 73.7

Imagga
created on 2018-02-10

man 32.2
person 26.7
adult 25.9
male 23.4
people 22.9
hat 19.9
clothing 19.7
tripod 16.8
silhouette 15.7
portrait 15.5
sunset 14.4
sport 14
suit 13.7
black 13.2
outdoor 13
protection 12.7
support 12.7
outdoors 12.7
rack 12.6
model 11.7
mask 11.5
relax 10.9
sky 10.8
covering 10.4
work 10.3
attractive 9.8
human 9.7
men 9.4
happy 9.4
danger 9.1
holding 9.1
exercise 9.1
weapon 9
working 8.8
sword 8.7
lifestyle 8.7
professional 8.5
headdress 8.5
smoke 8.4
hand 8.4
one 8.2
landscape 8.2
dirty 8.1
lady 8.1
tool 8
businessman 7.9
business 7.9
device 7.9
destruction 7.8
face 7.8
toxic 7.8
travel 7.7
sitting 7.7
military 7.7
gas 7.7
industry 7.7
dusk 7.6
beach 7.6
walking 7.6
fashion 7.5
leisure 7.5
action 7.4
gun 7.4
executive 7.4
safety 7.4
alone 7.3
industrial 7.3
pose 7.2
cloak 7.2
recreation 7.2
shadow 7.2
handsome 7.1
posing 7.1
summer 7.1
day 7.1
happiness 7.1

Google
created on 2018-02-10

photograph 95.6
black and white 93.1
monochrome photography 84.9
snapshot 81.8
photography 79.9
sitting 79.5
monochrome 72.3
human behavior 67.2
visual arts 66.8
vintage clothing 60.7
stock photography 56.9
girl 54

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 9-14
Gender Male, 64.9%
Happy 19.4%
Confused 5.4%
Angry 11.7%
Surprised 3%
Disgusted 3.6%
Calm 2.9%
Sad 54%

Microsoft Cognitive Services

Age 34
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Likely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.8%
Turtle 76.2%

Captions

Microsoft

a person sitting on a bed 35.5%
an old photo of a person 35.4%
a person sitting on a beach 35.3%