Human Generated Data

Title

Untitled (man standing under tree with hand raised to mouth)

Date

c. 1905

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3868

Human Generated Data

Title

Untitled (man standing under tree with hand raised to mouth)

People

Artist: Durette Studio, American 20th century

Date

c. 1905

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Clothing 99.5
Apparel 99.5
Person 98.7
Human 98.7
Tree 84.9
Plant 84.9
Sleeve 83.7
Long Sleeve 74.5
Coat 73.6
Face 69.9
Overcoat 64
Pants 63.5
Photography 63.3
Portrait 63.3
Photo 63.3
Finger 61.2
Outdoors 56.6
Jacket 51.8

Clarifai
created on 2019-06-01

people 99.8
monochrome 99.1
street 97.5
adult 96.9
man 96.2
portrait 96.2
woman 93.5
wedding 93.4
girl 93
black and white 92.8
child 92.8
one 92.8
two 91.5
wear 87.6
shadow 86.1
sepia 85.6
love 85.5
dark 84.9
model 82.8
couple 82.1

Imagga
created on 2019-06-01

umbrella 66.9
canopy 53.4
shelter 40.3
protective covering 28.2
person 21.2
leg 20.9
fashion 18.8
body 18.4
adult 18.1
posing 17.8
sexy 17.7
attractive 17.5
covering 17
dark 15.9
outdoors 15.7
people 15.1
active 14.4
exercise 13.6
fitness 13.6
one 13.4
model 13.2
lifestyle 13
pose 12.7
happy 12.5
man 12.1
light 12.1
motion 12
portrait 11.6
jumping 11.6
sport 11.6
jump 11.5
skin 11.2
dance 11.1
style 11.1
sand 10.9
exercising 10.6
lady 10.6
performance 10.5
dancer 10.5
fun 10.5
performer 10.4
free 10.3
beach 10.1
elegance 10.1
sensuality 10
leisure 10
silhouette 9.9
male 9.9
black 9.7
dancing 9.6
balance 9.5
stone 9.3
action 9.3
fit 9.2
outdoor 9.2
teenager 9.1
studio 9.1
pretty 9.1
human 9
sunset 9
cool 8.9
rock 8.7
grunge 8.5
casual 8.5
enjoy 8.5
slim 8.3
freedom 8.2
activity 8.1
hair 7.9
women 7.9
grass 7.9
aerobics 7.8
smile 7.8
gymnastics 7.8
travel 7.7
athlete 7.7
modern 7.7
walking 7.6
energy 7.6
relaxation 7.5
joy 7.5
park 7.4
world 7.4
vacation 7.4
clothing 7.3
night 7.1
happiness 7.1
sky 7

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

outdoor 94.6
clothing 92.7
person 88.5
standing 88.2
black and white 86.6
monochrome 73.9
human face 71.7
tree 69.1

Feature analysis

Amazon

Person 98.7%
Jacket 51.8%

Captions

Microsoft

a person that is standing in the rain holding an umbrella 44.1%
a person that is standing in the grass 44%
a person that is standing in the grass holding a black umbrella 43.9%