Human Generated Data

Title

Untitled (boy with bow tie standing on chair)
Date

c. 1910, printed later
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5949

Human Generated Data

Title

Untitled (boy with bow tie standing on chair)

People

Artist: Durette Studio, American 20th century

Date

c. 1910, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5949

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 98.9
Person 98.9
Sailor Suit 97.1
Face 81.2
Flooring 76.3
Portrait 63.8
Photography 63.8
Photo 63.8
Person 47.3

Clarifai
created on 2019-11-16

people 99.2
adult 96.3
one 96.3
man 94.3
woman 89.9
portrait 89.8
retro 89.4
chair 87.6
indoors 86.9
two 85.8
wear 85.3
sit 84.2
monochrome 79.4
child 78.3
leader 76
art 75.9
vintage 75.6
administration 73.7
old 71.5
seat 71

Imagga
created on 2019-11-16

fashion 30.9
sexy 27.3
portrait 25.2
person 22.7
style 22.2
adult 22
pretty 21
attractive 21
model 20.2
black 19
call 18.5
people 17.3
dress 16.3
posing 16
hair 15.8
cute 15.8
lady 15.4
wall 15.4
telephone 14
women 13.4
youth 12.8
man 12.8
wind instrument 12.7
musical instrument 12.4
vintage 12.4
urban 12.2
brunette 12.2
looking 12
one 11.9
expression 11.9
elegance 11.7
interior 11.5
smile 11.4
clothing 11.4
face 11.4
happy 11.3
human 11.2
sax 11.2
elegant 11.1
instrument 11.1
stylish 10.8
city 10.8
old 10.4
window 10.2
lifestyle 10.1
sensuality 10
make 10
device 9.8
building 9.7
indoors 9.7
standing 9.6
fashionable 9.5
blond 9.3
dark 9.2
sensual 9.1
lovely 8.9
culture 8.5
clothes 8.4
outdoor 8.4
gorgeous 8.2
music 8.1
male 8
body 8
musician 8
scale 7.9
happiness 7.8
architecture 7.8
harmonica 7.6
hairstyle 7.6
guitar 7.6
equipment 7.5
retro 7.4
electronic equipment 7.2
smiling 7.2
measuring instrument 7
life 7

Google
created on 2019-11-16

White 96.3
Black 95.4
Black-and-white 87.2
Standing 79.6
Monochrome 79.4
Chair 71.7
Monochrome photography 69.6
Art 62.5
Photography 62.4
Stock photography 59.4
Picture frame 53.4
Style 52.5

Microsoft
created on 2019-11-16

wall 99.1
text 97.1
person 86.8
clothing 78.5
black and white 74.9
painting 17.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Female, 76%
Surprised 0.2%
Angry 2.8%
Happy 0.1%
Fear 2.7%
Calm 58.3%
Disgusted 0.4%
Sad 34.8%
Confused 0.7%

AWS Rekognition

Age 12-22
Gender Female, 54.9%
Confused 45.4%
Calm 49.7%
Sad 45.3%
Surprised 45.2%
Happy 47.6%
Disgusted 45.9%
Fear 45.2%
Angry 45.7%

AWS Rekognition

Age 17-29
Gender Female, 51.8%
Angry 45%
Happy 45%
Disgusted 45%
Surprised 52%
Fear 47.9%
Sad 45%
Confused 45%
Calm 45%

Microsoft Cognitive Services

Age 4
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%

Categories

Imagga

streetview architecture 58.5%
paintings art 37.1%
events parties 1.7%
interior objects 1.1%

Captions

Microsoft
created on 2019-11-16

a painting hanging on a wall 69.6%
a painting of a book 38.9%
a painting on the wall 38.8%