Human Generated Data

Title

Untitled (sailor seated reading French newspaper)

Date

c. 1905-1915, printed later

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6027

Human Generated Data

Title

Untitled (sailor seated reading French newspaper)

People

Artist: Durette Studio, American 20th century

Date

c. 1905-1915, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 99.7
Sailor Suit 99.7
Person 99
Person 98.7
Accessory 89.5
Accessories 89.5
Sunglasses 89.5
Apparel 84.4
Hat 84.4
Clothing 84.4
Text 67
Face 63.4
Portrait 63.4
Photography 63.4
Photo 63.4
Sleeve 61.2
Finger 57.6

Clarifai
created on 2019-11-16

people 99.7
man 97.3
adult 97
portrait 96.3
two 94.3
group 92.9
outfit 92.5
retro 92.5
woman 90.9
wear 90.8
one 90.4
lid 85.5
paper 84.8
three 84.6
monochrome 84
nostalgia 83.8
music 78
uniform 77.6
business 77.1
musician 76.8

Imagga
created on 2019-11-16

bow tie 45.5
person 38
man 37.7
necktie 35.9
adult 34.3
male 32.6
suit 30.8
black 29.6
people 29
hat 28.7
portrait 27.8
attractive 27.3
clothing 22.6
smile 21.4
face 20.6
garment 19.9
model 18.7
business 18.2
sexy 17.7
businessman 17.7
happy 17.6
couple 17.4
businesswoman 17.3
fashion 16.6
professional 16.2
pretty 16.1
handsome 16.1
smiling 15.9
adolescent 15.9
studio 15.2
lady 14.6
elegant 14.6
expression 14.5
formal 14.3
men 13.7
women 13.4
love 13.4
style 13.4
lifestyle 13
juvenile 12.7
holding 12.4
manager 12.1
looking 12
two 11.9
hand 11.4
tie 11.4
human 11.3
corporate 11.2
confident 10.9
executive 10.3
glasses 10.2
jacket 10
posing 9.8
success 9.7
office 9.6
standing 9.6
smart 9.4
performer 9.3
costume 9.3
elegance 9.2
cap 9.2
20s 9.2
headdress 9
cheerful 8.9
hair 8.7
businesspeople 8.5
youth 8.5
modern 8.4
communication 8.4
entertainment 8.3
scholar 8.3
friendly 8.2
pose 8.2
game 8
job 8
together 7.9
look 7.9
work 7.9
partners 7.8
employee 7.6
meeting 7.5
one 7.5
occupation 7.3
successful 7.3
group 7.3
gorgeous 7.3
dress 7.2
cute 7.2
romantic 7.1
guy 7.1
happiness 7.1
groom 7

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

human face 98.4
person 97.4
text 97.4
clothing 97.2
man 90.7
hat 88.2
fashion accessory 87.7
smile 74.9
gallery 59.8
black and white 53.2
fedora 52.3
picture frame 7.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 42-60
Gender Female, 98.3%
Confused 0.1%
Calm 99.1%
Sad 0.1%
Surprised 0.1%
Happy 0.1%
Disgusted 0.2%
Fear 0%
Angry 0.2%

AWS Rekognition

Age 28-44
Gender Male, 97%
Happy 0.1%
Angry 0.2%
Disgusted 0.2%
Sad 0.4%
Surprised 0.1%
Calm 98.8%
Fear 0%
Confused 0.1%

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 53
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Sunglasses 89.5%
Hat 84.4%

Captions

Microsoft

a group of people standing in front of a window 71.8%
a group of people posing for a photo 71.7%
a group of people standing in front of a screen 71.6%