Human Generated Data

Title

Untitled (two photographs: studio portrait of sailor looking down at French newspaper; studio portrait of sailor holding up French newspaper to read)
Date

c. 1935, printed later
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6100

Human Generated Data

Title

Untitled (two photographs: studio portrait of sailor looking down at French newspaper; studio portrait of sailor holding up French newspaper to read)

People

Artist: Durette Studio, American 20th century

Date

c. 1935, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Sailor Suit 99.9
Human 99.9
Person 99.6
Person 99.4
Finger 67.2
Apparel 58.6
Clothing 58.6
Hat 58.6

Clarifai
created on 2019-11-16

people 99.7
outfit 99.3
group together 97
lid 96.8
adult 96.8
uniform 96.5
two 96.2
wear 95.2
man 95.1
baseball 94.3
group 94.2
three 92.1
cap 90.5
veil 87.8
woman 86.9
one 86.1
monochrome 83.9
four 83.2
portrait 80
recreation 77.3

Imagga
created on 2019-11-16

hat 60.3
person 39.7
scholar 34.2
man 32.3
headdress 31
clothing 28.8
male 27.7
intellectual 27.3
suit 24.7
people 23.4
black 22.8
adult 22.7
cowboy hat 21.7
portrait 20.7
cap 20.3
business 18.2
silhouette 16.6
face 16.3
mortarboard 16.2
fashion 14.3
covering 14.1
sombrero 13.5
tie 13.3
manager 13
studio 12.9
music 12.6
consumer goods 12.6
model 12.4
boss 12.4
job 12.4
smile 12.1
sexy 12
style 11.9
play 11.2
one 11.2
attractive 11.2
men 11.2
professional 11.1
executive 11.1
occupation 11
hand 10.6
art 10.5
boy 10.4
expression 10.2
work 10.2
child 10.2
guy 9.9
cowboy 9.8
lady 9.7
businessman 9.7
player 9.6
musical 9.6
standing 9.6
costume 9.5
guitar 9.5
corporate 9.4
happy 9.4
entertainment 9.2
worker 9.1
holding 9.1
cartoon 8.9
jacket 8.9
success 8.8
instrument 8.7
love 8.7
smiling 8.7
lifestyle 8.7
helmet 8.7
elegant 8.6
construction 8.6
musician 8.5
bow tie 8.5
performer 8.4
dark 8.3
safety 8.3
teen 8.3
fun 8.2
protection 8.2
office 8
handsome 8
brass 7.9
management 7.7
engineer 7.7
pretty 7.7
two 7.6
elegance 7.6
human 7.5
wind instrument 7.4
playing 7.3
gown 7.1
building 7.1
hair 7.1
happiness 7.1
look 7

Google
created on 2019-11-16

Photograph 96.2
Black-and-white 85.4
Snapshot 83.6
Photography 70.6
Monochrome 67.6
Monochrome photography 57.8
Style 54.3
Art 50.2

Microsoft
created on 2019-11-16

text 99.3
person 92.7
clothing 92.3
hat 86.6
man 83.4
black and white 80
human face 75.4
cartoon 71.5
fashion accessory 57.9
picture frame 7.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 30-46
Gender Male, 92.5%
Happy 0.1%
Calm 99.7%
Fear 0%
Confused 0%
Angry 0%
Surprised 0%
Disgusted 0%
Sad 0.2%

AWS Rekognition

Age 22-34
Gender Male, 92%
Calm 83.2%
Angry 1.2%
Surprised 0.4%
Confused 0.4%
Disgusted 1.3%
Happy 12.3%
Sad 0.8%
Fear 0.3%

Microsoft Cognitive Services

Age 38
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Hat 58.6%

Captions

Microsoft

a group of people posing for the camera 77.4%
a group of people around each other 65.8%
a group of people standing in front of a monitor 58.9%

Text analysis

Amazon

MILLE
SUR LE RED
SUA
AVI2S MILLE alic al
atioial
LAGTiIT SUR LE RED
alic al
RE L: SUA
RE
AVI2S
LAGTiIT
L:
AVG
eTA

Google

LA1
SUR
ו
IYT3
Natioa
MLLE
MILLE
SUAR
IYT3 LA1 Natioa MLLE AVDS SUR LE REC ו MILLE AVOS SUAR
AVDS
REC
AVOS
LE