Human Generated Data

Title

Untitled (studio portrait of young boy with armband holding bible and rosary)
Date

c. 1905-1915, printed later
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6018

Human Generated Data

Title

Untitled (studio portrait of young boy with armband holding bible and rosary)

People

Artist: Durette Studio, American 20th century

Date

c. 1905-1915, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Person 99.3
Human 99.3
Person 97.8
Tripod 94.9
Clothing 94.2
Apparel 94.2
Suit 90
Overcoat 90
Shoe 83
Footwear 83
Coat 73.1
Photography 68.9
Photo 68.9
Sitting 65.2
Musical Instrument 63.9
Musician 63.9
Face 61
Portrait 61
Stage 59.8
Leisure Activities 59.1
Studio 56

Clarifai
created on 2019-11-16

people 100
music 98.8
musician 98.4
group 98.4
man 98.1
adult 96.8
room 96.3
wear 96.3
singer 95.7
outfit 95
actor 93.7
two 93.5
stage 93.3
furniture 93
three 92
theater 91.7
guitar 91.6
group together 91.4
woman 91
stringed instrument 87.8

Imagga
created on 2019-11-16

musical instrument 60.8
wind instrument 42
man 28.2
sax 28.2
male 24.1
people 24
accordion 23.1
keyboard instrument 20.2
percussion instrument 19.6
adult 18.9
business 18.8
harmonica 18.5
businessman 16.8
person 16.1
free-reed instrument 15.1
steel drum 15
men 14.6
device 14.4
outfit 14.2
fashion 13.6
suit 13.5
black 13.2
group 12.9
office 12.8
women 12.6
urban 12.2
brass 11.8
city 11.6
silhouette 10.8
holding 10.7
window 10.1
music 9.9
attractive 9.8
portrait 9.7
chair 9.7
style 9.6
standing 9.6
corporate 9.4
model 9.3
executive 9.2
modern 9.1
job 8.8
interior 8.8
musician 8.8
working 8.8
lifestyle 8.7
work 8.6
bag 8.5
singer 8.5
washboard 8.4
street 8.3
room 8.3
laptop 8.2
trombone 8.1
professional 8
concert 7.8
electronic instrument 7.8
pretty 7.7
studio 7.6
guitar 7.6
happy 7.5
clothing 7.5
back 7.3
shopping 7.3
indoor 7.3
worker 7.3
protection 7.3
danger 7.3
computer 7.2
looking 7.2
team 7.2
hair 7.1
oboe 7

Google
created on 2019-11-16

Black-and-white 80.7
Photography 67.8
Art 65.5
Visual arts 59.3
Gentleman 57.3
Monochrome 54.4
Style 51

Microsoft
created on 2019-11-16

clothing 97.4
text 95.3
man 94.6
standing 89.6
footwear 89.2
person 86.6
furniture 83.8
concert 82.2
old 81.6
chair 75.5
black 75.4
posing 68.2
musical instrument 67.7
piano 54.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 21-33
Gender Male, 54.7%
Sad 45%
Fear 45%
Disgusted 45%
Surprised 45.5%
Angry 45%
Calm 53.8%
Happy 45.5%
Confused 45%

AWS Rekognition

Age 9-19
Gender Male, 54.7%
Confused 45%
Surprised 45%
Sad 45%
Disgusted 45%
Calm 55%
Fear 45%
Angry 45%
Happy 45%

Microsoft Cognitive Services

Age 22
Gender Male

Microsoft Cognitive Services

Age 24
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Shoe 83%
Coat 73.1%

Captions

Microsoft

a man standing in front of a group of people posing for a photo 83.7%
a group of people posing for a photo 83.6%
a man standing in front of a group of people posing for the camera 83.5%