Human Generated Data

Title

Untitled (studio portrait of young man playing accordion)

Date

c. 1935-1940, printed later

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5966

Human Generated Data

Title

Untitled (studio portrait of young man playing accordion)

People

Artist: Durette Studio, American 20th century

Date

c. 1935-1940, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Person 98.9
Human 98.9
Musical Instrument 89.1
Accordion 86.5
Portrait 62.5
Face 62.5
Photography 62.5
Photo 62.5
Musician 56.4

Clarifai
created on 2019-11-16

people 97.8
one 96.7
man 95.8
portrait 95.3
adult 95
music 94.5
musician 91.3
retro 87.4
piano 84
monochrome 82.8
wear 80.7
art 79.4
singer 77.9
instrument 77.7
business 76.8
jazz 76.3
classic 72.1
woman 72
concert 70.6
person 68.8

Imagga
created on 2019-11-16

wind instrument 100
musical instrument 100
accordion 100
keyboard instrument 100
people 32.4
person 27.2
man 24.9
adult 24.6
attractive 21.7
business 21.3
happy 20.7
laptop 20
music 19
casual 18.6
computer 18.4
smiling 18.1
work 17.3
smile 17.1
portrait 16.8
pretty 16.8
instrument 16.8
male 16.3
professional 16
expression 15.4
happiness 14.9
technology 14.8
cheerful 14.6
musician 14.6
playing 14.6
businesswoman 14.5
student 14.5
lifestyle 14.5
working 14.1
women 13.4
musical 13.4
holding 13.2
education 13
lady 13
cute 12.9
looking 12.8
face 12.8
sexy 12
corporate 12
sitting 12
executive 12
teenager 11.9
businessman 11.5
hand 11.4
human 11.2
office 11.2
play 11.2
hair 11.1
teen 11
handsome 10.7
guitar 10.7
modern 10.5
group 10.5
success 10.5
notebook 10.3
study 10.3
youth 10.2
black 10.2
20s 10.1
band 9.7
one 9.7
together 9.6
successful 9.1
studio 9.1
confident 9.1
fashion 9
guitarist 8.9
job 8.8
men 8.6
sound 8.4
electric 8.4
child 8.3
worker 8
kid 8
paper 7.8
boy 7.8
standing 7.8
rock 7.8
performer 7.8
culture 7.7
performance 7.7
serious 7.6
reading 7.6
businesspeople 7.6
communication 7.6
hot 7.5
joy 7.5
keyboard 7.5
fun 7.5
school 7.2
team 7.2
clothing 7.2
indoors 7

Microsoft
created on 2019-11-16

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-35
Gender Male, 55.2%
Confused 3.8%
Surprised 0.7%
Fear 0.7%
Happy 0.7%
Disgusted 1%
Angry 11.9%
Sad 20.2%
Calm 61%

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%

Captions

Microsoft

a man sitting on a bench 64.2%
a man sitting on a bench next to a window 45.1%
a man sitting on a bench in front of a window 45%

Text analysis

Amazon

EITW
ELVMIVIE EITW
ELVMIVIE
n1141111

Google

MILBIE
veLV MILBIE LITH
veLV
LITH