Human Generated Data

Title

Untitled (monkey inside house)
Date

c. 1950
People

Artist: Jack Gould, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16082

Human Generated Data

Title

Untitled (monkey inside house)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-25

Musical Instrument 100
Piano 100
Leisure Activities 100
Grand Piano 97.5
Person 92.6
Human 92.6
Person 91.4
Person 81.5
Musician 77.8
Performer 76.1
Pianist 66.6

Imagga
created on 2022-03-25

upright 100
piano 100
keyboard instrument 94.6
stringed instrument 83.3
percussion instrument 81.9
musical instrument 79
music 31.6
keyboard 31.1
instrument 27.3
musical 23
play 21.5
keys 21.4
playing 21
sound 18.7
home 18.3
black 17.4
key 16.8
grand piano 16.3
electric organ 15.1
people 15.1
child 14.2
interior 14.1
musician 13.6
classical 13.4
room 12.9
electronic instrument 12.6
indoors 12.3
learn 12.3
education 12.1
light 12
performance 11.5
sitting 11.2
song 10.7
lesson 10.7
old 10.4
office 10.4
art 10.4
wind instrument 10.3
person 10.3
house 10
furniture 10
chord 9.9
modern 9.8
adult 9.7
books 9.7
device 9.6
organ 9.4
learning 9.4
note 9.2
pianist 8.9
ivory 8.9
bedroom 8.9
equipment 8.8
practice 8.7
happiness 8.6
portrait 8.4
hand 8.4
classic 8.3
shelf 8.1
happy 8.1
ebony 7.9
work 7.8
melody 7.8
concert 7.8
lamp 7.6
player 7.5
human 7.5
close 7.4
style 7.4
closeup 7.4
retro 7.4
entertainment 7.4
brown 7.4
student 7.2
domestic 7.2
lifestyle 7.2
kid 7.1
male 7.1

Google
created on 2022-03-25

Musical instrument 94
Piano 92.7
White 92.2
Keyboard 91.9
Black 89.9
Musician 84
Pianist 83.9
Electronic musical instrument 82.4
Musical instrument accessory 78.2
Musical keyboard 76.6
Electronic instrument 75.9
Keyboard player 71.9
Comfort 71.7
Monochrome photography 71.5
Monochrome 69.3
Music 67.9
Machine 66.9
Room 66
Stock photography 64.3
Sitting 62.3

Microsoft
created on 2022-03-25

text 99.2
music 95.4
indoor 94.1
black and white 90.1
piano 89.3
person 89.3
musical keyboard 88.7
musical instrument 71.2
clavier 26.5
electric organ 7.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 29-39
Gender Male, 99.9%
Calm 93.9%
Happy 2.8%
Angry 1.1%
Confused 0.8%
Disgusted 0.5%
Sad 0.4%
Surprised 0.3%
Fear 0.2%

Microsoft Cognitive Services

Age 37
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Piano 100%
Person 92.6%

Captions

Microsoft

a person standing in front of a piano 88.2%
a person sitting in front of a piano 76.4%
a person standing in front of a piano keyboard 76.3%

Text analysis

Amazon

8
KODAK
SAFETY
KODAK SAFETY FILM
FILM
SAF
F

Google

KODAK
00
S'AFETY
00 8. KODAK S'AFETY FILM KODAK S'AF
FILM
S'AF
8.