Human Generated Data

Title

Untitled (monkey inside house)

Date

c. 1950

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16082

Human Generated Data

Title

Untitled (monkey inside house)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-25

Imagga
created on 2022-03-25

upright 100
piano 100
keyboard instrument 94.6
stringed instrument 83.3
percussion instrument 81.9
musical instrument 79
music 31.6
keyboard 31.1
instrument 27.3
musical 23
play 21.5
keys 21.4
playing 21
sound 18.7
home 18.3
black 17.4
key 16.8
grand piano 16.3
electric organ 15.1
people 15.1
child 14.2
interior 14.1
musician 13.6
classical 13.4
room 12.9
electronic instrument 12.6
indoors 12.3
learn 12.3
education 12.1
light 12
performance 11.5
sitting 11.2
song 10.7
lesson 10.7
old 10.4
office 10.4
art 10.4
wind instrument 10.3
person 10.3
house 10
furniture 10
chord 9.9
modern 9.8
adult 9.7
books 9.7
device 9.6
organ 9.4
learning 9.4
note 9.2
pianist 8.9
ivory 8.9
bedroom 8.9
equipment 8.8
practice 8.7
happiness 8.6
portrait 8.4
hand 8.4
classic 8.3
shelf 8.1
happy 8.1
ebony 7.9
work 7.8
melody 7.8
concert 7.8
lamp 7.6
player 7.5
human 7.5
close 7.4
style 7.4
closeup 7.4
retro 7.4
entertainment 7.4
brown 7.4
student 7.2
domestic 7.2
lifestyle 7.2
kid 7.1
male 7.1

Microsoft
created on 2022-03-25

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 29-39
Gender Male, 99.9%
Calm 93.9%
Happy 2.8%
Angry 1.1%
Confused 0.8%
Disgusted 0.5%
Sad 0.4%
Surprised 0.3%
Fear 0.2%

Microsoft Cognitive Services

Age 37
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Piano 100%
Person 92.6%

Captions

Microsoft

a person standing in front of a piano 88.2%
a person sitting in front of a piano 76.4%
a person standing in front of a piano keyboard 76.3%

Text analysis

Amazon

8
KODAK
SAFETY
KODAK SAFETY FILM
FILM
SAF
F

Google

KODAK
00
S'AFETY
00 8. KODAK S'AFETY FILM KODAK S'AF
FILM
S'AF
8.