Human Generated Data

Title

Untitled (boy at piano)
Date

1956, printed later
People

Artist: Francis J. Sullivan, American 1916 - 1996
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.229

Human Generated Data

Title

Untitled (boy at piano)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

1956, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Human 99.3
Person 99.3
Leisure Activities 97.9
Musical Instrument 95.6
Grand Piano 95
Piano 94.3
Performer 93
Pianist 90.2
Musician 90.2
Upright Piano 55.7

Imagga
created on 2022-01-08

grand piano 100
piano 100
keyboard instrument 100
stringed instrument 100
percussion instrument 100
musical instrument 84.8
upright 42.3
interior 29.2
home 23.9
indoors 20.2
chair 19.9
music 19.9
window 19.2
room 19.1
modern 17.5
indoor 16.4
people 15.1
sitting 14.6
business 14.6
architecture 14
instrument 14
black 13.8
house 13.4
lamp 13.3
furniture 13.3
glass 13.2
keyboard 13.1
urban 13.1
office 12.8
man 12.8
musical 12.4
person 12.4
table 12.1
male 12.1
light 12
inside 12
design 11.2
play 11.2
style 11.1
adult 11
playing 10.9
lifestyle 10.8
wood 10.8
sound 10.3
keys 9.7
building 9.5
floor 9.3
child 9.2
city 9.1
silhouette 9.1
living room 8.8
women 8.7
apartment 8.6
classical 8.6
luxury 8.6
living 8.5
desk 8.5
relax 8.4
attractive 8.4
happy 8.1
job 8
smiling 8
hall 7.8
wall 7.7
windows 7.7
sofa 7.6
children 7.3
domestic 7.2
computer 7.2
decor 7.1

Google
created on 2022-01-08

Piano 92.5
Keyboard 92.2
Musical instrument 92
Picture frame 88.4
Organist 88.1
Table 87.5
Pianist 86.4
Style 84
Musical keyboard 83
Black-and-white 82.4
Stool 80.9
Chair 79.8
Musician 78.7
Music 78.5
Recital 76.8
Font 76.1
Monochrome photography 75.6
Electronic instrument 75.5
Couch 74.6
Monochrome 73.5

Microsoft
created on 2022-01-08

piano 99.7
text 97.7
wall 97.3
indoor 92.6
musical keyboard 89.3
furniture 79.9
chair 52.9
black and white 51.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 12-20
Gender Female, 56.2%
Calm 99.9%
Angry 0%
Sad 0%
Confused 0%
Happy 0%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 20-28
Gender Female, 98.9%
Calm 91.9%
Sad 3.7%
Confused 1.6%
Happy 1%
Angry 0.8%
Disgusted 0.5%
Surprised 0.4%
Fear 0.1%

Microsoft Cognitive Services

Age 23
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Piano 94.3%

Captions

Microsoft

an old photo of a person in a room 81.6%
a person standing in a room 76.3%
a person standing in a room 76.2%

Text analysis

Amazon

MUSIC
VERS
POND
IRTUGAL
TAPS
for
MUSIC for MILI
VERS BISTON POND
IRTUGAL t Dream
TM
MILI
t Dream
UNDY
BISTON
OF
INTERNATIONAL
THRE

Google

IvERS
E
MUSIC e MIi NDY TAPS! IvERS E POND
TAPS!
POND
MUSIC
e
MIi
NDY