Human Generated Data

Title

Untitled (boy with violin and boy seated at piano)
Date

1930s
People

Artist: C. Bennette Moore, American 1879 - 1939
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12382

Human Generated Data

Title

Untitled (boy with violin and boy seated at piano)

People

Artist: C. Bennette Moore, American 1879 - 1939

Date

1930s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Human 98.7
Person 98.7
Person 98.5
Leisure Activities 97.6
Piano 94.7
Grand Piano 94.7
Musical Instrument 94.7
Clothing 61.5
Footwear 61.5
Apparel 61.5
Shoe 61.5
Upright Piano 60
Person 58.5
Violin 55.4
Viola 55.4
Fiddle 55.4

Imagga
created on 2022-01-22

violin 50.5
musical instrument 50.3
bowed stringed instrument 45.5
stringed instrument 40
man 21.5
person 20.5
wind instrument 20.2
people 19.5
male 18.4
adult 18
interior 16.8
room 15.7
black 15.6
chair 15.2
home 14.3
lifestyle 13.7
music 13.2
portrait 12.9
sexy 12.8
fashion 12.8
old 12.5
device 12.3
brass 12
sitting 11.2
men 11.2
indoors 10.5
vintage 9.9
keyboard instrument 9.7
guitar 9.6
style 9.6
urban 9.6
accordion 9.5
youth 9.4
face 9.2
modern 9.1
one 9
child 8.7
model 8.5
attractive 8.4
house 8.4
city 8.3
indoor 8.2
playing 8.2
happy 8.1
furniture 8.1
free-reed instrument 8.1
family 8
decoration 8
instrument 7.9
women 7.9
together 7.9
play 7.7
human 7.5
fun 7.5
holding 7.4
retro 7.4
smiling 7.2
equipment 7.2
art 7.2
happiness 7

Google
created on 2022-01-22

Musical instrument 87.7
Musician 86.5
Chair 83.1
Art 81.1
Door 79.4
Vintage clothing 76.1
Room 69.9
Stock photography 65.1
Music 64.6
Classic 63.1
Sitting 62.7
Drawer 62.1
Child 59.2
Retro style 57.4
Recital 56.1
Monochrome 55.9
Machine 55
Illustration 54.8
History 54.1
Stool 53.8

Microsoft
created on 2022-01-22

piano 94.7
text 91.1
musical instrument 88.2
indoor 85.3
child 83
boy 72.1
person 68.4
violin 63.2
black and white 52.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Male, 100%
Calm 97%
Sad 1%
Surprised 0.5%
Confused 0.5%
Fear 0.3%
Angry 0.3%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 6-14
Gender Female, 100%
Calm 76.7%
Sad 19.7%
Disgusted 0.8%
Confused 0.7%
Angry 0.6%
Surprised 0.6%
Fear 0.5%
Happy 0.4%

Microsoft Cognitive Services

Age 7
Gender Male

Microsoft Cognitive Services

Age 5
Gender Male

Google Vision

Surprise Possible
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Shoe 61.5%

Captions

Microsoft

a boy sitting in front of a laptop 46.8%
a group of people sitting in front of a laptop 46.7%
a young boy standing in front of a laptop 42%

Text analysis

Google

14
14