Human Generated Data

Title

Untitled (boy with violin)

Date

1890s

People

Artist: I. A. Collins, American 19th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2166

Human Generated Data

Title

Untitled (boy with violin)

People

Artist: I. A. Collins, American 19th century

Date

1890s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 98.4
Human 98.4
Leisure Activities 96.2
Viola 93.3
Fiddle 93.3
Musical Instrument 93.3
Sport 69.7
Sports 69.7
Skateboard 69.7
Cello 62.8
Apparel 60
Clothing 60
Violin 52.6

Imagga
created on 2021-12-14

bowed stringed instrument 100
violin 100
stringed instrument 90.5
musical instrument 62.2
weapon 32.6
instrument 24.7
man 22.2
sport 20.6
person 18.9
playing 18.2
adult 18.1
people 17.8
male 16.3
bow and arrow 16.1
portrait 15.5
music 15.3
fun 15
sword 14.4
studio 13.7
leisure 13.3
black 13.2
play 12.9
happy 12.5
war 12.5
player 12.2
cello 12.2
one 11.9
warrior 11.7
outdoor 10.7
pretty 10.5
outdoors 10.4
women 10.3
danger 10
holding 9.9
swing 9.9
attractive 9.8
old 9.7
musician 9.7
looking 9.6
smiling 9.4
child 9.2
protection 9.1
dress 9
clothing 9
bow 8.9
sexy 8.8
fight 8.7
musical 8.6
golf 8.6
model 8.6
hand 8.4
gun 8.2
lady 8.1
active 8.1
game 8
hair 7.9
soldier 7.8
fighting 7.8
military 7.7
youth 7.7
hobby 7.6
club 7.5
fashion 7.5
equipment 7.3
make 7.3
body 7.2
recreation 7.2
helmet 7.1
posing 7.1
face 7.1

Microsoft
created on 2021-12-14

text 99.8
person 96.4
clothing 95.9
boy 85.5
child 52.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 10-20
Gender Male, 95.6%
Calm 93.8%
Sad 5%
Happy 0.4%
Confused 0.4%
Angry 0.2%
Surprised 0.1%
Disgusted 0.1%
Fear 0%

Microsoft Cognitive Services

Age 28
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%
Skateboard 69.7%
Violin 52.6%

Captions

Microsoft

a boy holding a baseball bat 25.2%

Text analysis

Amazon

PORTRAITS
HANSON
ST.
ROCHESTER, HANSON ST. N.H
N.H
ROCHESTER,
LA.COLLINS

Google

PORTRAITS ROCHESTER A.COMINS
A.COMINS
PORTRAITS
ROCHESTER