Human Generated Data

Title

Untitled (boy with violin)
Date

1890s
People

Artist: I. A. Collins, American 19th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2166

Human Generated Data

Title

Untitled (boy with violin)

People

Artist: I. A. Collins, American 19th century

Date

1890s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2166

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 98.4
Human 98.4
Leisure Activities 96.2
Viola 93.3
Fiddle 93.3
Musical Instrument 93.3
Skateboard 69.7
Sport 69.7
Sports 69.7
Cello 62.8
Clothing 60
Apparel 60
Violin 52.6

Clarifai
created on 2023-10-15

people 99.8
portrait 99
art 97.8
music 97.7
wear 97
child 96.7
violin 96.6
vintage 96.3
adult 95.1
one 95.1
sepia pigment 94.7
two 94.5
retro 93.7
son 93.2
lid 93
sepia 92.9
musician 92.2
nostalgia 91.9
man 89.9
veil 89.7

Imagga
created on 2021-12-14

violin 100
bowed stringed instrument 100
stringed instrument 90.5
musical instrument 62.2
weapon 32.6
instrument 24.7
man 22.2
sport 20.6
person 18.9
playing 18.2
adult 18.1
people 17.8
male 16.3
bow and arrow 16.1
portrait 15.5
music 15.3
fun 15
sword 14.4
studio 13.7
leisure 13.3
black 13.2
play 12.9
happy 12.5
war 12.5
player 12.2
cello 12.2
one 11.9
warrior 11.7
outdoor 10.7
pretty 10.5
outdoors 10.4
women 10.3
danger 10
holding 9.9
swing 9.9
attractive 9.8
old 9.7
musician 9.7
looking 9.6
smiling 9.4
child 9.2
protection 9.1
dress 9
clothing 9
bow 8.9
sexy 8.8
fight 8.7
musical 8.6
golf 8.6
model 8.6
hand 8.4
gun 8.2
lady 8.1
active 8.1
game 8
hair 7.9
soldier 7.8
fighting 7.8
military 7.7
youth 7.7
hobby 7.6
club 7.5
fashion 7.5
equipment 7.3
make 7.3
body 7.2
recreation 7.2
helmet 7.1
posing 7.1
face 7.1

Google
created on 2021-12-14

Musical instrument 92.5
Violin family 91.8
Violin 90
Violist 87.4
Viola 85.3
Classical music 84.3
Fiddle 80.2
String instrument 78.5
Poster 76.3
Suit 76.2
Vintage clothing 75.5
Bowed string instrument 72.3
Fishing rod 68.4
Violinist 68
Stock photography 66
Vintage advertisement 60.9
Art 60
Recital 59.8
Advertising 58.7
Retro style 54.8

Microsoft
created on 2021-12-14

text 99.8
person 96.4
clothing 95.9
boy 85.5
child 52.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 10-20
Gender Male, 95.6%
Calm 93.8%
Sad 5%
Happy 0.4%
Confused 0.4%
Angry 0.2%
Surprised 0.1%
Disgusted 0.1%
Fear 0%

Microsoft Cognitive Services

Age 28
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%
Skateboard 69.7%
Violin 52.6%

Categories

Imagga

people portraits 88%
events parties 6.4%
pets animals 3.8%
paintings art 1.2%

Captions

Microsoft
created on 2021-12-14

a boy holding a baseball bat 25.2%

Text analysis

Amazon

PORTRAITS
HANSON
ST.
ROCHESTER, HANSON ST. N.H
N.H
ROCHESTER,
LA.COLLINS

Google

PORTRAITS
ROCHESTER
PORTRAITS ROCHESTER A.COMINS
A.COMINS