Human Generated Data

Title

Catching Firefly

Date

1870s-1880s

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Sam Pratt, P2003.212

Human Generated Data

Title

Catching Firefly

People

Artist: Unidentified Artist,

Date

1870s-1880s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Sam Pratt, P2003.212

Machine Generated Data

Tags

Amazon
created on 2022-05-28

Clothing 100
Apparel 100
Fashion 98.7
Robe 98.7
Person 98.2
Human 98.2
Gown 95.2
Kimono 93.4
Painting 62.4
Art 62.4

Clarifai
created on 2023-10-30

people 99.4
kimono 98.8
art 97.9
woman 97.7
one 97.2
gown (clothing) 96.2
wear 94.6
adult 93.1
geisha 92.2
girl 91
child 88.1
portrait 87.6
retro 84
painting 83.7
dress 82.7
veil 81.5
illustration 80.4
coat 78.1
sword 77.7
vintage 77.6

Imagga
created on 2022-05-28

person 27.6
man 24.2
adult 23.2
people 21.2
musical instrument 21
male 20.6
wind instrument 18
portrait 17.5
fashion 15.8
holding 15.7
life 13.9
happy 13.8
outdoors 13.4
posing 13.3
attractive 13.3
model 13.2
smiling 13
weapon 12.7
sax 12.5
stringed instrument 12
brass 11.8
violin 11.8
outdoor 11.5
wall 11.1
happiness 11
dress 10.8
seller 10.7
bowed stringed instrument 10.7
color 10.6
lifestyle 10.1
pretty 9.8
clothing 9.7
boy 9.6
hair 9.5
women 9.5
clothes 9.4
smile 9.3
vintage 9.1
suit 9
human 9
one 9
style 8.9
device 8.7
day 8.6
face 8.5
youth 8.5
businessman 7.9
business 7.9
brunette 7.8
standing 7.8
black 7.8
professional 7.8
men 7.7
hand 7.6
cornet 7.6
field 7.5
hold 7.4
cheerful 7.3
lady 7.3
pose 7.2
uniform 7.2
cute 7.2
handsome 7.1
job 7.1
summer 7.1

Microsoft
created on 2022-05-28

painting 94.9
clothing 88.9
text 88.9
drawing 87.9
person 83.7
woman 53.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 11-19
Gender Male, 85.4%
Sad 75.5%
Fear 42%
Calm 17.7%
Surprised 6.8%
Angry 3.6%
Confused 2.6%
Disgusted 2.5%
Happy 1.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.2%
Painting 62.4%

Categories

Imagga

paintings art 67.3%
pets animals 31.2%

Captions

Text analysis

Amazon

1510
Catching
1510 Catching firefly.
firefly.

Google

1510 Catching firefly.
Catching
1510
firefly
.