Human Generated Data

Title

Catching Firefly

Date

1870s-1880s

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Sam Pratt, P2003.212

Human Generated Data

Title

Catching Firefly

People

Artist: Unidentified Artist,

Date

1870s-1880s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-05-28

Clothing 100
Apparel 100
Robe 98.7
Fashion 98.7
Person 98.2
Human 98.2
Gown 95.2
Kimono 93.4
Art 62.4
Painting 62.4

Imagga
created on 2022-05-28

person 27.6
man 24.2
adult 23.2
people 21.2
musical instrument 21
male 20.6
wind instrument 18
portrait 17.5
fashion 15.8
holding 15.7
life 13.9
happy 13.8
outdoors 13.4
posing 13.3
attractive 13.3
model 13.2
smiling 13
weapon 12.7
sax 12.5
stringed instrument 12
brass 11.8
violin 11.8
outdoor 11.5
wall 11.1
happiness 11
dress 10.8
seller 10.7
bowed stringed instrument 10.7
color 10.6
lifestyle 10.1
pretty 9.8
clothing 9.7
boy 9.6
hair 9.5
women 9.5
clothes 9.4
smile 9.3
vintage 9.1
suit 9
human 9
one 9
style 8.9
device 8.7
day 8.6
face 8.5
youth 8.5
businessman 7.9
business 7.9
brunette 7.8
standing 7.8
black 7.8
professional 7.8
men 7.7
hand 7.6
cornet 7.6
field 7.5
hold 7.4
cheerful 7.3
lady 7.3
pose 7.2
uniform 7.2
cute 7.2
handsome 7.1
job 7.1
summer 7.1

Microsoft
created on 2022-05-28

painting 94.9
clothing 88.9
text 88.9
drawing 87.9
person 83.7
woman 53.3

Face analysis

Amazon

Google

AWS Rekognition

Age 11-19
Gender Male, 85.4%
Sad 75.5%
Fear 42%
Calm 17.7%
Surprised 6.8%
Angry 3.6%
Confused 2.6%
Disgusted 2.5%
Happy 1.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.2%
Painting 62.4%

Captions

Microsoft

a person wearing a suit and tie 81.7%
a person in a suit and tie 81.6%
a person standing in front of a tree 60.8%

Text analysis

Amazon

1510
Catching
1510 Catching firefly.
firefly.

Google

Catching
1510
.
1510 Catching firefly.
firefly