Human Generated Data

Title

"Now I will just drop this paper bag over his head." (700 b)

Date

c. 1906

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Professor and Mrs. John Coolidge, P1979.83

Human Generated Data

Title

"Now I will just drop this paper bag over his head." (700 b)

People

Artist: Unidentified Artist,

Date

c. 1906

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.7
Human 99.7
Person 99.6
Person 99.6
Person 99
Leisure Activities 97.7
Musical Instrument 94.8
Lute 94.4
Musician 87
Guitar 86.9
Advertisement 86
Poster 86
Banjo 75.2
Art 74.8
Apparel 69.7
Clothing 69.7
Violin 68.1
Viola 68.1
Fiddle 68.1
Performer 57.9
Guitarist 57.9

Imagga
created on 2022-01-22

man 22.2
person 19
cleaner 18
wind instrument 17.9
sport 16
male 15.6
musical instrument 15.4
people 13.4
adult 12.6
stick 11.8
ancient 11.2
outdoors 11.2
old 11.1
newspaper 10.2
art 9.9
brass 9.8
trombone 9.2
product 9.1
child 9
pipe 9
sky 8.9
work 8.8
architecture 8.6
summer 8.4
letter 8.2
symbol 8.1
water 8
culture 7.7
outdoor 7.6
religious 7.5
fun 7.5
one 7.5
professional 7.4
vintage 7.4
message 7.3
device 7.2
building 7.2
success 7.2
active 7.2
religion 7.2
envelope 7

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

text 98.2
cartoon 85.3
clothing 82.7
person 77.5
musical instrument 76.8
painting 70.7
poster 58.5
different 51.4

Face analysis

Amazon

Google

AWS Rekognition

Age 24-34
Gender Male, 99.2%
Calm 95.5%
Sad 2.8%
Confused 1.2%
Disgusted 0.2%
Fear 0.1%
Angry 0.1%
Surprised 0.1%
Happy 0%

AWS Rekognition

Age 23-33
Gender Male, 99.2%
Calm 99.9%
Confused 0%
Sad 0%
Surprised 0%
Happy 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 27-37
Gender Female, 99.7%
Calm 42.9%
Happy 42.6%
Confused 4.4%
Sad 3.1%
Disgusted 2.8%
Angry 2.2%
Surprised 1.2%
Fear 0.8%

AWS Rekognition

Age 19-27
Gender Female, 100%
Calm 66.1%
Happy 19.1%
Sad 6.3%
Fear 3.8%
Confused 1.6%
Surprised 1.3%
Angry 1%
Disgusted 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Poster 86%

Captions

Microsoft

a group of people looking at a book 32.4%
a group of people sitting in a box 32.3%
a group of people standing next to a book 32.2%

Text analysis

Amazon

drop
700
bag
this
by
just
I
his
Herman
paper
will
700 (b). "Now I will just drop this paper bag over
(b).
over
Copyright
his head."
head."
"Now
Copyright 1906 by Herman Knutzen.
Knutzen.
1906

Google

(b).
this
paper
1906
Herman
over
700
his
"Now
drop
bag
Copyright
Knutzen.
700 (b). his head." "Now I will just drop this paper bag over Copyright 1906 by Herman Knutzen.
head."
I
just
will
by