Human Generated Data

Title

"The Proposal" (8)

Date

c. 1917-c. 1922

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Professor and Mrs. John Coolidge, P1979.123

Human Generated Data

Title

"The Proposal" (8)

People

Artist: Unidentified Artist,

Date

c. 1917-c. 1922

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.4
Human 99.4
Person 99
Person 97.4
Person 96.9
Leisure Activities 91
Musical Instrument 80.9
Musician 72.9
Art 70.4
Lute 69.4
Furniture 64.8
Photography 61.4
Photo 61.4
Face 60.6
Portrait 60.6
Banjo 59.8
Guitar 56
Performer 56
Guitarist 56

Imagga
created on 2022-01-22

structure 27.9
billboard 23.8
old 20.9
brass 20.1
signboard 19.3
vintage 18.2
grunge 17.9
graffito 17.4
decoration 17.4
black 16.9
snow 14.6
memorial 14.6
dirty 13.6
retro 13.1
man 12.8
art 12.5
frame 12.5
person 12.1
cemetery 11.8
pattern 10.9
graphic 10.9
antique 10.4
space 9.3
dark 9.2
aged 9
landscape 8.9
people 8.9
musical instrument 8.8
season 8.6
winter 8.5
design 8.4
adult 8.4
outdoor 8.4
texture 8.3
city 8.3
sky 8.3
park 8.2
building 8.2
danger 8.2
border 8.1
digital 8.1
symbol 8.1
wind instrument 8.1
material 8
trees 8
forest 7.8
scene 7.8
tree 7.7
mask 7.7
negative 7.7
old fashioned 7.6
car 7.5
film 7.4
equipment 7.3
industrial 7.3
paint 7.2
male 7.1
working 7.1
travel 7

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

text 97.3
drawing 85.7
person 80.5
sketch 79.6
cartoon 63.7
old 53
clothing 51.8
picture frame 12.3

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Male, 72.5%
Calm 88.7%
Sad 4.3%
Fear 2.9%
Angry 1.5%
Confused 0.8%
Disgusted 0.7%
Happy 0.7%
Surprised 0.5%

AWS Rekognition

Age 30-40
Gender Male, 93%
Calm 99.1%
Sad 0.4%
Fear 0.1%
Happy 0.1%
Angry 0.1%
Disgusted 0.1%
Surprised 0.1%
Confused 0.1%

AWS Rekognition

Age 23-31
Gender Female, 50%
Calm 96%
Happy 1%
Sad 1%
Disgusted 0.7%
Fear 0.5%
Angry 0.3%
Surprised 0.3%
Confused 0.2%

AWS Rekognition

Age 23-33
Gender Female, 99.5%
Sad 81.4%
Calm 12.5%
Fear 2.2%
Confused 1.5%
Disgusted 0.8%
Surprised 0.6%
Angry 0.6%
Happy 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

an old photo of a person 72.9%
old photo of a person 69.3%
an old photo of a person 68.1%

Text analysis

Amazon

The
8. The Proposal.
8.
Proposal.

Google

8. The Proposal.
The
8.
Proposal.