Human Generated Data

Title

"Now, Mr. Artist, I want it to look just like me." (701 b)
Date

c. 1906
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Professor and Mrs. John Coolidge, P1979.88

Human Generated Data

Title

"Now, Mr. Artist, I want it to look just like me." (701 b)

People

Artist: Unidentified Artist,

Date

c. 1906

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Professor and Mrs. John Coolidge, P1979.88

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.8
Human 99.8
Person 99.8
Person 96.5
Person 95.3
Painting 94.8
Art 94.8
Person 92.3
Person 71
Chair 55.3
Furniture 55.3

Clarifai
created on 2023-10-26

people 99.8
painting 99.7
art 99.6
woman 98.9
print 98.6
illustration 98.5
adult 98.5
group 98.3
man 98.1
two 96.1
seat 95.5
furniture 93.1
elderly 92
easel 92
wear 90.9
three 89.3
religion 89.2
child 89
five 88.7
exhibition 88.4

Imagga
created on 2022-01-22

musical instrument 43.4
accordion 29.1
wind instrument 29
keyboard instrument 22.5
traditional 19.1
religion 18.8
man 18.1
old 18.1
people 17.8
religious 15.9
art 15.8
culture 14.5
person 14.2
male 14.2
adult 14
costume 12.9
dress 12.6
faith 12.4
portrait 12.3
clothing 12.2
face 12.1
fashion 12
church 12
saint 11.5
god 11.5
antique 11.2
color 11.1
colorful 10.7
prayer 10.6
statue 10.4
sculpture 10.2
kimono 10.2
musician 10
holy 9.6
spiritual 9.6
shop 9.5
holiday 9.3
singer 9
couple 8.7
women 8.7
worship 8.7
ancient 8.6
spirituality 8.6
black 8.4
robe 8.4
hand 8.3
tradition 8.3
city 8.3
vintage 8.3
peace 8.2
gold 8.2
bible 7.8
scene 7.8
pray 7.7
men 7.7
temple 7.6
elegance 7.5
clothes 7.5
monument 7.5
oriental 7.3
historic 7.3
garment 7.2
icon 7.1
interior 7.1
architecture 7

Google
created on 2022-01-22

Art 85
Chair 80.9
Adaptation 79.2
Classic 77.2
Vintage clothing 76.8
Suit 76.4
Poster 76.1
Painting 73.8
Recreation 73.4
Plant 72.7
Event 72.4
Illustration 71.8
Leisure 70
Stock photography 66.1
History 64.5
Conversation 63.4
Room 62.8
Visual arts 62
Advertising 62
Games 58.5

Microsoft
created on 2022-01-22

text 96.8
clothing 87.5
person 85.6
book 83.3
poster 83
woman 66
fashion 58.7
cartoon 58.2
nostalgia 51.7
picture frame 9.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 50-58
Gender Male, 88.1%
Happy 96.5%
Calm 2.9%
Sad 0.4%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%
Surprised 0%
Confused 0%

AWS Rekognition

Age 23-33
Gender Female, 99.6%
Fear 55.1%
Happy 22.8%
Calm 12.1%
Surprised 5%
Disgusted 1.9%
Angry 1.3%
Confused 1.1%
Sad 0.8%

AWS Rekognition

Age 45-53
Gender Female, 100%
Calm 75.8%
Happy 7.8%
Fear 5.8%
Surprised 3.2%
Angry 3%
Disgusted 2.1%
Confused 1.5%
Sad 0.8%

AWS Rekognition

Age 23-33
Gender Female, 83.2%
Calm 70.1%
Sad 15.1%
Disgusted 3.3%
Fear 3.3%
Angry 3%
Happy 2%
Confused 1.7%
Surprised 1.6%

AWS Rekognition

Age 27-37
Gender Male, 99.7%
Calm 67.6%
Sad 20.5%
Disgusted 5.7%
Angry 1.6%
Confused 1.2%
Surprised 1.2%
Fear 1.2%
Happy 1%

AWS Rekognition

Age 49-57
Gender Male, 98.8%
Calm 99.1%
Happy 0.6%
Sad 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0%
Surprised 0%
Angry 0%

AWS Rekognition

Age 20-28
Gender Female, 86.6%
Calm 92.6%
Sad 3.1%
Confused 1.3%
Happy 1.2%
Fear 0.6%
Angry 0.5%
Surprised 0.4%
Disgusted 0.3%

AWS Rekognition

Age 23-33
Gender Female, 93.4%
Sad 61.1%
Calm 32.6%
Happy 2.1%
Fear 1.5%
Angry 0.8%
Disgusted 0.7%
Confused 0.7%
Surprised 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Painting 94.8%
Chair 55.3%

Captions

Text analysis

Amazon

just
it
Artist,
701
like
1906
by
look
701 (b). "Now, Mr. Artist, I want it to look just
Mr.
"Now,
I
to
want
like me."
Herman
Copyright
me."
(b).
Copyright 1906 by Herman Knutzen.
Knutzen.

Google

701 (b). 'Now, Mr. Artist, I want it to look just like me." Copyright 1906 by Herman Knutzen.
701
(b).
'Now,
Mr.
Artist,
I
want
it
to
look
just
like
me."
Copyright
1906
by
Herman
Knutzen.