Human Generated Data

Title

"(Happy Father!) What Two? Yes, Sir, Two Little Beauties!!"
Date

19th-20th century
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Professor and Mrs. John Coolidge, P1979.140

Human Generated Data

Title

"(Happy Father!) What Two? Yes, Sir, Two Little Beauties!!"

People

Artist: Unidentified Artist,

Date

19th-20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Professor and Mrs. John Coolidge, P1979.140

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.2
Human 99.2
Person 99.2
Painting 96.4
Art 96.4
Person 96.2
Clothing 95.6
Apparel 95.6
Person 94.8
Furniture 68.9
Person 67.8
Portrait 61.5
Face 61.5
Photography 61.5
Photo 61.5
Gown 57.8
Fashion 57.8
Wood 56.7
Person 44.3

Clarifai
created on 2023-10-26

child 99.8
people 99.4
family 97.4
wear 95.4
woman 95.1
group 94.9
son 93.9
baby 91.9
fun 91
girl 90.9
man 89.5
art 87.7
painting 87.6
adult 86.1
boy 85.5
celebration 85.1
lid 84.9
religion 83
indoors 81.6
offspring 81

Imagga
created on 2022-01-22

vestment 100
gown 100
outerwear 77.5
clothing 62.7
consumer goods 28.3
covering 28.1
boutique 20.8
holiday 20.8
dress 19.9
people 19.5
religion 17.9
happy 17.5
face 16.3
culture 16.2
metropolitan 15.7
portrait 15.5
fashion 15.1
traditional 15
person 14.7
bags 14.6
gift 13.8
bag 13.6
lady 13
shopping 12.8
celebration 12.8
costume 12.7
women 12.7
old 12.5
temple 12.3
colorful 12.2
party 12
tradition 12
smiling 11.6
gold 11.5
smile 11.4
religious 11.2
clothes 11.2
kimono 10.8
man 10.8
color 10.6
pretty 10.5
customer 10.5
decoration 10.1
cute 10
present 10
travel 9.9
cheerful 9.8
faith 9.6
festival 9.6
happiness 9.4
church 9.3
holding 9.1
looking 8.8
mall 8.8
holy 8.7
mother 8.6
robe 8.6
god 8.6
golden 8.6
architecture 8.6
adult 8.4
attractive 8.4
sale 8.3
makeup 8.2
fun 8.2
style 8.2
celebrate 8.1
new 8.1
love 7.9
together 7.9
look 7.9
shopper 7.8
art 7.8
luxury 7.7
buying 7.7
tree 7.7
hand 7.6
shop 7.6
store 7.6
elegance 7.6
tourism 7.4
joyful 7.4
lifestyle 7.2
sexy 7.2
romantic 7.1
family 7.1
lovely 7.1
groom 7

Google
created on 2022-01-22

Photograph 94.2
Textile 87.7
Art 87
Painting 82.6
Adaptation 79.3
People 77.9
Illustration 75.8
Vintage clothing 75.1
Snapshot 74.3
Drawing 72.6
Recreation 72.5
Room 72.1
Visual arts 71.6
Paint 70.1
Event 70.1
Watercolor paint 69.6
Child 69.5
Magenta 67.3
Stock photography 66.8
House 65.2

Microsoft
created on 2022-01-22

clothing 98.1
painting 94.3
person 92.8
drawing 86.2
woman 80.6
cartoon 78.5
text 73.4
dress 65
child art 57.3
old 49
dressed 40.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 45-51
Gender Male, 99.9%
Calm 32.5%
Sad 23.1%
Angry 12.8%
Surprised 12.4%
Confused 8.8%
Fear 5%
Disgusted 4.8%
Happy 0.7%

AWS Rekognition

Age 29-39
Gender Male, 100%
Calm 43%
Surprised 24.7%
Angry 17.3%
Confused 7.7%
Fear 5%
Disgusted 1%
Sad 0.9%
Happy 0.4%

AWS Rekognition

Age 21-29
Gender Male, 83.2%
Calm 90%
Fear 2.4%
Happy 2.3%
Disgusted 1.4%
Angry 1.4%
Confused 1.1%
Surprised 0.8%
Sad 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Painting 96.4%

Categories

Imagga

paintings art 95.4%
people portraits 2.2%
interior objects 2.1%

Text analysis

Amazon

little
(Happy
what two.
"Jes. Sir I wo little beauties
I wo
"Jes.
(Happy fathes!) "What! two
Sir
beauties
two
fathes!)
"What!

Google

whal livo, (3teppy Fathes!)nhati two" "Tes, i, Invo liitle beauties.
whal
livo,
(3teppy
Fathes!)nhati
two"
"Tes,
i,
Invo
liitle
beauties.