Human Generated Data

Title

Photograph of the Portrait of Caspar Goodrich

Date

after 1888

People

Artist: John Singer Sargent, American 1856 - 1925

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. Francis Ormond, 1937.7.27.10.B

Human Generated Data

Title

Photograph of the Portrait of Caspar Goodrich

People

Artist: John Singer Sargent, American 1856 - 1925

Date

after 1888

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. Francis Ormond, 1937.7.27.10.B

Machine Generated Data

Tags

Amazon
created on 2022-06-03

Painting 98.2
Art 98.2
Person 95.9
Human 95.9
Architecture 67.9
Building 67.9
Photography 60.7
Photo 60.7
Portrait 60.7
Face 60.7
Crypt 58.4
Archaeology 57.7

Clarifai
created on 2023-10-30

art 99.8
people 99.7
portrait 99.1
picture frame 98.9
painting 98.8
baroque 98.7
wear 97.4
crown 95.2
one 94.9
vintage 94.1
furniture 90.9
adult 90.3
victorian 89.8
old 88.3
woman 88
baby 86.9
antique 86.2
group 86.1
illustration 85.3
Renaissance 84.1

Imagga
created on 2022-06-03

sculpture 43.3
architecture 39.8
ancient 38.9
old 34.8
carving 33.9
art 33.6
temple 27.1
religion 26.9
building 26.4
stone 25.6
history 24.2
statue 23.9
antique 22.2
structure 22.2
culture 21.4
historic 21.1
stucco 20.8
religious 17.8
travel 17.6
monument 16.8
wall 16.1
historical 16
famous 15.8
facade 15.2
vintage 14.9
texture 14.6
detail 14.5
decoration 13.9
landmark 13.5
church 12.9
architectural 12.5
city 11.6
column 11.6
pattern 11.6
tourism 11.6
spirituality 11.5
god 11.5
fountain 11.2
grunge 11.1
exterior 11.1
carved 10.8
spiritual 10.6
design 10.1
symbol 10.1
aged 10
plastic art 9.9
altar 9.8
entrance 9.7
heritage 9.7
door 9.5
buildings 9.5
figure 9.4
frame 9.4
retro 9
memorial 8.8
ruin 8.8
marble 8.7
paper 8.6
ornament 8.6
attraction 8.6
close 8.6
face 8.5
ornate 8.2
style 8.2
statues 7.9
ruins 7.8
worship 7.7
palace 7.7
holy 7.7
faith 7.7
destination 7.5
east 7.5
black 7.2
textured 7

Google
created on 2022-06-03

Microsoft
created on 2022-06-03

wall 97.8
person 97.1
human face 97.1
drawing 95.6
indoor 94.3
clothing 92.4
old 88.4
sketch 86.3
art 86.3
text 82.9
painting 23.1
picture frame 6.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-14
Gender Male, 99.9%
Calm 93.6%
Surprised 6.4%
Fear 6%
Angry 2.9%
Sad 2.7%
Confused 0.7%
Happy 0.3%
Disgusted 0.2%

Microsoft Cognitive Services

Age 9
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 98.2%
Person 95.9%

Categories

Imagga

paintings art 99.8%

Captions

Microsoft
created on 2022-06-03

a vintage photo of a person 86.9%
a painting of a person 86.8%
a vintage photo of a girl 76.9%