Human Generated Data

Title

Untitled (man with beard wearing hat, holding tray with bottle and glasses, standing in front of a balustrade)
Date

1860-1899
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.329.15

Human Generated Data

Title

Untitled (man with beard wearing hat, holding tray with bottle and glasses, standing in front of a balustrade)

People

Artist: Unidentified Artist,

Date

1860-1899

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.329.15

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Person 99.4
Human 99.4
Art 92.1
Drawing 89.2
Text 78.8
Poster 75.3
Advertisement 75.3
Sketch 69
Clothing 65.2
Apparel 65.2
Painting 60.9
Label 58.2

Clarifai
created on 2023-10-28

people 99.5
portrait 99.5
art 98.5
wear 98.3
one 97.8
adult 96.9
man 96.5
print 95.8
vintage 94.4
retro 94.3
lid 92.9
old 92.9
sepia pigment 91.9
paper 91.3
painting 90.5
antique 90.2
veil 87.7
illustration 86.3
nostalgia 83.9
sepia 82.9

Imagga
created on 2022-02-25

statue 48.7
sculpture 42.6
ancient 28.6
architecture 28.3
art 24.6
old 23.7
monument 23.4
building 23.2
culture 22.2
stone 20.6
history 20.6
travel 18.3
marble 18.2
religion 17.9
historical 17.9
city 16.6
tourism 16.5
structure 16.1
landmark 15.4
historic 14.7
famous 14
decoration 12.9
temple 12.6
fountain 12.5
religious 12.2
column 12
god 11.5
antique 11.3
device 10.8
roman 10.7
memorial 10.7
detail 10.5
carving 10.3
traditional 10
tourist 10
man 9.4
wall 9.4
face 9.2
house 9.2
vintage 9.1
catholic 8.8
artistic 8.7
cemetery 8.6
brass 8.2
facade 7.9
support 7.9
carved 7.8
window 7.8
heritage 7.7
balcony 7.6
head 7.6
figure 7.5
church 7.4
portrait 7.1
male 7.1

Google
created on 2022-02-25

Hat 91.7
Sun hat 84.9
Art 82.5
Tints and shades 76.5
Painting 74.1
Vintage clothing 73.8
Wood 66.6
Musical instrument 66
Visual arts 65.8
Font 65.6
Rectangle 65.3
Illustration 63.5
Stock photography 61.9
Monochrome 59.4
Room 58.3
Retro style 57.1
Guitar 55.8
Sitting 55.6
Portrait 54
History 53.2

Microsoft
created on 2022-02-25

text 98.8
clothing 98.3
person 96.1
drawing 95.2
wall 95.2
cartoon 89.7
sketch 89.7
old 84.4
photograph 84.3
human face 82.7
man 65.5
white 64.7
boy 55.6
smile 50.8
vintage 34.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 30-40
Gender Male, 99.6%
Calm 83.1%
Confused 5%
Angry 2.8%
Happy 2.5%
Sad 2.4%
Surprised 1.5%
Fear 1.4%
Disgusted 1.2%

Microsoft Cognitive Services

Age 38
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Poster
Person 99.4%
Poster 75.3%

Categories

Imagga

paintings art 98.4%
streetview architecture 1.2%