Human Generated Data

Title

Untitled (two unidentified men wearing turbans, seated in front of fabric back drop)
Date

1860-1899
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.329.21

Human Generated Data

Title

Untitled (two unidentified men wearing turbans, seated in front of fabric back drop)

People

Artist: Unidentified Artist,

Date

1860-1899

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.329.21

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Person 99
Human 99
Person 98.9
Clothing 97.4
Apparel 97.4
Face 76.7
Hat 73.6
Bonnet 71.4
Text 68.6
Art 68.5
People 59.3
Wood 56.9
Portrait 56.6
Photography 56.6
Photo 56.6
Painting 55.2

Clarifai
created on 2023-10-28

people 99.6
portrait 99.4
wear 98.5
art 96.4
child 96.3
man 96
adult 95.5
two 93.5
retro 92.5
veil 92.3
lid 90.3
memory 90.1
boy 89.9
son 89.7
nostalgia 89.6
one 89.5
painting 88.6
woman 88.5
old 88.2
vintage 87.8

Imagga
created on 2022-02-25

kin 34
old 22.3
statue 21.1
art 21.1
culture 19.6
book jacket 19.5
vintage 19
sculpture 18.9
ancient 18.1
jacket 16.1
antique 15.6
black 15
face 14.9
man 14.8
portrait 13.6
decoration 13.4
religion 13.4
world 13.1
people 12.8
history 12.5
retro 12.3
historical 12.2
monument 12.1
male 11.6
wrapping 11.5
detail 11.3
marble 11.1
architecture 10.9
dress 10.8
symbol 10.8
card 10.4
grunge 10.2
head 10.1
stone 9.8
museum 9.7
mask 9.6
person 9.5
closeup 9.4
baby 9.2
letter 9.2
traditional 9.1
theater 8.8
stamp 8.7
love 8.7
mail 8.6
golden 8.6
costume 8.6
empty 8.6
sibling 8.4
envelope 8.4
figure 8.4
covering 8.4
church 8.3
one 8.2
aged 8.1
mother 8
family 8
postmark 7.9
printed 7.9
postage 7.9
renaissance 7.9
post 7.6
child 7.6
old fashioned 7.6
decorative 7.5
religious 7.5
design 7.4
historic 7.3
blackboard 7.3
romantic 7.1
happiness 7

Google
created on 2022-02-25

Hairstyle 95.1
Art 81.2
Picture frame 79.1
Vintage clothing 77.3
Tints and shades 77.2
Room 70.1
Visual arts 67.3
Rectangle 66
Stock photography 62.4
Painting 62
Font 61.8
Illustration 61.5
Sitting 61
Paper product 60.9
Hat 59.2
History 57.8
Portrait 56.1
Photographic paper 55
Child 54
Retro style 53.8

Microsoft
created on 2022-02-25

clothing 98
person 97.1
old 96.5
human face 96.4
text 93.7
window 91.5
drawing 89.6
cartoon 78.5
white 77.5
black 76.8
man 70.6
smile 68.1
photograph 64.4
posing 61.1
sketch 60.4
painting 60.4
picture frame 52.9
vintage 47.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-36
Gender Male, 98.6%
Calm 91%
Fear 4.2%
Confused 2.2%
Sad 0.9%
Surprised 0.6%
Disgusted 0.4%
Angry 0.4%
Happy 0.3%

AWS Rekognition

Age 37-45
Gender Male, 100%
Calm 71.3%
Confused 21.1%
Angry 2.5%
Surprised 1.3%
Sad 1.3%
Fear 1%
Disgusted 0.8%
Happy 0.6%

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99%
Person 98.9%

Categories

Imagga

paintings art 96.4%
people portraits 3.3%