Human Generated Data

Title

Untitled (portrait of man standing beside chair in front of painted backdrop with parlor setting)
Date

c. 1856 - c. 1910
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.13313

Human Generated Data

Title

Untitled (portrait of man standing beside chair in front of painted backdrop with parlor setting)

People

Artist: Unidentified Artist,

Date

c. 1856 - c. 1910

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.13313

Machine Generated Data

Tags

Amazon
created on 2022-01-24

Chair 100
Furniture 100
Clothing 99.4
Apparel 99.4
Person 96.2
Human 96.2
Home Decor 82.7
Overcoat 76.6
Coat 76.6
Suit 75.4
Couch 62.4
Linen 59.4
Sitting 57.7
Door 56.4
Footwear 56.1

Clarifai
created on 2023-10-27

people 99.9
portrait 98.7
man 96.6
adult 96.3
leader 95.7
one 95.3
chair 94.8
street 93.8
wear 92.9
outfit 92
vintage 90.4
art 90.3
administration 89.8
two 89.3
furniture 87.7
monochrome 84.5
seat 83.9
actor 82.7
sepia 81.1
lid 79.9

Imagga
created on 2022-01-24

statue 47.2
military uniform 32.2
sculpture 32.2
uniform 27.6
religion 25.1
clothing 25.1
art 23
old 21.6
monument 20.5
man 19.5
ancient 19
religious 17.8
antique 17.6
person 17.2
culture 16.2
architecture 15.6
god 15.3
history 15.2
male 14.3
historical 14.1
figure 13.7
detail 13.7
catholic 13.6
marble 13.6
tourism 13.2
stone 12.6
saint 12.5
city 12.5
decoration 12.4
people 12.3
consumer goods 12.1
travel 12
historic 11.9
covering 11.6
vintage 10.8
face 10.7
holy 10.6
carving 10.3
church 10.2
kin 10
trench coat 9.6
spirituality 9.6
spiritual 9.6
faith 9.6
famous 9.3
portrait 9.1
roman 8.8
pray 8.7
adult 8.5
private 8.4
world 8.3
one 8.2
dress 8.1
symbol 8.1
building 7.9
artistic 7.8
angel 7.8
black 7.8
coat 7.7
worship 7.7
raincoat 7.7
mask 7.7
cathedral 7.7
traditional 7.5
tourist 7.2
landmark 7.2
interior 7.1

Google
created on 2022-01-24

Outerwear 95.1
Sleeve 87.2
Collar 83.8
Blazer 78.3
Vintage clothing 76.3
Street fashion 75.1
Fashion design 74.8
Chair 73.8
Classic 72.9
Formal wear 71.1
Suit 70.1
Monochrome 66.5
Dress shirt 64.9
Stock photography 63.2
Monochrome photography 62.7
Art 62
Uniform 61.4
Sitting 59.1
Eyewear 58
Trench coat 57.5

Microsoft
created on 2022-01-24

clothing 95.5
text 92.9
person 90.5
footwear 85
man 79.7
old 78.4
furniture 75.4
black 69.6
chair 67.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-30
Gender Male, 100%
Happy 55.8%
Confused 22%
Calm 16%
Angry 2.6%
Surprised 1.3%
Sad 1%
Disgusted 0.9%
Fear 0.5%

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Chair
Person
Chair 100%
Person 96.2%

Categories

Imagga

paintings art 90.2%
streetview architecture 4.4%
interior objects 4.3%

Captions

Microsoft
created on 2022-01-24

an old photo of a man 93.3%
an old photo of a man in a suit and tie 93.2%
old photo of a man 91.7%