Human Generated Data

Title

Untitled (full-length portrait of man with overcoat and bowler hat)
Date

c. 1856 - 1910
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.1

Human Generated Data

Title

Untitled (full-length portrait of man with overcoat and bowler hat)

People

Artist: Unidentified Artist,

Date

c. 1856 - 1910

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-05-28

Clothing 99.9
Apparel 99.9
Person 98.5
Human 98.5
Overcoat 97.4
Coat 97.3
Suit 80.6
Pants 74.5
Crypt 69.8
Portrait 62.1
Photography 62.1
Face 62.1
Photo 62.1
People 60.2
Sleeve 56.9
Dungeon 56.4
Wood 56.1

Imagga
created on 2022-05-28

military uniform 56.5
uniform 47.2
clothing 42.8
person 26.3
covering 22.4
consumer goods 22.3
man 22.2
people 21.2
adult 20.1
suit 17.8
fashion 17.3
male 17
coat 16.7
portrait 14.9
one 13.4
dark 13.4
vintage 13.2
dirty 12.6
old 12.5
statue 12.5
black 12.2
attractive 11.9
style 11.9
model 11.7
lifestyle 11.6
adolescent 11.1
street 11
trench coat 11
business 10.9
cell 10.8
juvenile 10.8
smile 10.7
human 10.5
outdoors 10.4
standing 10.4
ancient 10.4
architecture 10.1
outdoor 9.9
dress 9.9
holding 9.9
posing 9.8
raincoat 9.7
sculpture 9.6
building 9.5
retro 9
lady 8.9
garment 8.8
urban 8.7
antique 8.7
men 8.6
face 8.5
protection 8.2
handsome 8
looking 8
life 8
businessman 7.9
couple 7.8
brunette 7.8
art 7.8
guy 7.7
grunge 7.7
youth 7.7
casual 7.6
walking 7.6
happy 7.5
city 7.5
world 7.4
alone 7.3
danger 7.3
figure 7.2
office 7.2
cute 7.2
history 7.2
family 7.1
night 7.1
boy 7.1
autumn 7

Google
created on 2022-05-28

Chair 87.6
Collar 83.2
Sleeve 82.7
Suit 77.3
Vintage clothing 74.4
Tints and shades 74.1
Military person 73.8
Non-commissioned officer 73.7
Blazer 72.5
Classic 71.7
Uniform 68.9
History 65.9
Formal wear 65.1
Military officer 59.7
Visual arts 59.5
Art 58.8
Antique 57.1
Overcoat 54.9
Retro style 51.8

Microsoft
created on 2022-05-28

building 99.2
clothing 98.6
coat 96.9
person 91.9
outdoor 90.3
text 88.1
old 81.2
footwear 70.5
black 70.4
vintage clothing 52.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 18-24
Gender Male, 100%
Calm 89%
Surprised 6.5%
Fear 6.1%
Sad 5.6%
Angry 1.7%
Confused 0.7%
Happy 0.6%
Disgusted 0.2%

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%
Coat 97.3%

Captions

Microsoft

a vintage photo of a person standing in front of a building 89%
a vintage photo of an old man standing in front of a building 87.7%
a person standing in front of an old building 87.6%