Human Generated Data

Title

Untitled (full-length portrait of African-American man in formal dress and top hat posed in front of plain backdrop)
Date

c. 1856 - c. 1910
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.13321

Human Generated Data

Title

Untitled (full-length portrait of African-American man in formal dress and top hat posed in front of plain backdrop)

People

Artist: Unidentified Artist,

Date

c. 1856 - c. 1910

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.13321

Machine Generated Data

Tags

Amazon
created on 2022-01-24

Clothing 98.4
Apparel 98.4
Person 95.6
Human 95.6
Overcoat 89.8
Hat 77.1
Suit 72.7
Furniture 70.1
Shoe 67
Footwear 67
Portrait 65.2
Face 65.2
Photography 65.2
Photo 65.2
Chair 60.3
Text 59.2
Sleeve 57
Coat 51.6

Clarifai
created on 2023-10-26

people 99.7
portrait 98.4
man 97.2
art 96.1
wear 95.6
one 94.7
adult 94
sepia 93.2
vintage 91.8
retro 91
lid 88.2
mustache 85.1
old 81.7
street 80.7
model 77.7
leader 77.4
music 76.4
chair 73.6
sepia pigment 71
fashion 70.2

Imagga
created on 2022-01-24

suit 82.7
garment 44.5
clothing 42.9
man 42.3
male 38.3
businessman 38
person 37
business 35.8
bow tie 30.1
necktie 28.9
handsome 28.5
adult 28.5
portrait 26.5
tie 24.7
covering 23.5
executive 22.9
people 21.8
consumer goods 21.6
success 20.9
standing 20.9
holding 19
corporate 18.9
elegant 18.8
professional 18.6
one 17.9
job 16.8
attractive 16.8
fashion 16.6
black 16.5
smile 16.4
confident 16.4
work 15.7
men 15.5
uniform 15.4
coat 15.1
expression 14.5
lifestyle 14.5
shirt 14
model 14
military uniform 13.8
office 13.7
briefcase 13.6
face 13.5
guy 13.3
studio 12.9
successful 12.8
looking 12.8
human 12.7
worker 12.7
happy 12.5
boss 12.4
smiling 12.3
jacket 12.1
hat 11.8
hand 11.4
modern 11.2
alone 11
businesswoman 10.9
scholar 10.7
posing 10.7
serious 10.5
career 10.4
employee 10.1
style 9.6
headdress 9.4
happiness 9.4
trench coat 9.4
manager 9.3
pose 9.1
bag 8.8
formal 8.6
intellectual 8.6
smart 8.5
communication 8.4
elegance 8.4
phone 8.3
mortarboard 8.3
working 8
confidence 7.7
casual 7.6
finance 7.6
stand 7.6
dark 7.5
raincoat 7.5
outdoors 7.5
company 7.4
security 7.3
room 7.3
laptop 7.3
protection 7.3

Google
created on 2022-01-24

Hat 91.4
Coat 87.1
Sleeve 87
Standing 86.4
Collar 84.1
Suit 83.8
Art 79
Blazer 78.3
Tie 78
Vintage clothing 74.9
Rectangle 74.4
Formal wear 73.1
Classic 71.2
Overcoat 68.5
Trench coat 68
Room 67.6
Chair 67.4
White-collar worker 66.6
Uniform 66.6
Costume hat 66.2

Microsoft
created on 2022-01-24

wall 98.1
man 96.7
person 96.6
coat 95
clothing 91.1
text 84.1
old 83.4
tie 78.3
standing 77
suit 76.3
gentleman 72.4
posing 59.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 24-34
Gender Male, 99.9%
Sad 91.2%
Calm 4.8%
Confused 2.3%
Surprised 1%
Angry 0.3%
Fear 0.1%
Disgusted 0.1%
Happy 0%

Microsoft Cognitive Services

Age 27
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person
Hat
Suit
Shoe
Chair
Coat
Person 95.6%
Hat 77.1%
Suit 72.7%
Shoe 67%
Chair 60.3%
Coat 51.6%

Categories

Imagga

interior objects 47.8%
streetview architecture 42.9%
events parties 8.4%