Human Generated Data

Title

Untitled (portrait of a man in a hat)

Date

1920s

People

Artist: Strauss Peyton, French active 1890s-1920s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2941

Human Generated Data

Title

Untitled (portrait of a man in a hat)

People

Artist: Strauss Peyton, French active 1890s-1920s

Date

1920s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Tie 100
Accessories 100
Accessory 100
Hat 100
Apparel 100
Clothing 100
Coat 99.4
Overcoat 99.4
Suit 99.4
Person 99
Human 99
Sun Hat 81.7
Necktie 81.4
Cowboy Hat 57.4

Imagga
created on 2022-01-09

cowboy hat 100
hat 100
headdress 90.8
clothing 73.7
suit 50.3
consumer goods 39.9
covering 39.5
portrait 38.9
person 34.6
man 32.3
people 31.8
male 30.6
face 29.9
adult 26.5
business 23.7
smile 23.5
handsome 23.2
garment 22
model 21.8
happy 20.1
hand 19.8
businessman 19.4
guy 18.5
attractive 18.2
black 18.1
one 17.9
cowboy 17.7
looking 16.8
boy 16.5
expression 16.2
professional 16
smiling 15.9
fashion 15.9
manager 14.9
corporate 14.6
human 14.3
kid 14.2
executive 13.8
eyes 13.8
blond 13.5
pretty 13.3
tie 13.3
elegant 12.9
successful 12.8
confident 12.8
hair 12.7
western 12.6
serious 12.4
sexy 12.1
child 11.7
dark 11.7
smart 11.3
success 11.3
shirt 11.2
old 11.2
posing 10.7
studio 10.7
necktie 10.6
modern 10.5
style 10.4
building 10.3
women 10.3
youth 10.2
head 10.1
smoking 9.8
fun 9.7
job 9.7
look 9.6
men 9.5
work 9.4
friendly 9.2
children 9.1
businesswoman 9.1
worker 9
cheerful 9
lifestyle 8.7
smoke 8.4
student 8.2
lady 8.1
office 8
close 8
standing 7.8
cigarette 7.8
mysterious 7.8
mystery 7.7
boss 7.7
formal 7.7
gesture 7.6
career 7.6
meeting 7.5
bow tie 7.4
gorgeous 7.3
pose 7.3
eye 7.2
lovely 7.1

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

fashion accessory 99.9
person 99.8
fedora 99.2
necktie 99.1
man 99
wearing 97.4
wall 96.8
suit 96.8
cowboy hat 96.4
human face 95.6
sun hat 94.9
indoor 86.8
headdress 86.3
portrait 85.4
hat 85.1
clothing 83.8
headgear 82.3
text 80.8
costume hat 78.2
gentleman 66.6
cap 61.8
peaked cap 61.6
tie 58.6
posing 35.2
dressed 32.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-27
Gender Male, 75.4%
Calm 98.4%
Angry 1.2%
Confused 0.1%
Disgusted 0.1%
Surprised 0.1%
Sad 0.1%
Happy 0%
Fear 0%

Microsoft Cognitive Services

Age 24
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Tie 100%
Hat 100%
Suit 99.4%
Person 99%

Captions

Microsoft

a man wearing a suit and hat 98.8%
a man wearing a suit and tie and a hat 98.5%
a man wearing a suit and tie 98.4%

Text analysis

Amazon

YORE
44 YORE
44

Google

A
A NEW YORE
NEW
YORE