Human Generated Data

Title

Untitled (man in hat)

Date

1920s

People

Artist: Strauss-Peyton, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.1927

Human Generated Data

Title

Untitled (man in hat)

People

Artist: Strauss-Peyton, American 20th century

Date

1920s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Accessories 100
Accessory 100
Tie 100
Apparel 100
Clothing 100
Hat 100
Overcoat 99.3
Suit 99.3
Coat 99.3
Person 98.8
Human 98.8
Sun Hat 83.5
Necktie 76.3
Cowboy Hat 63.2

Imagga
created on 2021-12-15

cowboy hat 100
hat 100
headdress 83.7
clothing 77
suit 55.3
consumer goods 40.3
covering 39.9
portrait 37.6
person 35.7
people 31.3
male 30.6
man 30.3
adult 29.1
face 28.5
garment 28.4
business 28
businessman 26.5
model 21.8
handsome 21.4
smile 21.4
happy 20.1
professional 19.4
attractive 18.2
corporate 18.1
hand 17.5
manager 16.8
one 16.4
looking 16
smiling 15.9
guy 15.8
cowboy 15.7
black 15.7
boy 15.7
executive 14.8
kid 14.2
success 13.7
expression 13.7
fashion 13.6
blond 13.5
necktie 13.3
successful 12.8
child 12.7
pretty 12.6
tie 12.3
eyes 12.1
human 12
modern 11.9
businesswoman 11.8
head 11.8
posing 11.6
job 11.5
serious 11.5
men 11.2
old 11.2
elegant 11.1
youth 11.1
work 11
studio 10.7
cheerful 10.6
boss 10.5
office 10.5
businesspeople 10.4
standing 10.4
hair 10.3
western 9.7
sexy 9.7
career 9.5
shirt 9.3
occupation 9.2
children 9.1
fun 9
smoking 8.8
employee 8.8
building 8.7
lifestyle 8.7
casual 8.5
mature 8.4
bow tie 8.3
confident 8.2
student 8.2
pose 8.2
worker 8.1
eye 8.1
close 8
women 7.9
look 7.9
formal 7.7
gesture 7.6
communication 7.6
smart 7.5
smoke 7.4
style 7.4
secretary 7.4
20s 7.3
lady 7.3
working 7.1

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

fashion accessory 99.8
person 99.8
necktie 99.7
suit 99.2
man 99.2
wearing 99.1
fedora 99
wall 98.1
text 96.3
cowboy hat 95.5
human face 94.9
sun hat 93.9
hat 91.5
portrait 86.3
indoor 85.2
clothing 80.5
headgear 79.2
costume hat 75.7
gentleman 62.9
peaked cap 58.3
cap 57.7
tie 53.2
posing 51.6
dressed 49.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 11-21
Gender Male, 76.9%
Calm 98.8%
Sad 0.4%
Fear 0.3%
Angry 0.2%
Confused 0.1%
Happy 0.1%
Surprised 0.1%
Disgusted 0%

Microsoft Cognitive Services

Age 25
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Tie 100%
Hat 100%
Suit 99.3%
Person 98.8%

Captions

Microsoft

a man wearing a suit and hat 99.1%
a man wearing a suit and tie and a hat 99%
a man wearing a suit and tie 98.9%

Text analysis

Amazon

YORK
NEW
44 NEW YORK
44

Google

hau
n
da
hau da n