Human Generated Data

Title

Untitled (portrait of seated man in vest and hat)

Date

c. 1856 - c. 1910

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.13359

Human Generated Data

Title

Untitled (portrait of seated man in vest and hat)

People

Artist: Unidentified Artist,

Date

c. 1856 - c. 1910

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Person 99.3
Human 99.3
Hat 99.2
Clothing 99.2
Apparel 99.2
Face 76.2
Man 69.8
Finger 65.7
Photography 65.4
Photo 65.4
Portrait 65.4
Sun Hat 58.2

Imagga
created on 2022-01-28

person 42.2
male 38.1
man 37.7
portrait 37.6
call 35
adult 33.7
people 27.9
model 25.7
adolescent 25
handsome 25
attractive 24.5
face 24.2
fashion 23.4
sexy 21.7
juvenile 20.6
black 18.8
human 18.8
looking 18.4
hair 17.4
expression 17.1
style 17.1
guy 16.4
happy 16.3
posing 16
one 15.7
pretty 15.4
youth 14.5
lifestyle 14.5
casual 14.4
serious 14.3
standing 13.9
body 13.6
modern 13.3
suit 12.9
clothing 12.9
skin 12.9
confident 12.7
love 12.6
smiling 12.3
couple 12.2
business 11.5
businessman 11.5
lady 11.4
brunette 11.3
shirt 11.2
men 11.2
happiness 11
head 10.9
sensuality 10.9
dress 10.8
cool 10.7
studio 10.6
professional 10.1
dark 10
pose 10
boy 9.6
tie 9.5
smile 9.3
alone 9.1
mother 9
office 8.8
cute 8.6
relationship 8.4
parent 8.4
room 8.2
sensual 8.2
home 8
indoors 7.9
together 7.9
vertical 7.9
eyes 7.8
old 7.7
confidence 7.7
fashionable 7.6
healthy 7.6
elegance 7.6
single 7.4
necktie 7.4
20s 7.3
girls 7.3
make 7.3
life 7.3
telephone 7.3
success 7.2
stylish 7.2
women 7.1
interior 7.1
look 7

Google
created on 2022-01-28

Hairstyle 95.1
Photograph 94.2
Hat 92.5
Black 89.7
Beard 87.4
Sleeve 87.2
Sun hat 85
Headgear 84.3
Fedora 82.4
Collar 81.4
Vintage clothing 76.8
Tints and shades 76.4
Facial hair 76.2
Art 75.3
Snapshot 74.3
Rectangle 73
Costume hat 69.2
Moustache 68.9
Stock photography 65.8
Sitting 62.6

Microsoft
created on 2022-01-28

person 99.9
fashion accessory 98.7
clothing 98.7
human face 98.5
wall 98.3
sitting 95.8
old 95.5
text 93.5
fedora 91.5
man 89.3
cowboy hat 86.6
hat 81.1
portrait 76
sun hat 72.7
white 66.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 36-44
Gender Male, 100%
Confused 98.2%
Calm 1.4%
Surprised 0.2%
Angry 0.1%
Disgusted 0.1%
Sad 0.1%
Fear 0%
Happy 0%

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Hat 99.2%

Captions

Microsoft

a man sitting on a bench posing for the camera 85.4%
a vintage photo of a man sitting on a bench 77.5%
a man wearing a hat sitting on a bench 76.2%