Human Generated Data

Title

Untitled (portrait of a man)
Date

c. 1938
People

Artist: Arthur Rothstein, American 1915 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.1420

Human Generated Data

Title

Untitled (portrait of a man)

People

Artist: Arthur Rothstein, American 1915 - 1985

Date

c. 1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Hat 100
Clothing 100
Apparel 100
Person 98.3
Human 98.3
Face 92.9
Cowboy Hat 88.9
Sun Hat 77.3
Man 70.7
Portrait 62.1
Photography 62.1
Photo 62.1

Imagga
created on 2022-01-23

cowboy hat 100
hat 100
headdress 100
clothing 74.8
man 42.3
portrait 42.1
person 38.5
consumer goods 38.4
male 38.3
covering 38
face 36.2
people 30.7
model 28.8
black 25.2
handsome 23.2
adult 22
guy 21.2
fashion 21.1
one 20.2
smile 20
attractive 19.6
hair 19
serious 18.1
eyes 18.1
expression 17.9
old 16.7
cowboy 16.7
boy 16.5
happy 16.3
sexy 16.1
looking 16
shirt 15.9
dark 15.9
style 15.6
casual 15.3
smiling 15.2
head 15.1
men 14.6
youth 14.5
pose 12.7
beard 12.6
western 12.6
blond 12.6
close 12.6
look 12.3
senior 12.2
human 12
eye 11.6
wearing 11.4
hand 11.4
studio 11.4
child 10.8
kid 10.6
gesture 10.5
emotion 10.1
teenager 10
pretty 9.8
posing 9.8
fun 9.7
mysterious 9.7
mystery 9.6
smart 9.4
lifestyle 9.4
children 9.1
masculine 8.8
closeup 8.8
ethnic 8.6
skin 8.5
mature 8.4
rough 8.2
confident 8.2
smoking 7.8
ethnicity 7.7
costume 7.6
vintage 7.4
retro 7.4
brown 7.4
cheerful 7.3
cute 7.2
cool 7.1
happiness 7.1

Google
created on 2022-01-23

Chin 96.6
Eye 93.8
Hat 92.3
White 92.2
Black 89.5
Human 89.1
Collar 84.1
Sun hat 83.6
Black-and-white 82.3
Wrinkle 80.9
Facial hair 80.8
People 77.9
Monochrome photography 74.8
Monochrome 74.6
Moustache 74.3
Fedora 74.2
White-collar worker 68.5
Dress shirt 68.2
Button 67.6
Fashion accessory 67.3

Microsoft
created on 2022-01-23

man 99.6
human face 98.8
person 98.7
fashion accessory 97.4
text 96.9
fedora 92.9
clothing 91
hat 87.1
portrait 86.8
cowboy hat 86.8
sun hat 74.2
human beard 65.4
black and white 51

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 54-62
Gender Male, 100%
Calm 99.6%
Sad 0.2%
Confused 0.1%
Angry 0%
Happy 0%
Fear 0%
Disgusted 0%
Surprised 0%

Microsoft Cognitive Services

Age 62
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Hat 100%
Person 98.3%

Captions

Microsoft

a man wearing a hat 93.7%
a man wearing a hat looking at the camera 91.1%
a man wearing a hat and looking at the camera 91%

Text analysis

Amazon

NAGUA
AACA

Google

VAIM CA
VAIM
CA