Human Generated Data

Title

Untitled (portrait of Horace Pippin)
Date

1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5173
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (portrait of Horace Pippin)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Tie 99.9
Accessories 99.9
Accessory 99.9
Person 98.2
Human 98.2
Face 94.4
Text 86.6
Head 79.5
Clothing 77.7
Apparel 77.7
Suit 66.1
Coat 66.1
Overcoat 66.1
Portrait 66
Photography 66
Photo 66
Leisure Activities 55.1

Imagga
created on 2022-01-23

bow tie 58
male 53.3
necktie 50.6
man 50.5
person 42
portrait 40.2
adult 35.8
professional 35.3
garment 34.9
businessman 34.5
people 34.1
doctor 33.9
handsome 33.1
looking 29.7
coat 28.9
stethoscope 28.7
lab coat 28.4
medical 28.3
smiling 28.3
medicine 26.5
hospital 26.4
smile 25
business 25
face 24.9
one 23.9
success 23.4
clothing 23.2
men 22.4
mature 22.4
work 21.2
specialist 21
senior 20.7
care 20.6
glasses 20.4
office 20.1
happy 20.1
suit 19.9
health 19.5
standing 18.3
executive 18
successful 17.4
job 16.8
confident 16.4
serious 16.2
nurse 16.2
tie 16.2
human 15.8
elderly 15.4
casual 15.3
attractive 14.7
cheerful 14.7
uniform 14.5
shirt 14
worker 14
corporate 13.8
studio 13.7
hand 13.7
clinic 13.4
guy 13.4
old 13.3
expression 12.8
friendly 11.9
hair 11.9
head 11.8
happiness 11.8
physician 11.7
confidence 11.5
working 11.5
practitioner 11.2
color 11.2
occupation 11
gray 10.8
closeup 10.1
modern 9.8
expertise 9.7
boss 9.6
smart 9.4
natural 9.4
instrument 9.4
student 9.4
model 9.4
black 9
jacket 9
middle aged 8.8
examination 8.8
lifestyle 8.7
exam 8.6
thinking 8.6
alone 8.2
aged 8.2
mug shot 8
look 7.9
authority 7.9
clinical 7.8
consultant 7.8
lab 7.8
mid adult 7.7
retirement 7.7
profession 7.7
staff 7.7
formal 7.7
only 7.7
age 7.6
manager 7.5
single 7.4
camera 7.4
positive 7.4
indoor 7.3
computer 7.2
bright 7.2

Google
created on 2022-01-23

Forehead 98.5
Photograph 94.2
Jaw 88.1
Dress shirt 88
Tie 86.6
Sleeve 86.2
Collar 84
Blazer 78
Suit 73
White-collar worker 72.3
Monochrome photography 71.6
Monochrome 70.4
Formal wear 69.6
Art 66.2
Stock photography 65.6
Vintage clothing 64.6
Uniform 60.8
History 59.5
Portrait 58.2
Portrait photography 56.8

Microsoft
created on 2022-01-23

text 99.9
man 99.5
person 99.2
human face 97.4
suit 95.2
posing 93.3
old 88
wearing 87.6
tie 87.3
portrait 86
clothing 84.4
black and white 81.4
smiling 80.5
sketch 55
vintage 46

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 39-47
Gender Male, 90.9%
Calm 33.5%
Confused 23.1%
Sad 20.4%
Surprised 10.1%
Happy 9.3%
Disgusted 1.7%
Fear 1%
Angry 0.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.9%
Person 98.2%
Suit 66.1%

Captions

Microsoft

a vintage photo of a smiling man wearing a suit and tie 97.2%
a vintage photo of a man wearing a suit and tie 97.1%
a man wearing a suit and tie smiling at the camera 97%

Text analysis

Amazon

11587
11587.
I
CTEELA-UUVR

Google

11587. 11587 VEEIA KULV 11587.
11587.
11587
VEEIA
KULV