Human Generated Data

Title

Untitled (portrait of man in suit)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17439

Human Generated Data

Title

Untitled (portrait of man in suit)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Clothing 99.3
Apparel 99.3
Home Decor 98.2
Sleeve 97.9
Person 93.9
Human 93.9
Long Sleeve 91.6
Suit 87.1
Overcoat 87.1
Coat 87.1
Face 81.6
Accessory 81.2
Tie 81.2
Accessories 81.2
Linen 77.6
Shirt 70.9
Photography 67.2
Photo 67.2
Portrait 67.2
Man 59.2
Door 56.1
Tie 52.4

Imagga
created on 2022-02-26

lab coat 80.9
coat 80.6
doctor 63.1
stethoscope 54.3
medical 54
man 49.2
professional 49
male 48.3
specialist 47.2
person 45.3
hospital 44.3
medicine 38.8
portrait 37
people 34.7
uniform 34.6
handsome 34
garment 33.8
health 32.7
adult 31.4
care 31.3
nurse 31.3
job 31
smile 29.3
confident 29.2
clinic 28.8
occupation 27.6
mature 27
surgeon 26.9
practitioner 26.8
work 26.7
profession 24.9
physician 24.5
suit 24.2
smiling 23.9
happy 23.9
business 23.7
senior 23.5
office 23.3
looking 23.2
standing 22.7
businessman 21.2
clothing 19.4
friendly 19.3
successful 18.3
men 18.1
success 17.7
patient 17.7
baron 17.2
clinical 16.6
one 16.5
laboratory 16.4
elderly 16.3
worker 15.3
face 15
glasses 14.8
treatment 14.7
surgery 13.7
health care 13.6
executive 13.6
studio 12.9
human 12.8
healthy 12.6
exam 12.5
confidence 12.5
staff 12.5
tie 12.4
career 12.3
attractive 11.9
practice 11.6
formal 11.5
hand 11.4
modern 11.2
shirt 11.2
general 10.8
diagnosis 10.8
examination 10.7
lab 10.7
working 10.6
illness 10.5
old 10.5
hair 10.3
guy 10.3
casual 10.2
lifestyle 10.1
alone 10.1
bright 10
aged 10
doctors 9.9
cheerful 9.8
computer 9.6
corporate 9.5
smart 9.4
holding 9.1
black 9
intern 8.9
medic 8.8
older 8.8
sick 8.7
mid adult 8.7
30s 8.7
expression 8.5
indoor 8.2
natural 8
look 7.9
happiness 7.9
color 7.8
middle aged 7.8
expertise 7.8
only 7.7
serious 7.6
research 7.6
one person 7.6
technology 7.4
student 7.4
copy space 7.2
fresh 7.2
women 7.1
science 7.1
indoors 7

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

text 99.6
wall 98.5
clothing 89.1
man 88.7
person 86.8
human face 85.9
suit 76.2
smile 73.7
posing 35.2

Face analysis

Amazon

Google

AWS Rekognition

Age 25-35
Gender Male, 99.9%
Happy 63.3%
Surprised 12.8%
Calm 8.8%
Disgusted 5.3%
Confused 3.5%
Sad 2.4%
Angry 2.3%
Fear 1.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 93.9%
Suit 87.1%
Tie 81.2%

Captions

Microsoft

a person standing in front of a mirror posing for the camera 46.2%
a person standing in front of a mirror posing for the camera 46.1%
a person that is standing in front of a mirror posing for the camera 34.4%

Text analysis

Amazon

DICK
and
RE and DICK
3
RE
MJI7--YT37--

Google

13 MJI7--YT 37A°2- - AGON E ond DICK
ond
-
DICK
13
MJI7--YT
37A°2-
AGON
E