Human Generated Data

Title

Untitled (portrait of man in suit and glasses)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16517

Human Generated Data

Title

Untitled (portrait of man in suit and glasses)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Apparel 99.9
Clothing 99.9
Accessories 99.1
Accessory 99.1
Tie 99.1
Person 98.2
Human 98.2
Coat 97.7
Overcoat 97.7
Suit 95.8
Lab Coat 90.5
Tuxedo 78
Shirt 74.9
Curtain 65

Imagga
created on 2022-02-11

lab coat 100
coat 93.1
garment 51.1
man 50.5
male 46.9
person 43
professional 40.4
businessman 38.9
portrait 38.3
looking 36.1
doctor 35.8
people 34.6
adult 34.6
business 32.9
suit 32.4
smiling 31.9
clothing 31.8
office 31.4
executive 31.3
handsome 29.5
medical 29.2
specialist 28.9
hospital 28.3
happy 28.2
medicine 24.7
work 24.4
stethoscope 23.3
smile 22.1
confident 21.9
corporate 21.5
job 21.3
face 20.6
occupation 20.2
success 20.2
care 19.8
successful 19.2
standing 19.2
tie 19
worker 19
attractive 18.9
cheerful 18.7
one 18.7
health 18.1
uniform 18.1
men 18.1
senior 17.8
clinic 17.3
manager 16.8
mature 16.8
glasses 16.7
lifestyle 16.7
friendly 15.6
indoor 15.5
modern 15.4
casual 15.3
mid adult 14.5
nurse 14.2
desk 14.2
happiness 14.1
expression 13.7
human 13.5
women 13.5
formal 13.4
businesspeople 13.3
team 12.6
elderly 12.5
holding 12.4
hand 12.2
computer 12
businesswoman 11.8
expertise 11.7
laboratory 11.6
30s 11.6
working 11.5
bright 11.5
look 11.4
shirt 11.2
camera 11.1
laptop 11
lab 10.7
indoors 10.6
only 10.5
smart 10.4
phone 10.2
alone 10.1
studio 9.9
consultant 9.8
practitioner 9.7
1 9.7
leadership 9.6
confidence 9.6
serious 9.6
color 9.5
light 9.4
teamwork 9.3
student 9.2
doctors 8.9
physician 8.8
middle aged 8.8
couple 8.7
leader 8.7
career 8.5
one person 8.5
two 8.5
horizontal 8.4
positive 8.3
medic 7.9
clinical 7.8
40s 7.8
examination 7.8
colleagues 7.8
workers 7.8
corporation 7.7
using 7.7
old 7.7
profession 7.7
boss 7.7
research 7.6
company 7.5
technology 7.4
gray 7.2
home 7.2
science 7.1
day 7.1

Google
created on 2022-02-11

Microsoft
created on 2022-02-11

man 98.8
suit 98.4
person 97.3
text 97
indoor 92.7
tie 91.6
clothing 91
human face 87.3
shirt 72.2
black and white 59.5
posing 42

Face analysis

Amazon

Google

AWS Rekognition

Age 45-53
Gender Male, 99.9%
Calm 88.8%
Surprised 3.4%
Sad 3.4%
Confused 2.4%
Fear 0.9%
Angry 0.4%
Disgusted 0.4%
Happy 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.1%
Person 98.2%
Suit 95.8%

Captions

Microsoft

a man standing in front of a mirror posing for the camera 84.5%
a man that is standing in front of a mirror posing for the camera 76.4%
a man standing in front of a mirror 76.3%

Text analysis

Amazon

Z
MJ17--YT37--

Google

MJI3
ヨヨ
°
YT
MJI3--YTヨヨA°2--AGO
A
2
--
AGO