Human Generated Data

Title

Untitled (man in suit with cigarette)

Date

1950s

People

Artist: Jean Raeburn, American active 1950s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.1922

Human Generated Data

Title

Untitled (man in suit with cigarette)

People

Artist: Jean Raeburn, American active 1950s

Date

1950s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Tie 99.9
Accessories 99.9
Accessory 99.9
Suit 99.7
Clothing 99.7
Overcoat 99.7
Coat 99.7
Apparel 99.7
Person 98.4
Human 98.4
Tuxedo 78.8
Man 78
Face 73.7
Finger 67.5
Necktie 55.8

Imagga
created on 2022-01-23

suit 76.9
executive 75.9
businessman 73.6
corporate 66.4
business 59.8
man 53.3
professional 50.1
male 49.1
office 48.5
confident 42
person 38.9
people 37
businesspeople 36.2
successful 35.8
businesswoman 35.6
men 35.3
work 34.7
success 33.9
team 33.3
handsome 33.1
meeting 33.1
portrait 31.8
teamwork 30.7
job 30.2
adult 29.9
baron 29.4
smiling 29
happy 27.1
tie 26.7
smile 25.8
group 25.1
looking 24.9
garment 23.2
manager 22.4
confidence 22.1
businessmen 21.5
entrepreneur 21.5
corporation 21.3
colleagues 20.5
partnership 20.2
boss 20.2
employee 19.7
standing 19.2
secretary 19.1
worker 19.1
working 18.6
friendly 18.4
clothing 18.3
workplace 18.2
career 17.1
smart 17
communication 16.9
coworkers 16.8
building 16.7
formal 16.3
modern 16.2
company 15.9
computer 15.3
partners 14.6
leadership 14.5
staff 14.4
together 14.1
mature 14
laptop 13.7
leader 13.5
attractive 13.3
cheerful 13.1
face 12.8
workers 12.7
partner 12.6
one 12
planner 12
occupation 12
happiness 11.8
guy 11.8
cooperation 11.6
diversity 11.6
colleague 11.4
shirt 11.3
sitting 11.2
expression 11.1
lifestyle 10.9
black 10.9
consumer goods 10.9
covering 10.7
hand 10.7
hands 10.5
phone 10.2
20s 10.1
lawyer 10.1
businessperson 9.8
deal 9.8
indoors 9.7
serious 9.6
outside 9.5
contemporary 9.4
commerce 9.4
handshake 8.8
conference 8.8
management 8.8
busy 8.7
table 8.7
collar 8.7
elegant 8.6
groom 8.4
positive 8.3
light 8.1
women 7.9
bright 7.9
businesswomen 7.9
30s 7.7
two 7.7
casual 7.7
talking 7.6
fashionable 7.6
desk 7.6
human 7.5
outdoors 7.5
holding 7.5
natural 7.4
indoor 7.3
judge 7.2
look 7
model 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

person 100
man 99.8
suit 99.7
necktie 99.2
wearing 94
human face 93.9
tie 93.9
clothing 89.6
text 84.9
smile 73.4
black and white 67.9
portrait 59.2
posing 41.5
dressed 36.9
male 15.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-56
Gender Male, 99.8%
Happy 74.1%
Calm 21.3%
Confused 1.8%
Surprised 1.2%
Disgusted 0.5%
Fear 0.4%
Sad 0.4%
Angry 0.2%

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.9%
Suit 99.7%
Person 98.4%

Captions

Microsoft

a man wearing a suit and tie 99.3%
a man wearing a suit and tie smiling at the camera 98.6%
a man wearing a suit and tie looking at the camera 98.5%

Text analysis

Amazon

JEAN
JEAN RAEBURN, N.Y
RAEBURN, N.Y

Google

O JEAN RAEBURN, N. Y
O
JEAN
RAEBURN,
N.
Y