Human Generated Data

Title

Untitled (man with striped tie)

Date

1970s

People

Artist: Bachrach Studios, founded 1868

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.580

Human Generated Data

Title

Untitled (man with striped tie)

People

Artist: Bachrach Studios, founded 1868

Date

1970s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Tie 100
Accessories 100
Accessory 100
Suit 99.9
Coat 99.9
Overcoat 99.9
Apparel 99.9
Clothing 99.9
Human 99.1
Person 99.1
Face 92.2
Head 80.5
Necktie 68.3
Advertisement 66.9
Poster 64.9

Imagga
created on 2022-02-26

executive 94.1
businessman 76.2
business 54.8
man 53.9
suit 52
male 49.1
person 46.5
corporate 44.8
professional 39.4
men 38.8
office 38.7
handsome 38.5
people 36.4
portrait 35.1
manager 34.6
confident 31.9
secretary 30.9
success 30.7
happy 29.5
businesspeople 28.6
adult 28.5
successful 27.5
team 26.1
baron 25.4
smiling 25.4
boss 24
meeting 23.6
work 23.6
tie 22.8
judge 22.2
looking 21.7
senior 21.6
teamwork 21.4
face 21.4
mature 20.5
businessmen 19.6
standing 19.2
formal 19.2
businesswoman 19.1
job 18.6
smile 18.6
colleagues 16.6
leadership 16.4
expression 16.3
modern 16.2
worker 16.1
speaker 16
company 15.9
one 15.7
partnership 15.4
group 15.4
working 15.1
laptop 14.6
corporation 14.5
black 14.5
elderly 14.4
communication 14.3
desk 14.2
smart 14.2
old 14
occupation 13.8
computer 13.7
partner 13.6
confidence 13.4
career 13.3
glasses 13
studio 13
older 12.7
jacket 12.6
lawyer 12.5
articulator 12.3
cheerful 12.2
hand 12.2
entrepreneur 12.1
40s 11.7
partners 11.7
human 11.3
sitting 11.2
leader 10.6
employee 10.6
staff 10.6
serious 10.5
lifestyle 10.1
friendly 10.1
alone 10.1
colleague 9.8
together 9.7
adults 9.5
happiness 9.4
two 9.3
communicator 9.2
clothing 9
businessperson 8.8
table 8.7
collar 8.7
workplace 8.6
planner 8.6
one person 8.5
head 8.4
presentation 8.4
color 8.4
guy 8.3
holding 8.3
necktie 8.1
indoors 7.9
education 7.8
agreement 7.8
cooperation 7.8
mid adult 7.7
busy 7.7
30s 7.7
thinking 7.6
finance 7.6
horizontal 7.6
inside 7.4
indoor 7.3
gray 7.2
fresh 7.2
hair 7.2

Google
created on 2022-02-26

Tie 91.2
Coat 89.7
Dress shirt 89
Sleeve 87.2
Gesture 85.3
Collar 84.1
Suit 81.1
Blazer 78.3
Formal wear 74
Official 70.1
Art 69.2
Event 65.2
White-collar worker 65.2
Rectangle 56.8
Visual arts 55.5
Portrait 55.1
Wrinkle 53.4
Illustration 52.2
Self-portrait 50.9
History 50.6

Microsoft
created on 2022-02-26

wall 99.9
man 99.9
person 99.7
suit 99.6
text 97.5
tie 92.4
human face 90.7
indoor 87.3
clothing 85.3
posing 70

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 53-61
Gender Male, 100%
Calm 99.1%
Confused 0.2%
Angry 0.2%
Disgusted 0.2%
Happy 0.2%
Surprised 0.1%
Fear 0%
Sad 0%

Microsoft Cognitive Services

Age 57
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 100%
Suit 99.9%
Person 99.1%

Captions

Microsoft

a man wearing a suit and tie 98.9%
a man wearing a suit and tie smiling at the camera 98.2%
a man wearing a suit and tie smiling and looking at the camera 97.9%