Human Generated Data

Title

Bobby of the Lord Nelson, 46, Doorman
Date

1974 (printed 1998)
People

Artist: Timm Rautert, German born 1941
Classification

Photographs
Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Purchased through the generosity of Günther Engler, Werner and Jutta Pottbrock, Lothar and Christiane Pues, and the Antonia Paepcke DuBrul Fund, 2012.7.12
Copyright

© Timm Rautert

Human Generated Data

Title

Bobby of the Lord Nelson, 46, Doorman

People

Artist: Timm Rautert, German born 1941

Date

1974 (printed 1998)

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Apparel 99.9
Clothing 99.9
Overcoat 98.4
Coat 98.4
Jacket 97.9
Blazer 97.9
Person 96
Human 96
Suit 92.5

Clarifai
created on 2018-03-16

portrait 98.2
man 97.6
wear 97.4
one 97
fashion 95.8
people 94
business 93.1
adult 92.8
fashionable 87.2
outfit 86.7
jacket 85.5
fine-looking 85.5
retro 84.9
tie 84
model 83.1
actor 82.7
lid 80.4
contemporary 79.9
looking 79.8
pants 77.3

Imagga
created on 2018-03-16

suit 100
garment 100
clothing 100
consumer goods 67.2
covering 66.5
businessman 49.6
business 49.3
man 46.5
male 42
adult 40.8
corporate 39.6
standing 38.3
success 37.1
executive 37
handsome 36.6
professional 35.5
person 35
jacket 31.6
commodity 31.2
boss 29.7
people 29.6
portrait 29.2
confident 29.2
manager 28.9
tie 28.5
successful 27.5
work 26.8
office 24.2
studio 23.6
smile 23.6
job 23.1
looking 22.5
one 21.7
happy 21.4
worker 20.5
attractive 19.6
formal 19.2
businesswoman 19.1
smiling 18.9
expression 18.8
model 18.7
full 18.3
modern 17.6
stand 17.1
youth 17.1
smart 17
guy 16.6
elegant 16.3
casual 16.1
human 15.8
body 15.2
businesspeople 15.2
posing 15.1
fashion 15.1
holding 14.9
employee 14.4
20s 13.8
friendly 13.8
black 13.7
entrepreneur 13.1
hand 12.9
shirt 12.2
company 12.1
face 12.1
men 12.1
businessperson 11.7
briefcase 11.1
pose 10.9
fresh 10.5
career 10.4
necktie 10.2
lifestyle 10.1
length 9.8
pretty 9.1
style 8.9
attorney 8.9
vertical 8.8
brunette 8.7
women 8.7
collar 8.7
serious 8.6
finance 8.5
mature 8.4
occupation 8.3
bow tie 8.2
hands 7.8
attitude 7.8
corporation 7.7
confidence 7.7
twenties 7.7
fashionable 7.6
one person 7.6
camera 7.4
cheerful 7.3
lady 7.3
student 7.3
working 7.1
indoors 7

Google
created on 2018-03-16

suit 96.5
formal wear 93.7
coat 87.2
overcoat 86.8
gentleman 86.7
standing 85.4
tuxedo 74.8
outerwear 73
blazer 60.8
facial hair 52.9
professional 50.1

Microsoft
created on 2018-03-16

person 98.8
suit 96.3
standing 96.2
clothing 95.6
posing 56.6
dressed 52.6
clothes 20.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 49-69
Gender Male, 94.1%
Sad 2.3%
Surprised 4%
Calm 3.6%
Happy 82.9%
Angry 2%
Disgusted 2.1%
Confused 3.2%

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96%

Captions

Microsoft

a man wearing a suit and tie 96.4%
a man wearing a suit and tie posing for a picture 96.3%
a person standing posing for the camera 93.9%