Human Generated Data

Title

Mr. G., 70, Attorney
Date

1974 (printed 1998)
People

Artist: Timm Rautert, German born 1941
Classification

Photographs
Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Purchased through the generosity of Günther Engler, Werner and Jutta Pottbrock, Lothar and Christiane Pues, and the Antonia Paepcke DuBrul Fund, 2012.7.7
Copyright

© Timm Rautert

Human Generated Data

Title

Mr. G., 70, Attorney

People

Artist: Timm Rautert, German born 1941

Date

1974 (printed 1998)

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Clothing 98.1
Apparel 98.1
Person 94.3
Human 94.3
Overcoat 88.9
Fashion 79.3
Robe 74
Coat 73.4
Photography 61.5
Portrait 61.5
Photo 61.5
Face 61.5
Costume 60.8
Footwear 60.7
Shoe 60.7
Standing 56.3

Clarifai
created on 2018-03-16

gown 99.4
portrait 98.4
one 98.1
fashion 97.9
wear 97.8
adult 95.9
man 94.3
model 92.6
people 92.2
gown (clothing) 89.5
woman 84.5
fashionable 83.8
collection 82.6
lid 82
accomplishment 80.3
menswear 80.3
gentleman 78.5
graduation 78.2
cap 77.7
ceremony 76.7

Imagga
created on 2018-03-16

suit 59.2
clothing 54.5
academic gown 43.3
gown 42.5
man 41
male 39
businessman 37.1
business 34
person 31.5
people 30.7
covering 29.3
garment 29
outerwear 28.6
executive 27.9
adult 26.7
portrait 26.5
tie 25.6
mortarboard 25.3
cap 24.3
success 24.1
handsome 24.1
consumer goods 23.7
professional 23.7
confident 23.7
happy 23.2
black 22.7
smiling 21.7
corporate 21.5
smile 20
successful 18.3
standing 18.3
attractive 18.2
work 18.1
headdress 17.2
robe 17.2
men 17.2
job 16.8
office 16.1
hand 16
holding 15.7
face 15.6
fashion 15.1
model 14.8
dress 14.5
kimono 13.4
formal 12.4
lifestyle 12.3
one 11.9
expression 11.9
alone 11.9
style 11.9
happiness 11.8
boss 11.5
jacket 11.5
judge 11.4
guy 11.3
clothes 11.2
shirt 11.2
looking 11.2
manager 11.2
elegant 11.1
women 11.1
studio 10.6
modern 10.5
pretty 10.5
human 10.5
mature 10.2
20s 10.1
worker 10
sexy 9.6
education 9.5
career 9.5
casual 9.3
company 9.3
friendly 9.1
couple 8.7
confidence 8.6
smart 8.5
coat 8.4
outdoors 8.2
outside 7.7
cloak 7.4
cheerful 7.3

Google
created on 2018-03-16

academic dress 89.1
formal wear 87.9
robe 80.7
standing 77.7
outerwear 75
gentleman 72.8
professional 69.8
suit 68.8
tuxedo 52.5

Microsoft
created on 2018-03-16

clothing 98.5
man 96.7
black 96.4
standing 95.2
person 93.8
indoor 91.6
suit 91.2
dressed 50.5
posing 49.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 57-77
Gender Male, 97.8%
Surprised 1.8%
Angry 2%
Sad 2.9%
Calm 71.2%
Disgusted 1.1%
Confused 2.9%
Happy 18%

Microsoft Cognitive Services

Age 66
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 94.3%
Overcoat 88.9%
Coat 73.4%
Shoe 60.7%

Captions

Microsoft

a man wearing a black dress 92.3%
a man wearing a suit and tie 92.2%
a man wearing a black suit 92.1%