Human Generated Data

Title

Untitled (two men in formal wear posing)
Date

1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.432.3
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two men in formal wear posing)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-25

Clothing 99.6
Apparel 99.6
Coat 99.6
Overcoat 99.6
Person 99.6
Human 99.6
Person 99.5
Hat 99.5
Suit 98.5
Hat 98.2
Face 97.9
Suit 97.4
Tuxedo 93.6
Performer 89.8
Accessory 86.4
Tie 86.4
Accessories 86.4
People 81.8
Jacket 80.4
Blazer 80.4
Smile 73.7
Portrait 72.6
Photography 72.6
Photo 72.6
Man 71.6
Female 68.8
Girl 65.6
Wedding 57.9
Bridegroom 57.9
Glasses 55.3

Clarifai
created on 2019-03-25

people 99.8
adult 98.7
man 98.1
lid 98
two 97.5
veil 96.7
portrait 96.2
group together 95.5
retro 95.2
group 95.2
wear 94.3
three 92.6
administration 92.5
woman 92.4
facial expression 90.9
leader 90.3
movie 88.6
outfit 88
four 84.9
one 84.4

Imagga
created on 2019-03-25

suit 73.9
bow tie 66.8
necktie 57.5
man 53.1
clothing 48.7
garment 48.5
businessman 47.7
male 45.5
business 37.7
adult 33.6
person 32.7
portrait 30.4
executive 29.5
corporate 28.4
handsome 27.6
people 26.8
professional 25.5
covering 25.4
consumer goods 23.3
tie 22.8
military uniform 21.6
smile 21.4
confident 20.9
men 20.6
guy 19.8
success 19.3
office 19.3
standing 18.3
happy 18.2
manager 17.7
uniform 17.6
successful 17.4
smiling 17.4
groom 16.7
face 16.3
formal 16.2
expression 16.2
looking 16
mortarboard 15.5
work 14.9
businesswoman 14.5
one 14.2
smart 14.1
cap 14.1
elegant 13.7
worker 13.5
job 13.3
modern 12.6
boss 12.4
meeting 12.3
headdress 12.2
hat 12.2
hand 12.2
attractive 11.9
employee 11.8
colleagues 11.7
team 11.7
workplace 11.4
studio 11.4
couple 11.3
human 10.5
serious 10.5
black 10.5
group 10.5
businesspeople 10.4
building 10.3
happiness 10.2
model 10.1
communication 10.1
jacket 9.8
partners 9.7
outdoors 9.7
corporation 9.7
partnership 9.6
love 9.5
mature 9.3
head 9.2
fashion 9.1
colleague 8.8
businessmen 8.8
entrepreneur 8.7
boy 8.7
two 8.5
teamwork 8.3
glasses 8.3
phone 8.3
friendly 8.2
businessperson 7.8
outside 7.7
married 7.7
confidence 7.7
staff 7.7
career 7.6
joy 7.5
holding 7.4
wedding 7.4
cheerful 7.3
hair 7.1
look 7

Google
created on 2019-03-25

Photograph 96.1
Gentleman 85.6
Headgear 71.8
Hat 65.9
Photography 62.4
Fashion accessory 59.9
Vintage clothing 59
Suit 56.8
Black-and-white 56.4
Art 50.2

Microsoft
created on 2019-03-25

person 99.8
suit 98.9
outdoor 98.5
man 97.8
clothing 94.9
old 94.6
hat 86
military uniform 84.7
older 46.3
wedding 46.3
ceremony 3.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Female, 51.1%
Happy 77.6%
Calm 1.6%
Angry 3.3%
Disgusted 4.3%
Confused 5.4%
Surprised 5%
Sad 2.8%

AWS Rekognition

Age 23-38
Gender Male, 99%
Confused 3.2%
Angry 1%
Surprised 2.9%
Happy 86.7%
Calm 1.9%
Disgusted 2.4%
Sad 1.9%

Microsoft Cognitive Services

Age 23
Gender Male

Microsoft Cognitive Services

Age 33
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Hat 99.5%
Suit 98.5%
Tie 86.4%

Captions

Microsoft

a man wearing a suit and hat 99.3%
a vintage photo of a man wearing a suit and hat 98.4%
a man wearing a suit and tie and a hat 98.3%