Human Generated Data

Title

Duffy Square, New York, N.Y.
Date

1947-1948, printed 1991
People

Artist: Louis Faurer, American 1916 - 2001
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Schneider/Erdman Printer's Proof Collection, partial gift, and partial purchase through the Margaret Fisher Fund, 2011.184
Copyright

© Estate of Louis Faurer

Human Generated Data

Title

Duffy Square, New York, N.Y.

People

Artist: Louis Faurer, American 1916 - 2001

Date

1947-1948, printed 1991

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Person 99.2
Human 99.2
Suit 96.8
Overcoat 96.8
Apparel 96.8
Coat 96.8
Clothing 96.8
Person 94.3
Asphalt 88.6
Tarmac 88.6
Tie 84.7
Accessory 84.7
Accessories 84.7
Suit 83.2
Pedestrian 72.9
Bag 71.4
Tuxedo 69.1
Sleeve 64.1
Tie 63.2
People 60.4
Female 57.5
Home Decor 55.1

Clarifai
created on 2018-03-23

people 99.7
adult 97.9
two 96.6
woman 96.6
group 95
man 94.5
administration 94.3
wear 92.9
actress 91.2
street 90.5
portrait 90.3
leader 88.9
music 88.9
group together 88.3
three 87.9
movie 87.3
actor 87.2
outfit 86.6
monochrome 84.3
musician 83.6

Imagga
created on 2018-03-23

suit 83.7
businessman 54.8
business 51
garment 50.7
man 49.1
male 44
clothing 41.8
professional 38.7
executive 37.3
corporate 35.2
office 32.9
person 30.1
black 29.5
people 29
adult 27.9
covering 27
job 24.8
work 23.6
success 23.3
men 23.2
handsome 23.2
tie 22.8
worker 22
consumer goods 21.6
attractive 20.3
formal 20.1
businesspeople 19.9
robe 18.5
businesswoman 18.2
meeting 17
hand 16
employee 15.4
career 15.1
fashion 15.1
standing 14.8
successful 14.6
building 14.3
guy 14.2
manager 14
hands 13.9
happy 13.8
handshake 13.7
confident 13.7
smile 13.5
working 13.3
portrait 12.9
businessmen 12.7
modern 12.6
communication 12.6
smiling 12.3
shirt 12.3
face 12.1
team 11.7
holding 11.6
necktie 11.4
style 11.1
jacket 10.9
corporation 10.6
outside 10.3
company 10.2
pretty 9.8
businessperson 9.8
human 9.8
outdoors 9.7
employment 9.7
partnership 9.6
looking 9.6
boss 9.6
talking 9.5
fashionable 9.5
elegant 9.4
day 9.4
teamwork 9.3
phone 9.2
indoors 8.8
colleagues 8.7
deal 8.7
agreement 8.7
women 8.7
lifestyle 8.7
diversity 8.7
sales 8.6
confidence 8.6
serious 8.6
workplace 8.6
clothes 8.4
mature 8.4
occupation 8.3
20s 8.2
stylish 8.1
dress 8.1
group 8.1
businesswomen 7.9
happiness 7.8
shake 7.8
expression 7.7
collar 7.7
profession 7.7
casual 7.6
finance 7.6
one 7.5
glasses 7.4
secretary 7.4
briefcase 7.3
indoor 7.3

Google
created on 2018-03-23

photograph 96.3
black 95.9
white 95.9
standing 93.4
black and white 93.2
monochrome photography 88.1
gentleman 85.4
photography 85.1
vintage clothing 82.2
snapshot 81.8
fashion 73.1
monochrome 71.4
suit 71
girl 70.3
human 67.9
formal wear 60.8
car 59.5
film noir 52.9
retro style 50.1

Microsoft
created on 2018-03-23

person 98.9
standing 90.9
suit 60.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 99.8%
Confused 4.1%
Sad 3.7%
Calm 34.4%
Happy 2.1%
Surprised 46.3%
Angry 5.1%
Disgusted 4.2%

AWS Rekognition

Age 35-52
Gender Male, 54.7%
Calm 48.3%
Angry 45.5%
Disgusted 45.7%
Happy 46.9%
Confused 45.3%
Surprised 45.3%
Sad 47.9%

Microsoft Cognitive Services

Age 20
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Suit 96.8%
Tie 84.7%

Captions

Microsoft

Catherine Hessling et al. standing next to a man in a suit and tie 95.6%
Catherine Hessling in a suit and tie 95.5%
Catherine Hessling et al. standing next to a man 88.9%