Human Generated Data

Title

Two Women, Kingston Avenue, Brooklyn, New York City

Date

1950

People

Artist: N. Jay Jaffee, American 1921 - 1999

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of the Artist, P1998.112

Copyright

© The N. Jay Jaffee Trust. All rights reserved. Used by permission. www.njayjaffee.com

Human Generated Data

Title

Two Women, Kingston Avenue, Brooklyn, New York City

People

Artist: N. Jay Jaffee, American 1921 - 1999

Date

1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Apparel 100
Clothing 100
Person 98
Human 98
Overcoat 95.2
Shoe 91.8
Footwear 91.8
Person 88.5
Shoe 83.9
Shoe 81.7
Car 73.5
Vehicle 73.5
Automobile 73.5
Transportation 73.5
Coat 70.7
Coat 70.3
Bag 60.9
Suit 60.8
Female 56.9
Sleeve 56.3

Imagga
created on 2021-12-14

trench coat 81.6
raincoat 67.2
coat 59.5
military uniform 57
clothing 45.3
uniform 44.7
business 35.9
man 35
suit 33.6
male 31.2
businessman 28.3
people 27.4
adult 26.5
attractive 25.2
person 24.7
corporate 24.1
professional 23.6
job 21.2
garment 21
fashion 20.4
black 19.9
jacket 19.5
men 18.9
work 18.8
smile 18.5
city 18.3
pretty 18.2
street 17.5
women 17.4
hat 17
happy 16.9
success 16.9
office 16.9
portrait 16.8
urban 15.7
businesswoman 15.5
briefcase 15.1
holding 14.9
executive 14.8
building 14.3
standing 13.9
lifestyle 13.7
confident 13.7
worker 13.3
businesspeople 13.3
walking 13.3
bearskin 13
casual 12.7
handsome 12.5
model 12.5
walk 12.4
manager 12.1
expression 12
successful 11.9
smiling 11.6
boss 11.5
fashionable 11.4
face 11.4
stand 11.4
career 11.4
human 11.3
modern 11.2
20s 11
covering 10.9
lady 10.6
consumer goods 10.6
brunette 10.5
tie 10.4
looking 10.4
style 10.4
bag 10.4
architecture 10.2
student 10
outdoor 9.9
team 9.9
one 9.7
sales 9.6
outside 9.4
company 9.3
occupation 9.2
outdoors 9
group 8.9
working 8.8
suitcase 8.8
cute 8.6
meeting 8.5
smart 8.5
travel 8.5
stylish 8.1
sexy 8
posing 8
indoors 7.9
headdress 7.5
teamwork 7.4
phone 7.4
body 7.2
hair 7.1
happiness 7.1
autumn 7
look 7

Google
created on 2021-12-14

Clothing 98.7
Footwear 98.1
Overcoat 94.7
Photograph 94.2
Frock coat 91.4
Sleeve 87.2
Trench coat 86.6
Coat 86.5
Standing 86.4
Street fashion 84.5
Style 83.8
Collar 83.3
Duster 81
Blazer 78.2
Waist 74
Formal wear 73.5
Bag 71.1
Monochrome photography 70.8
High heels 70.4
Boot 70.1

Microsoft
created on 2021-12-14

text 99.8
coat 99.2
person 96.4
clothing 94.4
fashion 87.1
footwear 76.7
black 73
jacket 68.6
handbag 62.8
street fashion 61.5
trench coat 60.2
suit 53.7
posing 38.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 34-50
Gender Male, 82%
Angry 52.2%
Calm 22.6%
Confused 7.3%
Disgusted 7.1%
Surprised 4.9%
Fear 2.8%
Sad 1.6%
Happy 1.5%

AWS Rekognition

Age 34-50
Gender Male, 93.3%
Sad 55.9%
Calm 41.9%
Fear 1%
Confused 0.5%
Angry 0.4%
Surprised 0.1%
Happy 0.1%
Disgusted 0.1%

Microsoft Cognitive Services

Age 42
Gender Female

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98%
Overcoat 95.2%
Shoe 91.8%
Car 73.5%
Coat 70.7%

Captions

Microsoft

a person standing posing for the camera 91.2%
a person posing for the camera 91.1%
a person posing for a photo 84.1%