Human Generated Data

Title

Untitled (New York City)
Date

1932-1934
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2884
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2884

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Clothing 100
Coat 99.9
Coat 99.7
Adult 99.5
Male 99.5
Man 99.5
Person 99.5
Overcoat 99.5
Adult 99
Male 99
Man 99
Person 99
Face 85.2
Head 85.2
Hat 60
Smoke 57.8
Jacket 57.1
Hat 57.1
Formal Wear 56.8
Suit 56.8
Blazer 56.4
Body Part 56
Hand 56
Cap 55.7

Clarifai
created on 2018-05-10

people 100
two 97.8
adult 97.7
group 96.9
wear 96.7
three 96.7
administration 96.4
man 96.2
group together 96
lid 94.9
outfit 94.2
veil 94.1
portrait 93.4
leader 93.4
military 93
four 91.5
several 88.3
woman 87.9
five 87.9
one 85.8

Imagga
created on 2023-10-05

military uniform 93.7
uniform 75.7
clothing 63.7
man 51.7
male 47.5
covering 38.7
consumer goods 38.2
suit 32.1
person 31.7
business 30.4
people 28.4
businessman 26.5
adult 25.9
men 24
hat 22.5
portrait 21.3
private 20.6
handsome 19.6
face 19.2
senior 18.7
corporate 17.2
worker 16.9
professional 16.2
success 16.1
office 16.1
commodity 15.8
happy 15.7
engineer 15.4
hand 15.2
tie 15.2
job 15
occupation 14.7
executive 14.1
standing 13.9
smiling 13.7
looking 13.6
casual 13.5
smile 13.5
work 13.3
shirt 13.1
jacket 12.8
mature 12.1
team 11.6
one 11.2
attractive 11.2
construction 11.1
expression 11.1
guy 11
confident 10.9
holding 10.7
architect 10.6
elderly 10.5
look 10.5
old 10.4
businesspeople 10.4
manager 10.2
black 10.2
coat 10
human 9.7
working 9.7
grandfather 9.7
couple 9.6
formal 9.5
serious 9.5
hair 9.5
career 9.5
color 9.4
lifestyle 9.4
model 9.3
indoor 9.1
trench coat 9
beard 8.8
mid adult 8.7
happiness 8.6
industry 8.5
meeting 8.5
modern 8.4
businesswoman 8.2
cheerful 8.1
group 8.1
eye 8
helmet 7.9
old-timer 7.9
confidence 7.7
employee 7.6
engineering 7.6
style 7.4
20s 7.3
successful 7.3
aged 7.2
raincoat 7.2
building 7.1
indoors 7

Google
created on 2018-05-10

photograph 95.7
standing 89.2
military officer 83.6
gentleman 83.4
black and white 82.6
military person 82.4
snapshot 81.8
vintage clothing 78.3
staff 71.7
monochrome photography 65.4
history 59.2
militia 58.3
station master 57.4
monochrome 54.5

Microsoft
created on 2018-05-10

person 99.8
outdoor 95.3
man 95.3
standing 94.7
old 92.6
military uniform 89.4
posing 76.8
people 72.6
suit 69.5
clothes 21.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 33-41
Gender Male, 100%
Calm 99.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Angry 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 42-50
Gender Male, 99.9%
Calm 75.1%
Sad 20%
Surprised 6.7%
Fear 6.1%
Confused 3.4%
Angry 2.3%
Disgusted 0.5%
Happy 0.2%

AWS Rekognition

Age 56-64
Gender Female, 85.1%
Sad 68.9%
Happy 22.6%
Calm 18.3%
Angry 16.4%
Surprised 7.5%
Fear 6.2%
Disgusted 5.6%
Confused 1.7%

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 52
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Coat 99.9%
Adult 99.5%
Male 99.5%
Man 99.5%
Person 99.5%
Hat 60%