Human Generated Data

Title

Untitled (New York City)
Date

1932-1934
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2878
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2878

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Formal Wear 100
Coat 100
Sun Hat 99.5
Adult 99.1
Male 99.1
Man 99.1
Person 99.1
Adult 99
Male 99
Man 99
Person 99
Hat 98.2
Adult 97.3
Male 97.3
Man 97.3
Person 97.3
Face 94.7
Head 94.7
Person 93.8
Person 91.2
Suit 89.8
Shirt 86.1
Hat 85.5
Photography 81.3
Portrait 81.3
Accessories 60.4
Tie 60.4
Suit 60.1
Tuxedo 57
Overcoat 55.9
Cap 55.7

Clarifai
created on 2018-05-10

people 99.9
adult 98.7
two 98.3
group 98.2
man 98.2
group together 98.2
wear 95.8
outfit 95.5
three 95.3
lid 93.9
administration 93.7
leader 93.4
several 92.8
veil 92.3
uniform 90.8
four 90.8
portrait 90.3
movie 89.2
many 88.8
one 88.5

Imagga
created on 2023-10-06

man 54.4
male 39.7
person 34.6
people 30.1
work 25.1
business 24.3
professional 22
face 21.3
office 21
men 20.6
businessman 20.3
adult 19.7
portrait 18.1
sitting 18
worker 17.3
suit 17
job 16.8
bartender 16.3
looking 16
senior 15.9
occupation 15.6
table 15.6
lifestyle 15.2
happy 15
look 14.9
tie 14.2
black 13.8
hat 13.5
call 13.3
smiling 13
mature 13
glasses 13
corporate 12.9
smile 12.8
restaurant 12.8
serious 12.4
working 12.4
shop 12.3
clothing 12.1
coat 11.9
old 11.8
confident 11.8
handsome 11.6
engineer 11.6
holding 11.6
indoors 11.4
hand 11.4
executive 11.4
desk 11.3
barbershop 11.1
guy 10.5
computer 10.4
attractive 9.8
necktie 9.7
medical 9.7
study 9.3
manager 9.3
building 9.2
scientist 8.8
chemistry 8.7
education 8.7
happiness 8.6
college 8.5
meeting 8.5
shirt 8.4
employee 8.4
phone 8.3
one 8.2
laptop 8.2
bow tie 8.1
hair 7.9
student 7.9
conversation 7.8
talk 7.7
exam 7.7
elderly 7.7
profession 7.7
career 7.6
mercantile establishment 7.5
focus 7.4
tool 7.4
indoor 7.3
alone 7.3
group 7.3
success 7.2
color 7.2
team 7.2

Google
created on 2018-05-10

photograph 96.2
black and white 91.9
monochrome photography 84.8
standing 84.3
gentleman 84.1
vintage clothing 82.9
photography 81.9
snapshot 81.8
monochrome 72.4
headgear 71.4
human behavior 66.2
military officer 58.3
stock photography 57
film noir 54.1
military person 50.6

Microsoft
created on 2018-05-10

person 100
man 99.7
hat 87.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 34-42
Gender Male, 100%
Calm 99.2%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.3%
Disgusted 0.2%
Happy 0.1%
Angry 0.1%

Microsoft Cognitive Services

Age 28
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Adult 99.1%
Male 99.1%
Man 99.1%
Person 99.1%
Hat 98.2%
Suit 89.8%

Categories

Imagga

people portraits 97.3%
events parties 1.2%

Captions

Microsoft
created on 2018-05-10

a man wearing a hat 95.4%
a man wearing a suit and hat 95.3%
a man wearing a black hat 93.9%

Text analysis

Amazon

TH'S
SMITHS
9
A
M
ND
7P
SA TH'S
8 A ND UMA
1
600
8
Behing
UMA
SA