Human Generated Data

Title

Broadway Ballyhoo

Date

c. 1940-1941, printed later

People

Artist: Aaron Siskind, American 1903 - 1991

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Carl Chiarenza and Heidi Katz, P2000.110

Copyright

© Estate of Aaron Siskind

Human Generated Data

Title

Broadway Ballyhoo

People

Artist: Aaron Siskind, American 1903 - 1991

Date

c. 1940-1941, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Apparel 99.9
Clothing 99.9
Overcoat 98.5
Coat 98.5
Person 98.4
Human 98.4
Person 97.6
Person 93.1
Advertisement 92.4
Poster 92.4
Person 90.5
Person 87.5
Suit 73.4
Tuxedo 64.8
Person 61.3
Text 59.8
Face 58.7
Billboard 57.3

Imagga
created on 2022-01-23

shop 100
barbershop 100
mercantile establishment 82.4
place of business 55
establishment 28.4
building 25.8
sign 21.1
office 20.1
city 17.5
business 15.2
house 15
architecture 14.8
daily 14.1
old 13.2
home 12.8
road 11.7
door 11.4
finance 11
financial 10.7
urban 10.5
street 10.1
man 10.1
wall 9.4
window 9.3
sale 9.2
transportation 9
sky 8.9
travel 8.4
bank 8.1
businessman 7.9
entrance 7.7
closed 7.7
industry 7.7
estate 7.6
historic 7.3
success 7.2
working 7.1

Google
created on 2022-01-23

Hat 89
Font 80.6
Sun hat 79.2
Blazer 76.6
Overcoat 74.9
Fedora 74.8
Suit 74.4
Trench coat 74
Curtain 72.4
Monochrome photography 71.3
Monochrome 70.2
Poster 68.1
Street fashion 65.7
Art 64.3
Vintage clothing 64.3
Advertising 62.1
Room 59.6
Rectangle 55.1
Uniform 55
History 54.1

Microsoft
created on 2022-01-23

text 98.8
clothing 98.2
person 97.1
man 93.1
black and white 82.7
poster 60.2
suit 50

Face analysis

Amazon

Google

AWS Rekognition

Age 22-30
Gender Female, 100%
Calm 77.2%
Angry 5.2%
Happy 4.8%
Surprised 4.3%
Confused 4%
Disgusted 1.7%
Sad 1.5%
Fear 1.2%

AWS Rekognition

Age 23-31
Gender Female, 99.9%
Calm 98.4%
Surprised 0.6%
Sad 0.3%
Angry 0.3%
Happy 0.3%
Disgusted 0.1%
Fear 0.1%
Confused 0.1%

AWS Rekognition

Age 45-53
Gender Male, 100%
Calm 97.8%
Sad 1.7%
Confused 0.2%
Happy 0.1%
Angry 0.1%
Surprised 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 54-62
Gender Male, 99.7%
Happy 95.5%
Calm 1.7%
Angry 1.6%
Surprised 0.4%
Disgusted 0.4%
Fear 0.2%
Confused 0.1%
Sad 0.1%

AWS Rekognition

Age 9-17
Gender Female, 88.2%
Sad 59.1%
Happy 11.4%
Confused 10.1%
Surprised 6.4%
Calm 5.8%
Fear 2.5%
Angry 2.5%
Disgusted 2.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%
Poster 92.4%
Suit 73.4%

Captions

Microsoft

a person standing in front of a bus 30.4%

Text analysis

Amazon

GRAPES
AND
BLONDE
AND 21"
LYNN
they
SHARE
THEY
BARI-JOAN
WILCOXON
21"
PLUS
thing
But
one
WICH
MEN
THEIR
Good
Sport?
John
THE
But one thing they dont share.. THEIR MEN
FROCKS-
"FREE. BLONDE
dont
PLUS John Steinbecks
Little
"FREE.
THEY SHARE STOCKINGS.LIPSTICK. FROCKS-
share..
LYNN BARI-JOAN DAVISHENRY WILCOXON
Little . Good Sport?
Steinbecks
GRAPES OF WRATH
Or A Good
15
STOCKINGS.LIPSTICK.
OF
WRATH
Or A
ens
.
DAVISHENRY
Shell
Unite
Unite Girls
Girls

Google

ens THEY SHARE STOCKINGS. LIPSTICK. FROCKS-I But one thing they dont skare...THEIR MEN! WICH A Good e Spert Or A FREE.BLONDE AND 21 LYNN BARI-JOAN DAVIS HENRY WILCOXON PLUS im Samnch. GRAPESOF WRATI
But
thing
dont
MEN!
A
STOCKINGS.
LIPSTICK.
WICH
AND
LYNN
DAVIS
THEY
FREE.BLONDE
HENRY
PLUS
Samnch.
SHARE
FROCKS-I
one
they
skare...THEIR
Or
WILCOXON
im
ens
Good
e
Spert
21
BARI-JOAN
GRAPESOF
WRATI