Human Generated Data

Title

Broadway Ballyhoo

Date

c. 1940-1941, printed later

People

Artist: Aaron Siskind, American 1903 - 1991

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Carl Chiarenza and Heidi Katz, P2000.110

Copyright

© Estate of Aaron Siskind

Human Generated Data

Title

Broadway Ballyhoo

People

Artist: Aaron Siskind, American 1903 - 1991

Date

c. 1940-1941, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Carl Chiarenza and Heidi Katz, P2000.110

Copyright

© Estate of Aaron Siskind

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Clothing 99.9
Apparel 99.9
Overcoat 98.5
Coat 98.5
Person 98.4
Human 98.4
Person 97.6
Person 93.1
Poster 92.4
Advertisement 92.4
Person 90.5
Person 87.5
Suit 73.4
Tuxedo 64.8
Person 61.3
Text 59.8
Face 58.7
Billboard 57.3

Clarifai
created on 2023-10-26

people 99.9
adult 97.8
man 97.5
administration 97.2
group 97
leader 96.9
monochrome 96.7
lid 94.9
veil 94.8
group together 94.1
street 93.8
one 93.8
portrait 93.3
two 92.3
newspaper 89.5
outfit 88.4
fedora 87.3
vehicle 86.3
war 84.9
wear 83.7

Imagga
created on 2022-01-23

barbershop 100
shop 100
mercantile establishment 82.4
place of business 55
establishment 28.4
building 25.8
sign 21.1
office 20.1
city 17.5
business 15.2
house 15
architecture 14.8
daily 14.1
old 13.2
home 12.8
road 11.7
door 11.4
finance 11
financial 10.7
urban 10.5
street 10.1
man 10.1
wall 9.4
window 9.3
sale 9.2
transportation 9
sky 8.9
travel 8.4
bank 8.1
businessman 7.9
entrance 7.7
closed 7.7
industry 7.7
estate 7.6
historic 7.3
success 7.2
working 7.1

Google
created on 2022-01-23

Hat 89
Font 80.6
Sun hat 79.2
Blazer 76.6
Overcoat 74.9
Fedora 74.8
Suit 74.4
Trench coat 74
Curtain 72.4
Monochrome photography 71.3
Monochrome 70.2
Poster 68.1
Street fashion 65.7
Art 64.3
Vintage clothing 64.3
Advertising 62.1
Room 59.6
Rectangle 55.1
Uniform 55
History 54.1

Microsoft
created on 2022-01-23

text 98.8
clothing 98.2
person 97.1
man 93.1
black and white 82.7
poster 60.2
suit 50

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 22-30
Gender Female, 100%
Calm 77.2%
Angry 5.2%
Happy 4.8%
Surprised 4.3%
Confused 4%
Disgusted 1.7%
Sad 1.5%
Fear 1.2%

AWS Rekognition

Age 23-31
Gender Female, 99.9%
Calm 98.4%
Surprised 0.6%
Sad 0.3%
Angry 0.3%
Happy 0.3%
Disgusted 0.1%
Fear 0.1%
Confused 0.1%

AWS Rekognition

Age 45-53
Gender Male, 100%
Calm 97.8%
Sad 1.7%
Confused 0.2%
Happy 0.1%
Angry 0.1%
Surprised 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 54-62
Gender Male, 99.7%
Happy 95.5%
Calm 1.7%
Angry 1.6%
Surprised 0.4%
Disgusted 0.4%
Fear 0.2%
Confused 0.1%
Sad 0.1%

AWS Rekognition

Age 9-17
Gender Female, 88.2%
Sad 59.1%
Happy 11.4%
Confused 10.1%
Surprised 6.4%
Calm 5.8%
Fear 2.5%
Angry 2.5%
Disgusted 2.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%
Poster 92.4%
Suit 73.4%

Categories

Imagga

paintings art 99.4%

Captions

Microsoft
created on 2022-01-23

a person standing in front of a bus 30.4%

Text analysis

Amazon

GRAPES
AND
BLONDE
AND 21"
LYNN
they
SHARE
THEY
BARI-JOAN
WILCOXON
21"
PLUS
thing
But
one
WICH
MEN
THEIR
Good
Sport?
John
THE
But one thing they dont share.. THEIR MEN
FROCKS-
"FREE. BLONDE
dont
PLUS John Steinbecks
Little
"FREE.
THEY SHARE STOCKINGS.LIPSTICK. FROCKS-
share..
LYNN BARI-JOAN DAVISHENRY WILCOXON
Little . Good Sport?
Steinbecks
GRAPES OF WRATH
Or A Good
15
STOCKINGS.LIPSTICK.
OF
WRATH
Or A
ens
.
DAVISHENRY
Shell
Unite
Unite Girls
Girls

Google

ens THEY SHARE STOCKINGS. LIPSTICK. FROCKS-I But one thing they dont skare...THEIR MEN! WICH A Good e Spert Or A FREE.BLONDE AND 21 LYNN BARI-JOAN DAVIS HENRY WILCOXON PLUS im Samnch. GRAPESOF WRATI
ens
THEY
SHARE
STOCKINGS.
LIPSTICK.
FROCKS-I
But
one
thing
they
dont
skare...THEIR
MEN!
WICH
A
Good
e
Spert
Or
FREE.BLONDE
AND
21
LYNN
BARI-JOAN
DAVIS
HENRY
WILCOXON
PLUS
im
Samnch.
GRAPESOF
WRATI