Human Generated Data

Title

Untitled (New York City)
Date

1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2212
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2212

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2022-06-25

Person 99.6
Human 99.6
Clothing 83.3
Apparel 83.3
Face 66.9
Spoke 60.7
Machine 60.7
Pedestrian 59.7
City 58.7
Building 58.7
Town 58.7
Urban 58.7
Handrail 58.7
Banister 58.7
Text 57.8

Clarifai
created on 2023-10-29

people 99.9
one 99.5
adult 99.4
man 97.7
administration 97.3
leader 94.9
two 93.9
wear 91.6
portrait 91.1
vehicle 88.8
group together 87.6
three 87.1
facial expression 84.7
group 83.6
war 81.9
writer 81
monochrome 80.8
furniture 80.4
four 80.4
elderly 80.2

Imagga
created on 2022-06-25

barbershop 47.9
shop 42.4
man 38.3
scholar 37.2
person 35.2
male 33.3
mercantile establishment 32.9
intellectual 30.7
senior 30
people 23.4
old 23
place of business 21.9
adult 20
mature 19.5
elderly 19.1
portrait 18.1
retired 17.5
looking 16.8
indoors 16.7
home 16
business 15.8
grandfather 15.5
sitting 15.5
retirement 15.4
happy 15
lifestyle 14.5
pensioner 14.1
newspaper 13.5
businessman 13.2
face 12.8
smiling 12.3
couple 12.2
building 11.2
office 11.1
establishment 10.9
serious 10.5
one 10.5
men 10.3
work 10.2
architecture 10.2
alone 10
laptop 10
chair 9.9
close 9.7
computer 9.6
daily 9.6
together 9.6
smile 9.3
occupation 9.2
city 9.1
holding 9.1
product 9
70s 8.9
job 8.8
older 8.7
sculpture 8.7
wife 8.5
one person 8.5
casual 8.5
camera 8.3
confident 8.2
aged 8.1
cheerful 8.1
financial 8
to 8
hair 7.9
statue 7.8
half length 7.8
education 7.8
husband 7.6
relaxed 7.5
room 7.5
manager 7.4
glasses 7.4
gray 7.2
handsome 7.1
love 7.1
day 7.1

Google
created on 2022-06-25

Black 89.6
Sleeve 87.2
Black-and-white 85.9
Style 84
Monochrome 76
Monochrome photography 75.7
Snapshot 74.3
Vintage clothing 70.9
Font 67
Sitting 64.7
Stock photography 64.1
Street 61.2
Street fashion 59.3
History 58.2
Retro style 55.7
Wrinkle 52.1
Photography 51.7
Portrait photography 50.9
Classic 50.6

Microsoft
created on 2022-06-25

text 99.9
person 99.2
man 93.7
black and white 91.5
outdoor 89.5
newspaper 82.3
clothing 71
white 67.2
old 66.9
posing 45.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 53-61
Gender Male, 100%
Angry 75.6%
Calm 13.3%
Surprised 6.3%
Fear 6%
Sad 5.7%
Confused 3.4%
Disgusted 0.1%
Happy 0.1%

Microsoft Cognitive Services

Age 61
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Text analysis

Amazon

MURDER
BRENT
KAY
KAY FRANCIS
HAIRCUT
FRANCIS
GLORY
GREATER
THE
NO GREATER
NO
THE FLEET
FLEET
Sham
ANDY
POWELL
STRANDED
MURDER IN
APADE
BRUCE
WILL
GEO. BRENT
GRAND
IN
ST.
WATCH
PARKER
LIGHTS
OPERA
GEO.
TAYLON PARKER
TH
10-11-12
Day
GAINST
Only
TAYLON
GRAND 23RD OPERA HOUSE
HOUSE
13
&
for
& kerosene Sham
TUES
CROSSING
23RD
Virginia
TUES AUG 13
FRL
&SHAVE
kerosene
TAT"
ER. Virginia BRUCE
la
AUG
ST. & 8 TH AVE.
HARDT
SAT.
MON
AVE.
14-15-16
SAT. SUN & MON AUG 10-11-12
AUG.
HARDT la "TIT for TAT"
ER.
A FRL AUG. 14-15-16
RAFEIC LIGHTS
One Day Only
& 8
Haircut-Shaw
JEAN
ROGERS
SUN
1954
A
RAFEIC
ROBERT
FEBRAS
"TIT
160 FEBRAS
PRAVA
160
One
UNITED
PRAVA SOKLAGE'S
SOKLAGE'S

Google

WATCH LIFEIC LIGHTS ROSSING GAINST OPERA HOUSE 23RD ST. & 8TH AVE. SAT, SUN & MON AUG. 10-11-12 KAY FRANCIS MURDER IN THE FLEET GEO. BRENT STRANDED TAYLON PARKER One Day Only FRAM SORIAGES NO GREATER GLORY TUES. AUG 13 WILL ROGERS ANDY & FRL AUG. 14-15-16 POWELL APADE ER, Virginia BRUCE HARDY in "TIT for TAT ‘ HAIRCUT HAIRCUT &SHAVE Haircut-Shay & kerosene Sham
WATCH
LIFEIC
LIGHTS
ROSSING
GAINST
OPERA
HOUSE
23RD
ST
.
&
8TH
AVE
SAT
,
SUN
MON
AUG
10-11-12
KAY
FRANCIS
MURDER
IN
THE
FLEET
GEO
BRENT
STRANDED
TAYLON
PARKER
One
Day
Only
FRAM
SORIAGES
NO
GREATER
GLORY
TUES
13
WILL
ROGERS
ANDY
FRL
14-15-16
POWELL
APADE
ER
Virginia
BRUCE
HARDY
in
"
TIT
for
TAT
‘
HAIRCUT
SHAVE
Haircut
-
Shay
kerosene
Sham