Human Generated Data

Title

New York

Date

1940, printed later

People

Artist: Rudy Burckhardt, American 1914 - 1999

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Richard and Ronay Menschel Fund for the Acquisition of Photographs, P2002.1.2

Human Generated Data

Title

New York

People

Artist: Rudy Burckhardt, American 1914 - 1999

Date

1940, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 91.7
Human 91.7
Shop 87.4
Food 83.4
Meal 83.4
Person 72.3
Spoke 72.1
Machine 72.1
Person 68.8
Home Decor 67.9
Path 61.8
Walkway 61.8
Bakery 61.8
Tire 60.9
Cafe 56.4
Restaurant 56.4
Deli 56.1
Door 55.9
Car Wheel 55.4
Wheel 55.4

Imagga
created on 2022-01-08

scoreboard 100
board 90.6
signboard 83.1
blackboard 24.1
shop 21.9
barbershop 21
sign 18
black 18
chalk 16.6
chalkboard 15.7
building 15
structure 14.9
technology 14.8
old 14.6
mercantile establishment 14.4
business 14
wall 12
monitor 11.9
texture 11.8
digital 11.3
education 11.3
design 11.3
blank 11.1
grunge 11.1
dirty 10.8
school 10.8
retro 10.6
button 10.6
computer 10.3
vintage 9.9
station 9.8
information 9.7
place of business 9.6
antique 9.5
equipment 9.2
frame 9.2
hand 9.1
road 9
pattern 8.9
object 8.8
door 8.6
space 8.5
learn 8.5
display 8.5
electronic 8.4
horizontal 8.4
room 8.2
transportation 8.1
science 8
architecture 7.8
nobody 7.8
radio 7.8
travel 7.7
empty 7.7
memorial 7.7
screen 7.6
system 7.6
network 7.6
communication 7.6
house 7.5
billboard 7.5
security 7.3
message 7.3
rough 7.3
interior 7.1

Google
created on 2022-01-08

Window 87.6
Black-and-white 85
Style 83.9
Font 83.2
Rectangle 81.9
Building 81.5
Monochrome photography 74.7
Monochrome 73.8
Facade 73
Advertising 70.2
Room 66.2
Street 66.1
Town 62.6
Door 62.4
Art 62.2
Stock photography 62
Darkness 60.5
Signage 58
Glass 57
City 56.6

Microsoft
created on 2022-01-08

text 99.7
outdoor 97.3
street 94.4
black and white 88.8
waste container 60.6
monochrome 58.5
store 56.8
shop 56.3

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Male, 99.7%
Happy 44.3%
Sad 20%
Disgusted 11.3%
Angry 7%
Confused 6.9%
Surprised 4.5%
Fear 3.1%
Calm 2.9%

AWS Rekognition

Age 23-33
Gender Female, 99.9%
Calm 37.1%
Happy 31.4%
Sad 12%
Surprised 5.9%
Angry 4.5%
Disgusted 4.5%
Confused 3.5%
Fear 1.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 91.7%

Captions

Microsoft

a store sign on the side of a building 91.6%
a sign on the side of a building 91.1%
a store front at day 91%

Text analysis

Amazon

144
SHOP
VITA
BARBER SHOP
BARBER
NO
CORNS
EAGLE
Shave
Haircut Shave
Haircut
NO MORE CORNS
NO MORE
SIGNS
MORE
pain...
JERIS
KORNOFF
SHOW-CARDS
SWEETHEARTS
142
without pain...
2504
CALLOUSES
ENTRANCE
ERI
CHRISTMAS
FOR
First
ROMANCE
without
THE
"A
FUN
First Class Service
YOO
15
Class Service
"A CHRISTMAS CABOL"
cinema
FOR TI
25¢ 15
FUN OF
removes
H
TI
25¢
-
positively removes
- -
- cinema
COPPERFIELD
positively
CABOL"
OF
Gobiz
YMC
H Selsnick
TRATZ
A8
THEREY ROMANCE IN THE HAIR
HAIR
"DA ID COPPERFIELD
Selsnick
DOING
MARY
IN
AIR
me
THEREY
PER me MARY
IL..
it
IL.. 218A3HT33W2
AIR SONA
"DA ID
corns-callouses
OP
218A3HT33W2
3-
GOOMERCYPARK
PER
MEAMOUNT
Olivia
SONA

Google

EAGLE
Selanick
2TRA3HT
JERIS
Senvice
MORE
OF
YMC
#
THAT2
L
SHOW-CARDS
25
ERI
IOMANCE
MR
CORNS
SWEETHEARTS
pain.
FOR
COPPEEL
EAGLE 144 # Selanick SIGNS THAT2 L 2TRA3HT OBARBER SHOP SHOW-CARDS ENTRANCE Haircut Shave 25 15 ERI NITA THEES IOMANCE IN THE MR | JERIS NO MORE CORNS Rsl Class Senvice NO MORE CALLOUSES GuomERCY Pon Gaker KÕRNOFF A CHRICTMAS CAROL SWEETHEARTS positivcly removCS cornscallouscA without pain. FOR T SUN OF YMC AD COPPEEL
SHOP
THEES
IN
CALLOUSES
A
positivcly
cornscallouscA
SUN
144
ENTRANCE
Haircut
15
NITA
|
Rsl
Class
KÕRNOFF
CHRICTMAS
removCS
without
T
SIGNS
OBARBER
Shave
THE
NO
GuomERCY
Pon
Gaker
CAROL
AD