Human Generated Data

Title

Susquehanna Hotel, Self-portrait in a third-floor room with grass
Date

1966-7, printed later
People

Artist: Danny Lyon, American born 1942
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Jennifer Speciale and family, 2022.420
Copyright

© Danny Lyon/Magnum Photos

Human Generated Data

Title

Susquehanna Hotel, Self-portrait in a third-floor room with grass

People

Artist: Danny Lyon, American born 1942

Date

1966-7, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Jennifer Speciale and family, 2022.420

Copyright

© Danny Lyon/Magnum Photos

Machine Generated Data

Tags

Amazon
created on 2023-06-28

Adult 99.5
Male 99.5
Man 99.5
Person 99.5
Clothing 87.3
Footwear 87.3
Shoe 87.3
Bench 78.7
Furniture 78.7
Accessories 75.6
Belt 75.6
Home Damage 64.2
Architecture 57.4
Building 57.4
Wall 57.4
Mold 57.3
Rubble 55.8
Ruins 55.5
Outdoors 55.4
Shelter 55.4
Bunker 55.1

Clarifai
created on 2023-10-13

abandoned 99.5
decay 97.7
people 96.4
house 95.9
home 95.7
street 94.4
broken 93.6
room 93.5
old 93.5
derelict 93.4
monochrome 92.8
vintage 92.5
building 92.3
no person 91.7
family 91.6
black and white 90.3
disrepair 90.1
decline 87.9
ravage 86
architecture 85.9

Imagga
created on 2023-06-28

old 49.5
cell 48.3
building 40.9
architecture 39.2
wall 37.1
stone 35.2
ancient 34.6
door 29.2
prison 28
brick 26.5
house 24.3
window 24
history 23.3
correctional institution 20.9
aged 17.2
construction 17.1
travel 16.9
abandoned 16.6
street 16.6
penal institution 15.7
antique 15.6
city 15
structure 14.9
town 14.9
tourism 14
exterior 13.8
ruin 13.6
dirty 13.6
broken 13.5
vintage 13.2
entrance 12.6
wood 12.5
texture 12.5
medieval 12.5
tunnel 12.2
culture 12
grunge 11.9
institution 11.4
urban 11.4
home 11.2
historic 11
arch 10.7
village 10.6
rustic 10.6
wooden 10.6
weathered 10.5
scene 10.4
dark 10
traditional 10
temple 10
road 9.9
ruins 9.7
detail 9.7
historical 9.4
monument 9.4
alley 9.3
industrial 9.1
tourist 9.1
landmark 9
interior 8.9
rural 8.8
closed 8.7
windows 8.6
rusty 8.6
passage 8.5
garage 8.2
metal 8.1
gate 8
cobblestone 7.9
empty 7.7
heritage 7.7
castle 7.7
mystery 7.7
middle 7.7
frame 7.5
destination 7.5
place 7.5
light 7.4
design 7.3
scenery 7.2
ashcan 7.1
country 7
sky 7

Google
created on 2023-06-28

Black 89.5
Wood 86.8
Door 84.9
Style 83.8
Black-and-white 83.4
Line 81.7
Wall 81.1
Building 80.1
Adaptation 79.4
Rural area 77.2
Tints and shades 77.2
Monochrome 73.8
Monochrome photography 73.5
Grass 72.1
Room 68.2
House 59
Landscape 58.5
Rectangle 58.1
Still life photography 57.5
Darkness 56.4

Microsoft
created on 2023-06-28

outdoor 96.8
black and white 92.6
abandoned 92
building 87.7
decay 78.1
old 73.4
monochrome 68.4
white 62.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 24-34
Gender Male, 100%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0.1%
Confused 0%
Happy 0%
Disgusted 0%

Microsoft Cognitive Services

Age 37
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Adult 99.5%
Male 99.5%
Man 99.5%
Person 99.5%
Shoe 87.3%
Bench 78.7%
Belt 75.6%

Captions

Microsoft
created on 2023-06-28

an old photo of a building 81%
an old photo of a house 80.9%
old photo of a building 76%