Human Generated Data

Title

Untitled (Fifteenth Street, New York City)
Date

1932-1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2900
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Fifteenth Street, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2900

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Formal Wear 100
Clothing 99.9
Dress 99.9
Adult 99.6
Bride 99.6
Female 99.6
Person 99.6
Wedding 99.6
Woman 99.6
Fashion 98.7
Gown 98.7
Coat 95.3
Hat 94.7
Wedding Gown 91.4
Lady 85.4
Face 85.3
Head 85.3
Suit 68.5
Brick 66.6
Machine 63.6
Wheel 63.6
Door 57.4
Furniture 57.1
Accessories 56.9
Photography 56.7
Portrait 56.7
Architecture 56.6
Building 56.6
Hospital 56.6
Standing 56
Bag 55.7
Handbag 55.7
Shop 55.5
Bridegroom 55.2
Male 55.2
Man 55.2

Clarifai
created on 2018-05-10

people 99.9
adult 98.7
one 97.8
wear 95
woman 93
man 92.6
administration 89.4
room 89.3
two 89.3
furniture 86.5
group 79.5
portrait 78.7
military 77.7
leader 77.5
movie 77.3
indoors 77.3
vehicle 74
outfit 72.8
home 72.6
actor 71.4

Imagga
created on 2023-10-06

rotisserie 73.2
oven 60
kitchen appliance 43.9
home appliance 29.5
old 23.7
safe 23.3
machine 20
door 19.9
cash machine 18.8
strongbox 18.4
box 18.2
building 16.9
man 16.8
male 15.6
device 15.4
wall 15.4
appliance 14.7
vintage 14
house 13.4
window 13.1
wood 12.5
industry 11.9
architecture 11.7
antique 11.4
home 11.2
people 11.1
container 10.9
industrial 10.9
person 10.8
worker 10.7
entrance 10.6
interior 10.6
aged 9.9
ancient 9.5
work 9.4
construction 9.4
equipment 9.2
historic 9.2
business 9.1
texture 9
retro 9
doorway 8.8
glass 8.6
fashion 8.3
dirty 8.1
steel 7.9
wooden 7.9
urban 7.9
standing 7.8
travel 7.7
men 7.7
structure 7.7
room 7.7
grunge 7.7
power 7.5
case 7.3
metal 7.2
detail 7.2
computer 7.2
history 7.1
working 7.1
indoors 7

Google
created on 2018-05-10

photograph 96.3
black 95.1
standing 90.5
black and white 88.4
photography 82.1
snapshot 81.8
vintage clothing 77.8
monochrome photography 75
monochrome 64.9
house 54.1
window 53.2

Microsoft
created on 2018-05-10

person 97.2
man 92.3
black 72.5
white 63.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 47-53
Gender Male, 67.6%
Calm 97.7%
Surprised 6.4%
Fear 5.9%
Sad 2.3%
Confused 0.5%
Happy 0.4%
Angry 0.3%
Disgusted 0.2%

Microsoft Cognitive Services

Age 50
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Adult
Bride
Female
Person
Woman
Wheel
Adult 99.6%
Bride 99.6%
Female 99.6%
Person 99.6%
Woman 99.6%
Wheel 63.6%

Captions

Microsoft
created on 2018-05-10

a black and white photo of a man 92.1%
a man standing in front of a window 91.3%
a man standing in front of a building 91.2%

Clarifai
created by general-english-image-caption-blip on 2025-05-15

a photograph of a woman in a white dress standing in front of a door -100%