Human Generated Data

Title

Untitled (Elizabeth Street, New York City)
Date

1932-1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2913
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Elizabeth Street, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2913

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Face 100
Head 100
Photography 100
Portrait 100
Blouse 99.9
Clothing 99.9
Person 99.6
Adult 99.6
Bride 99.6
Female 99.6
Wedding 99.6
Woman 99.6
Person 99.4
Adult 99.4
Female 99.4
Woman 99.4
Architecture 92.8
Building 92.8
Hospital 92.8
Lady 57.9
Clinic 57.8
Chair 56.1
Furniture 56.1
Happy 55.6
Smile 55.6
Glove 55.3

Clarifai
created on 2018-05-10

people 99.9
adult 99.1
one 98.4
portrait 98.1
administration 96.3
two 95.6
woman 95.3
wear 94.4
man 92.1
sit 91.8
facial expression 89.4
leader 88.9
group 85.5
music 84.3
retro 83.9
actress 82.2
actor 81.2
war 77.5
three 77
musician 74.5

Imagga
created on 2023-10-06

portrait 31.7
person 28.2
people 27.3
man 26.9
adult 26.6
happy 23.2
lifestyle 21
sexy 20.9
male 20.7
hair 20.6
fashion 20.3
couple 20
face 19.9
senior 19.7
love 18.9
attractive 18.9
model 18.7
body 18.4
pretty 18.2
human 17.2
mother 17
old 16.7
plunger 16.6
together 15.8
smile 15.7
women 15
happiness 14.9
lady 14.6
elderly 14.4
one 14.2
hand tool 13.7
home 13.6
smiling 13
grandma 12.7
dress 12.6
sensual 11.8
crazy 11.7
posing 11.5
parent 11.4
brunette 11.3
shower 10.8
healthy 10.7
handsome 10.7
retired 10.7
room 10.5
boy 10.4
two 10.2
wet 9.8
husband 9.8
black 9.6
retirement 9.6
hands 9.6
skin 9.6
tool 9.5
men 9.4
device 9.4
guy 9.4
blond 9.4
water 9.3
mature 9.3
relaxation 9.2
health 9
gray 9
fun 9
eye 8.9
family 8.9
urban 8.7
cute 8.6
eyes 8.6
expression 8.5
togetherness 8.5
head 8.4
elegance 8.4
joy 8.3
emotion 8.3
care 8.2
girls 8.2
sensuality 8.2
looking 8
grandfather 7.7
sitting 7.7
elegant 7.7
females 7.6
erotic 7.6
dark 7.5
leisure 7.5
style 7.4
joyful 7.3
cheerful 7.3
gorgeous 7.2
aged 7.2
beard 7.2
interior 7.1
modern 7

Google
created on 2018-05-10

photograph 96.1
white 95.8
person 93.3
black and white 89.4
vintage clothing 83.4
standing 83
snapshot 81.8
monochrome photography 77.2
portrait 69.2
monochrome 68.4
family 62.8
retro style 57.8
history 54.8
smile 54.6
pattern 54.2
girl 54.2

Microsoft
created on 2018-05-10

person 99.7
woman 94.5
white 64.3
posing 63.4
old 59.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-33
Gender Female, 100%
Happy 96.2%
Surprised 6.5%
Fear 5.9%
Sad 2.2%
Calm 1.7%
Disgusted 0.6%
Confused 0.4%
Angry 0.3%

AWS Rekognition

Age 47-53
Gender Female, 99.8%
Calm 62.9%
Happy 24.8%
Surprised 6.9%
Fear 6.3%
Sad 4.2%
Confused 2.7%
Angry 1.6%
Disgusted 1%

Microsoft Cognitive Services

Age 64
Gender Male

Microsoft Cognitive Services

Age 48
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Adult
Bride
Female
Woman
Person 99.6%
Person 99.4%
Adult 99.6%
Adult 99.4%
Bride 99.6%
Female 99.6%
Female 99.4%
Woman 99.6%
Woman 99.4%

Categories

Imagga

people portraits 94.2%
paintings art 4.5%

Captions

Microsoft
created on 2018-05-10

a black and white photo of a woman 96.1%
a man and a woman posing for a photo 91%
a man and woman posing for a photo 88.5%

Clarifai
created by general-english-image-caption-blip on 2025-05-03

a photograph of a woman sitting on a chair in a room -100%

Text analysis

Amazon

TH
AR