Human Generated Data

Title

Untitled (Susanna Shahn)
Date

Spring 1937
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4380.5

Human Generated Data

Title

Untitled (Susanna Shahn)

People

Artist: Ben Shahn, American 1898 - 1969

Date

Spring 1937

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4380.5

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Wood 99.7
Floor 99.3
Flooring 99.3
Baby 97.7
Person 97.7
Furniture 96.9
Infant Bed 96.9
Architecture 93.3
Building 93.3
House 93.3
Housing 93.3
Porch 93.3
Face 93.1
Head 93.1
Baby 92.6
Person 92.6
Bed 77.2
Deck 72.6
Outdoors 63.7
Windmill 63.7
Handrail 60.3
Crib 60.3
Couch 57.9
Hardwood 57.7
Cradle 57.5
Box 56.2

Clarifai
created on 2018-05-09

people 99.7
child 99.5
one 97
baby 96.9
adult 94.5
portrait 93.7
man 93.4
administration 92.1
indoors 87.7
son 85.8
war 83.3
two 82.7
offspring 81.2
chair 80.2
family 79.3
sit 78.4
furniture 77.5
curiosity 76.4
education 75.5
wear 75.3

Imagga
created on 2023-10-06

child 82.5
family 39.1
kid 39
baby 30.8
childhood 29.6
parent 29.3
children 29.2
person 28.8
little 28.3
happy 28.2
mother 27.5
boy 26.9
father 25.4
portrait 25.2
people 24.5
cute 24.4
son 23.5
male 22.1
love 22.1
toddler 22
face 21.3
daughter 20.8
dad 20.8
happiness 20.4
playing 20.1
juvenile 20
home 19.9
infant 19.3
smiling 18.8
smile 18.5
kids 17.9
man 17.5
innocent 15.7
care 15.6
fun 15
together 14.9
adorable 14.8
play 14.6
grandfather 14.6
sitting 14.6
newborn 14.6
joy 13.4
lifestyle 13
eyes 12.9
girls 12.8
parenthood 12.7
sister 12.7
innocence 12.5
old 11.8
couple 11.3
senior 11.2
expression 11.1
youth 11.1
brother 10.8
hand 10.6
adult 10.4
blond 10.3
black 10.2
life 10.2
grandma 9.9
cheerful 9.8
mom 9.7
school 9.6
scholar 9.3
head 9.2
joyful 9.2
park 9.1
hair 8.7
hug 8.7
sweet 8.7
education 8.7
world 8.4
holding 8.3
healthy 8.2
looking 8
indoors 7.9
mum 7.8
elderly 7.7
health 7.6
garden 7.5
house 7.5
intellectual 7.4
funny 7.3
interior 7.1

Google
created on 2018-05-09

photograph 96.3
black 94.9
person 94
black and white 93.1
sitting 91.1
child 90.3
monochrome photography 87.4
standing 85
photography 84.7
snapshot 81.8
monochrome 69.5
stock photography 59.5
girl 56.9
portrait photography 53.9
toddler 53
vintage clothing 50.8

Microsoft
created on 2018-05-09

person 94.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 0-3
Gender Female, 84.1%
Calm 79.1%
Fear 7.7%
Disgusted 6.6%
Surprised 6.5%
Sad 4%
Angry 3.3%
Happy 1.2%
Confused 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Baby
Person
Windmill
Crib
Baby 97.7%
Baby 92.6%
Person 97.7%
Person 92.6%
Windmill 63.7%
Crib 60.3%

Captions

Text analysis

Amazon

inverted
and
Art
(Harvard
College
fm
of
Fellows
Museums)
neg
University
President and Fellows of Harvard College (Harvard University Art Museums)
Harvard
P1970.4380.0005 inverted fm neg
President
P1970.4380.0005

Google

O President and Fellows of Harvard College (Harvard University Art Museums) P1970.4380.0005 inverted fm neg
O
President
and
Art
P1970.4380.0005
fm
Fellows
of
Harvard
College
(Harvard
University
Museums)
inverted
neg