Human Generated Data

Title

Untitled (Jersey Homesteads, New Jersey)
Date

1939
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3568
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Jersey Homesteads, New Jersey)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1939

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3568

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Clothing 100
Adult 99.4
Male 99.4
Man 99.4
Person 99.4
Adult 98.2
Male 98.2
Man 98.2
Person 98.2
Sun Hat 97.5
Adult 97
Male 97
Man 97
Person 97
Shirt 94.2
Face 89.9
Head 89.9
Adult 88
Male 88
Man 88
Person 88
Photography 86.5
Hat 74.1
Portrait 57.6
Outdoors 57.1
Smoke 56.1
Cowboy Hat 55.2

Clarifai
created on 2018-05-10

people 99.9
adult 99
man 97.7
wear 95.9
one 94.5
two 94.4
furniture 93.1
portrait 92
woman 89.5
group 88.2
veil 87.9
room 86.2
offense 85.9
outfit 82.8
lid 79.8
administration 78.6
recreation 78.5
facial expression 78.4
three 77
music 76.1

Imagga
created on 2023-10-07

man 45
hairdresser 44.3
person 32
people 30.1
male 27.2
patient 23.8
couple 20
adult 19.6
home 19.1
happy 17.5
indoors 16.7
hat 15.7
portrait 15.5
men 14.6
lifestyle 13
sitting 12.9
love 12.6
medical 12.4
smiling 12.3
room 12.3
two 11.9
fashion 11.3
senior 11.2
old 11.1
health 11.1
father 11.1
worker 11.1
occupation 11
happiness 11
case 10.8
nurse 10.8
holding 10.7
hand 10.6
job 10.6
husband 10.5
loving 10.5
doctor 10.3
work 10.2
casual 10.2
sick person 10.1
clothing 10
parent 9.8
boyfriend 9.6
together 9.6
girlfriend 9.6
looking 9.6
relationship 9.4
hospital 9.3
life 9.3
smile 9.3
dad 9.2
face 9.2
attractive 9.1
professional 8.9
style 8.9
medicine 8.8
affectionate 8.7
uniform 8.6
married 8.6
office 8.4
black 8.4
relaxation 8.4
treatment 8.3
human 8.2
care 8.2
indoor 8.2
grandfather 8.1
lady 8.1
romantic 8
shop 7.9
women 7.9
business 7.9
two people 7.8
content 7.7
pain 7.7
chair 7.6
bow tie 7.6
wife 7.6
adults 7.6
meeting 7.5
mature 7.4
emotion 7.4
friendly 7.3
cheerful 7.3
bright 7.1
family 7.1
clinic 7.1
businessman 7.1
modern 7

Google
created on 2018-05-10

white 96.1
photograph 96
black 95.6
black and white 90
sitting 82.6
snapshot 81.8
monochrome photography 79.9
photography 79.7
human 71.9
human behavior 67.1
monochrome 64.1
girl 59.5
stock photography 52.7
vintage clothing 52.6

Microsoft
created on 2018-05-10

person 97.5

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 48-54
Gender Male, 99.8%
Sad 85.1%
Calm 40.3%
Angry 19.6%
Surprised 6.4%
Fear 6%
Confused 0.2%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 24-34
Gender Male, 99.8%
Sad 100%
Surprised 6.3%
Fear 6.1%
Confused 1.3%
Calm 0.7%
Disgusted 0.6%
Angry 0.4%
Happy 0.1%

AWS Rekognition

Age 28-38
Gender Male, 98.2%
Calm 91.2%
Fear 7.4%
Surprised 6.3%
Sad 3.8%
Disgusted 0.3%
Angry 0.3%
Confused 0.2%
Happy 0.1%

Feature analysis

Amazon

Adult
Male
Man
Person
Hat
Adult 99.4%
Adult 98.2%
Adult 97%
Adult 88%
Male 99.4%
Male 98.2%
Male 97%
Male 88%
Man 99.4%
Man 98.2%
Man 97%
Man 88%
Person 99.4%
Person 98.2%
Person 97%
Person 88%
Hat 74.1%

Captions

Microsoft
created on 2018-05-10

a person sitting on a bed 62.9%
a man and a woman sitting on a bed 43.9%
a man and woman sitting on a bed 37.3%