Human Generated Data

Title

Untitled (rehabilitation clients, Boone County, Arkansas)

Date

October 1935, printed later

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3596

Human Generated Data

Title

Untitled (rehabilitation clients, Boone County, Arkansas)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3596

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.5
Human 99.5
Clothing 97.7
Apparel 97.7
Person 92.3
People 72.1
Face 71.4
Man 67.7
Pants 67.6
Jacket 62.6
Coat 62.6
Shirt 59.6
Wall 56
Jeans 55.5
Denim 55.5

Clarifai
created on 2023-10-15

people 99.9
portrait 99.8
two 98.5
three 98.5
group 98.3
adult 98
child 97.8
collage 97.6
man 97.1
vintage 97
wear 96.6
son 95.8
retro 94.6
four 93
woman 93
documentary 92.8
boy 91.9
family 91.6
group together 90.6
veil 88

Imagga
created on 2021-12-15

kin 32.6
statue 23.6
religion 20.6
sculpture 20.6
old 18.8
portrait 18.8
face 18.5
art 18.4
ancient 18.2
people 16.7
religious 15.9
person 15.4
god 15.3
architecture 15
adult 14.9
world 14.2
antique 13
sexy 12.8
dress 12.6
model 12.4
male 12.3
vintage 11.6
man 11.4
culture 11.1
stone 11
fashion 10.6
temple 10.4
hair 10.3
black 10.2
juvenile 10
traditional 10
travel 9.9
attractive 9.8
human 9.7
women 9.5
adolescent 9.5
love 9.5
mother 9.4
historical 9.4
church 9.2
history 8.9
body 8.8
marble 8.7
worship 8.7
spirituality 8.6
spiritual 8.6
monument 8.4
head 8.4
pretty 8.4
carving 8.3
figure 8.3
building 8.2
closeup 8.1
cute 7.9
brunette 7.8
catholic 7.8
sepia 7.8
pray 7.8
holy 7.7
happy 7.5
child 7.5
city 7.5
famous 7.4
makeup 7.3
lady 7.3
sensual 7.3

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

text 99.5
person 98.7
human face 98.4
clothing 98.3
outdoor 93.2
smile 91.4
man 80.8
standing 76.6
glasses 75.8
black and white 54.7
posing 48.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 28-44
Gender Female, 96.8%
Angry 87.6%
Calm 7.9%
Sad 3.6%
Disgusted 0.4%
Confused 0.3%
Fear 0.2%
Surprised 0.1%
Happy 0.1%

AWS Rekognition

Age 29-45
Gender Male, 77.1%
Angry 98.5%
Calm 1.4%
Sad 0.1%
Confused 0%
Surprised 0%
Fear 0%
Disgusted 0%
Happy 0%

Microsoft Cognitive Services

Age 49
Gender Male

Microsoft Cognitive Services

Age 41
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Jacket 62.6%

Categories