Human Generated Data

Title

Untitled (Mulhall family, sharecroppers, Ozarks, Arkansas)
Date

October 1935, printed later
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3603

Human Generated Data

Title

Untitled (Mulhall family, sharecroppers, Ozarks, Arkansas)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935, printed later

Classification

Photographs

Machine Generated Data

Tags

Clarifai
created on 2018-05-10

people 99.9
two 99.2
adult 98
child 97.6
man 96.7
facial expression 96.2
portrait 94.7
woman 94.2
offspring 93.8
group 93.3
family 90.8
three 89.7
wear 89.5
affection 89.4
sibling 88.4
boy 87.7
sit 84.8
son 81.4
home 79.5
group together 79

Google
created on 2018-05-10

people 96.8
photograph 96.4
person 93.7
black and white 93.7
monochrome photography 90.3
child 88.2
sitting 87.3
standing 85.4
photography 83.1
emotion 81.8
snapshot 81.8
smile 77.5
family 76.2
vintage clothing 75.5
monochrome 72.5
interaction 71.3
human 70.2
tree 68.8
girl 68
fun 61.9

Microsoft
created on 2018-05-10

outdoor 99.8
person 99.3
old 79.5
white 61.4
posing 58.1
crowd 0.8

Face analysis

Microsoft

Google

Microsoft Cognitive Services

Age 2
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Captions

Microsoft

a vintage photo of a man 94.1%
a black and white photo of a man 93.1%
a vintage photo of a man smiling for the camera 91.2%