Human Generated Data

Title

Untitled (southern farmer)

Date

1930s

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3102

Human Generated Data

Title

Untitled (southern farmer)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1930s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Human 99.3
Person 99.3
Nature 99.1
Person 98.9
Outdoors 98.9
Clothing 96.7
Apparel 96.7
Countryside 93.4
Building 88.2
Rural 87.6
Shack 87.6
Hut 87.6
Hat 75
Sun Hat 57.2

Imagga
created on 2021-12-15

seller 30.2
old 24.4
building 22.1
man 20.8
hovel 18.3
architecture 17.2
person 15.8
house 15
structure 12.8
male 12.8
city 12.5
sky 12.1
hut 11.7
people 11.1
adult 11
roof 10.4
stone 10.1
washboard 10.1
outdoor 9.9
outdoors 9.7
device 9.7
home 9.6
window 9.6
statue 9.5
uniform 9.2
history 8.9
clothing 8.9
urban 8.7
wall 8.7
ancient 8.6
travel 8.4
hat 8.4
street 8.3
vintage 8.3
gun 8.2
religion 8.1
village 7.8
black 7.8
outside 7.7
construction 7.7
culture 7.7
industry 7.7
sculpture 7.6
shelter 7.6
human 7.5
leisure 7.5
tourism 7.4
town 7.4
sport 7.4
worker 7.3
water 7.3
alone 7.3
lifestyle 7.2
military uniform 7.1
working 7.1
equipment 7.1

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

text 98.9
clothing 95.9
person 93.9
drawing 93
outdoor 90
black and white 83.3
house 81.6
old 80.6
man 75.5
sketch 68.7

Face analysis

Amazon

Google

AWS Rekognition

Age 31-47
Gender Male, 89.3%
Calm 79.8%
Happy 8.6%
Sad 5%
Angry 2.2%
Disgusted 1.3%
Surprised 1.2%
Confused 1.2%
Fear 0.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Hat 75%

Captions

Microsoft

a man sitting in front of a building 78.6%
a man standing in front of a building 78.5%
a man standing in front of a window 76.6%