Human Generated Data

Title

Sharecroppers, Pulaski County, Arkansas
Date

1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3049

Human Generated Data

Title

Sharecroppers, Pulaski County, Arkansas

People

Artist: Ben Shahn, American 1898 - 1969

Date

1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3049

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.9
Human 99.9
Person 99.7
Apparel 97.7
Hat 97.7
Clothing 97.7
Sitting 77.9
Face 77.6
People 73
Sleeve 67.5
Wood 59.8

Clarifai
created on 2023-10-15

people 99.9
portrait 99.8
elderly 99.4
adult 98.9
two 98.7
lid 98.5
man 97.9
veil 97.2
woman 95.2
three 93.2
retro 92.1
old 91.7
wear 89.9
group 88.3
street 87.7
one 86.3
vintage 86.2
musician 86
facial expression 84.5
documentary 81.7

Imagga
created on 2021-12-15

man 43
male 33.3
barbershop 31.4
person 29.9
people 28.4
shop 26.4
bow tie 24.5
worker 23.4
necktie 22.3
men 20.6
portrait 20
senior 19.7
mercantile establishment 19.4
waiter 19.2
work 17.3
professional 17
old 16.7
adult 16.2
grandfather 15.9
couple 14.8
dining-room attendant 14.6
face 14.2
occupation 13.7
black 13.2
clothing 13.2
place of business 13
hat 12.8
medical 12.3
home 12
employee 11.5
business 11.5
profession 11.5
looking 11.2
happy 10.6
job 10.6
elderly 10.5
garment 10.4
mature 10.2
concertina 9.8
serious 9.5
education 9.5
building 9.5
doctor 9.4
smile 9.3
patient 9.1
family 8.9
lifestyle 8.7
sitting 8.6
construction 8.5
two 8.5
vintage 8.3
free-reed instrument 8.3
uniform 8.2
equipment 8.1
to 8
smiling 8
businessman 7.9
wind instrument 7.9
standing 7.8
lab 7.8
attractive 7.7
health 7.6
office 7.6
hand 7.6
human 7.5
room 7.4
establishment 7.3
new 7.3
aged 7.2
love 7.1
working 7.1
happiness 7
indoors 7
helmet 7

Google
created on 2021-12-15

Hat 91.1
Black 89.7
Human 89.2
Smile 87.9
Style 83.8
Sun hat 79.5
Adaptation 79.4
People 77.6
Snapshot 74.3
Vintage clothing 72.4
Monochrome photography 71.3
Monochrome 69.2
Stock photography 65.3
Happy 64.7
Costume hat 62.5
Sitting 61
Room 60.8
Child 60.2
Sleeve 59.4
History 56.6

Microsoft
created on 2021-12-15

person 99.8
man 99.6
text 99.1
human face 99.1
clothing 98.1
smile 95.4
outdoor 89.8
hat 89.6
old 81.5
fashion accessory 74.8
black and white 70.4
white 60.1
fedora 59.9
cowboy hat 55.3
posing 35.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-42
Gender Male, 99.6%
Calm 94.3%
Happy 2.7%
Angry 0.7%
Confused 0.6%
Sad 0.6%
Surprised 0.6%
Disgusted 0.4%
Fear 0.2%

AWS Rekognition

Age 35-51
Gender Male, 94.5%
Happy 58.1%
Calm 32.5%
Confused 3.9%
Surprised 2.1%
Sad 2%
Disgusted 0.6%
Fear 0.4%
Angry 0.4%

Microsoft Cognitive Services

Age 63
Gender Male

Microsoft Cognitive Services

Age 49
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%
Hat 97.7%

Categories

Imagga

people portraits 53.9%
paintings art 45.4%

Captions

Microsoft
created on 2021-12-15

an old photo of a man 96.9%
old photo of a man 96.2%
a man sitting in front of a building 91.2%