Human Generated Data

Title

Cotton pickers, 6:30 a.m., Alexander Plantation, Pulaski County, Arkansas

Date

1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3056

Human Generated Data

Title

Cotton pickers, 6:30 a.m., Alexander Plantation, Pulaski County, Arkansas

People

Artist: Ben Shahn, American 1898 - 1969

Date

1935

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Clothing 99.8
Apparel 99.8
Person 99.4
Human 99.4
Person 98.9
Person 98.8
Person 83.8
Person 74.9
Face 73.4
Hat 72
People 69.2
Sun Hat 67.8
Person 62.5
Coat 58.1
Overcoat 58.1
Person 43

Imagga
created on 2021-12-15

man 24.8
people 23.4
person 21.2
male 19.2
mortarboard 18.2
adult 18.2
passenger 18.1
clothing 17.4
men 17.2
old 14.6
scholar 14.1
cap 13.6
sculpture 13.4
statue 13.3
hair 12.7
black 12.6
portrait 12.3
building 12
headdress 11.6
gown 11.5
youth 11.1
world 11
head 10.9
smiling 10.8
family 10.7
intellectual 10.5
city 10
religion 9.8
art 9.8
human 9.7
sepia 9.7
couple 9.6
ancient 9.5
sitting 9.4
architecture 9.4
face 9.2
worker 9.1
history 8.9
urban 8.7
work 8.6
happiness 8.6
smile 8.5
wall 8.5
religious 8.4
street 8.3
vintage 8.3
holding 8.2
one 8.2
girls 8.2
style 8.2
happy 8.1
academic gown 8
looking 8
lifestyle 7.9
women 7.9
serious 7.6
two 7.6
hand 7.6
hat 7.6
fashion 7.5
historical 7.5
monument 7.5
covering 7.3
home 7.2
love 7.1

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

person 99.9
outdoor 98.4
hat 98.2
text 98
clothing 96.6
fashion accessory 95.6
smile 94.3
human face 92.9
people 91.4
fedora 86.7
cowboy hat 84.3
man 77.1
group 75.4
sun hat 69.6
white 67.3
old 65.6
sketch 54.5
dressed 28.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 28-44
Gender Female, 85.3%
Sad 53.8%
Calm 29.8%
Fear 14.7%
Surprised 0.5%
Confused 0.5%
Happy 0.4%
Angry 0.2%
Disgusted 0.1%

AWS Rekognition

Age 22-34
Gender Male, 98.3%
Calm 99.8%
Surprised 0.1%
Happy 0.1%
Sad 0%
Confused 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 23-37
Gender Female, 61.5%
Calm 97.3%
Angry 1%
Happy 0.7%
Surprised 0.4%
Sad 0.4%
Disgusted 0.1%
Confused 0.1%
Fear 0%

Microsoft Cognitive Services

Age 41
Gender Female

Microsoft Cognitive Services

Age 25
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Hat 72%

Captions

Microsoft

Louise Beavers et al. posing for a photo 96.8%
Louise Beavers et al. posing for the camera 96.7%
Louise Beavers et al. standing in an old photo of a person 94.2%