Human Generated Data

Title

Cotton pickers, 6:30 a.m., Alexander Plantation, Pulaski County, Arkansas

Date

1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3056

Human Generated Data

Title

Cotton pickers, 6:30 a.m., Alexander Plantation, Pulaski County, Arkansas

People

Artist: Ben Shahn, American 1898 - 1969

Date

1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3056

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Clothing 99.8
Apparel 99.8
Person 99.4
Human 99.4
Person 98.9
Person 98.8
Person 83.8
Person 74.9
Face 73.4
Hat 72
People 69.2
Sun Hat 67.8
Person 62.5
Overcoat 58.1
Coat 58.1
Person 43

Clarifai
created on 2023-10-15

people 100
portrait 99.2
veil 98.9
three 98.8
group 98.5
lid 98.3
man 98.3
adult 97.9
two 97.6
four 96.2
group together 95.4
wear 94.3
woman 91.7
family 90.1
music 89.2
child 87.5
retro 87.4
musician 85.7
administration 82.7
five 82.4

Imagga
created on 2021-12-15

man 24.8
people 23.4
person 21.2
male 19.2
mortarboard 18.2
adult 18.2
passenger 18.1
clothing 17.4
men 17.2
old 14.6
scholar 14.1
cap 13.6
sculpture 13.4
statue 13.3
hair 12.7
black 12.6
portrait 12.3
building 12
headdress 11.6
gown 11.5
youth 11.1
world 11
head 10.9
smiling 10.8
family 10.7
intellectual 10.5
city 10
religion 9.8
art 9.8
human 9.7
sepia 9.7
couple 9.6
ancient 9.5
sitting 9.4
architecture 9.4
face 9.2
worker 9.1
history 8.9
urban 8.7
work 8.6
happiness 8.6
smile 8.5
wall 8.5
religious 8.4
street 8.3
vintage 8.3
holding 8.2
one 8.2
girls 8.2
style 8.2
happy 8.1
academic gown 8
looking 8
lifestyle 7.9
women 7.9
serious 7.6
two 7.6
hand 7.6
hat 7.6
fashion 7.5
historical 7.5
monument 7.5
covering 7.3
home 7.2
love 7.1

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

person 99.9
outdoor 98.4
hat 98.2
text 98
clothing 96.6
fashion accessory 95.6
smile 94.3
human face 92.9
people 91.4
fedora 86.7
cowboy hat 84.3
man 77.1
group 75.4
sun hat 69.6
white 67.3
old 65.6
sketch 54.5
dressed 28.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 28-44
Gender Female, 85.3%
Sad 53.8%
Calm 29.8%
Fear 14.7%
Surprised 0.5%
Confused 0.5%
Happy 0.4%
Angry 0.2%
Disgusted 0.1%

AWS Rekognition

Age 22-34
Gender Male, 98.3%
Calm 99.8%
Surprised 0.1%
Happy 0.1%
Sad 0%
Confused 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 23-37
Gender Female, 61.5%
Calm 97.3%
Angry 1%
Happy 0.7%
Surprised 0.4%
Sad 0.4%
Disgusted 0.1%
Confused 0.1%
Fear 0%

Microsoft Cognitive Services

Age 41
Gender Female

Microsoft Cognitive Services

Age 25
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Hat 72%

Categories

Imagga

people portraits 77.2%
paintings art 20.7%
pets animals 1.3%