Human Generated Data

Title

Arkansas cotton pickers

Date

1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3058

Human Generated Data

Title

Arkansas cotton pickers

People

Artist: Ben Shahn, American 1898 - 1969

Date

1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3058

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.6
Human 99.6
Person 99.1
Person 99
Person 98.7
Person 98.2
People 97.5
Person 96.1
Family 94.9
Outdoors 79.7
Clothing 79.5
Apparel 79.5
Person 79.4
Face 75.6
Nature 70
Countryside 69
Hat 68.8
Female 65.6
Person 63.5

Clarifai
created on 2023-10-15

people 100
portrait 99.8
group 99.5
adult 99.1
wear 98.4
child 98.2
group together 97.2
three 96.5
man 95.7
boy 94.4
documentary 93.5
woman 92.1
son 90.9
veil 90.7
four 90.4
music 89.2
family 89
five 87.4
home 87
offspring 86.8

Imagga
created on 2021-12-15

person 28.1
people 22.9
dress 17.2
male 17
man 16.8
adult 16.5
old 15.3
black 14.6
clothing 13.4
men 12.9
fan 12.8
statue 12.6
bride 12.5
face 12.1
religion 11.6
clothes 11.2
kin 11
art 10.6
fashion 10.5
vintage 9.9
history 9.8
portrait 9.7
follower 9.6
happiness 9.4
architecture 9.4
model 9.3
two 9.3
wedding 9.2
city 9.1
business 9.1
human 9
businessman 8.8
wind instrument 8.8
musical instrument 8.8
world 8.7
couple 8.7
women 8.7
ancient 8.6
groom 8.6
sculpture 8.6
religious 8.4
monument 8.4
silhouette 8.3
one 8.2
symbol 8.1
love 7.9
catholic 7.9
antique 7.8
holy 7.7
youth 7.7
faith 7.7
outdoor 7.6
happy 7.5
church 7.4
sexy 7.2
life 7.2
family 7.1
posing 7.1

Google
created on 2021-12-15

Photograph 94.2
Sleeve 87.2
Adaptation 79.4
People 78.4
Snapshot 74.3
Vintage clothing 72.2
History 66
Stock photography 64.9
Event 62.1
Hat 61.2
Classic 60.8
Monochrome photography 57.5
Room 57.1
Art 53.2
Plant 53.1
Family 52.5

Microsoft
created on 2021-12-15

person 99.4
text 98.5
clothing 97.7
smile 91.5
human face 91.3
posing 89.3
outdoor 85.4
group 83.7
man 82.8
standing 80.7
people 70.4
old 66.3
clothes 15.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 29-45
Gender Female, 99.8%
Calm 91.5%
Sad 6%
Confused 0.7%
Happy 0.5%
Fear 0.5%
Disgusted 0.3%
Surprised 0.3%
Angry 0.1%

AWS Rekognition

Age 24-38
Gender Female, 52.9%
Angry 38.9%
Calm 29.3%
Sad 18.6%
Confused 5.7%
Fear 2.6%
Disgusted 2.6%
Surprised 1.6%
Happy 0.9%

AWS Rekognition

Age 22-34
Gender Male, 99.6%
Calm 97%
Happy 1.8%
Sad 0.5%
Angry 0.4%
Confused 0.1%
Surprised 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 31-47
Gender Male, 97.2%
Calm 95.7%
Happy 1.5%
Sad 0.9%
Surprised 0.6%
Confused 0.6%
Disgusted 0.4%
Angry 0.3%
Fear 0.1%

AWS Rekognition

Age 22-34
Gender Female, 81.5%
Calm 75.9%
Sad 7.1%
Happy 6.8%
Confused 4.8%
Angry 2.4%
Disgusted 1.4%
Surprised 1%
Fear 0.6%

AWS Rekognition

Age 26-40
Gender Female, 69.7%
Calm 75.4%
Confused 8.7%
Happy 6.3%
Surprised 4.3%
Sad 2.3%
Fear 2%
Angry 0.7%
Disgusted 0.4%

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 36
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Hat 68.8%

Categories

Imagga

paintings art 67.5%
people portraits 32.2%