Human Generated Data

Title

Untitled (Mulhall family, sharecroppers, Ozarks, Arkansas)
Date

October 1935, printed later
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3604

Human Generated Data

Title

Untitled (Mulhall family, sharecroppers, Ozarks, Arkansas)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3604

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Face 100
Head 100
Photography 100
Portrait 100
People 99.3
Person 99.2
Adult 99.2
Female 99.2
Woman 99.2
Person 98.4
Wood 87.9
Clothing 81.1
Dress 81.1
Outdoors 76.1
Body Part 70.4
Finger 70.4
Hand 70.4
Architecture 62.5
Building 62.5
Countryside 62.5
Hut 62.5
Nature 62.5
Rural 62.5
Happy 61
Smile 61
Shelter 57.7
Window 57.4
Door 56.1
Slum 55.2

Clarifai
created on 2018-05-10

people 100
child 99.5
group 99.1
adult 98.6
two 98.4
offspring 98
portrait 97.9
woman 96.4
family 96
facial expression 95.9
actress 95.7
three 95.3
son 95.1
wear 93.9
sibling 93.2
man 92.4
baby 92.3
four 90.7
music 90.1
musician 87.7

Imagga
created on 2023-10-07

kin 63.8
mother 36.8
parent 31.2
child 26.7
people 21.8
portrait 20.7
world 18.8
love 18.1
man 18.1
old 17.4
adult 16.8
happiness 16.5
family 16
male 15.7
happy 15.7
outdoors 14.9
couple 14.8
father 14
dad 13.9
human 13.5
daughter 13.3
black 13.2
face 12.8
sepia 12.6
cute 12.2
ancient 12.1
hair 11.9
bride 11.5
sculpture 11.5
statue 11.4
lady 11.4
smiling 10.8
person 10.7
fashion 10.6
married 10.5
vintage 9.9
one 9.7
culture 9.4
lifestyle 9.4
smile 9.3
house 9.2
outdoor 9.2
groom 9.2
dress 9
home 8.8
together 8.8
females 8.5
youth 8.5
bouquet 8.5
two 8.5
stone 8.4
head 8.4
attractive 8.4
wedding 8.3
holding 8.3
girls 8.2
day 7.8
architecture 7.8
antique 7.8
model 7.8
summer 7.7
hand 7.6
city 7.5
park 7.4
makeup 7.3
life 7.3
looking 7.2
religion 7.2
art 7.2
romantic 7.1

Google
created on 2018-05-10

people 96.9
photograph 96.4
black and white 93.6
person 92.4
monochrome photography 89.3
standing 87.1
picture frame 82
snapshot 81.8
family 81.2
photography 80.2
vintage clothing 77.6
sitting 75.2
monochrome 74.4
human 69.5
portrait 69.1
smile 64
history 61.5
child 61
religion 60.5
stock photography 59.5

Microsoft
created on 2018-05-10

person 93.2
outdoor 88.8
white 66.3
old 50.9
picture frame 10

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 42-50
Gender Female, 100%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 1.3%
Confused 0.1%
Angry 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 0-4
Gender Male, 64.1%
Sad 100%
Surprised 6.4%
Fear 6.2%
Calm 4.7%
Angry 2.1%
Disgusted 0.5%
Happy 0.1%
Confused 0.1%

AWS Rekognition

Age 6-12
Gender Female, 99.5%
Sad 66%
Calm 63.1%
Fear 7.4%
Surprised 6.3%
Confused 1.3%
Angry 0.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 4-12
Gender Female, 95.1%
Sad 95.7%
Calm 45.3%
Surprised 6.7%
Fear 6.1%
Confused 2.2%
Angry 1.7%
Disgusted 0.7%
Happy 0.2%

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 3
Gender Male

Microsoft Cognitive Services

Age 27
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Adult 99.2%
Female 99.2%
Woman 99.2%

Categories

Imagga

people portraits 81.4%
paintings art 16%
pets animals 1.6%