Human Generated Data

Title

All Men Are Created Equal, Pattison, Mississippi
Date

1973, printed 2015
People

Artist: Nathan Benn, American born 1950
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Nathan Benn, 2018.183
Copyright

© Nathan Benn

Human Generated Data

Title

All Men Are Created Equal, Pattison, Mississippi

People

Artist: Nathan Benn, American born 1950

Date

1973, printed 2015

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-07-20

Person 99.6
Human 99.6
Person 99.3
Person 99.3
Person 98.1
Canine 97.9
Pet 97.9
Dog 97.9
Animal 97.9
Mammal 97.9
Person 97.8
Person 96.2
Person 96.1
Person 93
Urban 91.1
Pants 89.6
Apparel 89.6
Clothing 89.6
Building 82.1
Countryside 72.2
Outdoors 72.2
Rural 72.2
Shelter 72.2
Nature 72.2
People 65.2
Screen 63.6
Electronics 63.6
Display 59.2
Monitor 59.2
Sitting 59
Brick 58.7
Road 58.5
Town 58.2
City 58.2
Slum 57.9
Jeans 57
Denim 57
Sleeve 56.6
Long Sleeve 56.6
Indoors 55.4
Living Room 55.4
Room 55.4
Person 54.5

Clarifai
created on 2019-07-20

people 99.9
group 99.4
child 98.8
adult 98.6
wear 98
many 96.3
woman 95.8
man 95.5
calamity 95.3
mammal 91.8
boy 90.7
family 89
war 88
market 87.2
education 86.6
several 86
one 86
military 83.1
religion 82.7
commerce 82.6

Imagga
created on 2019-07-20

hog 45.2
swine 38.2
pen 24
dog 23.4
cowboy 22.3
enclosure 19.3
ungulate 19.1
outdoors 18.8
man 17.5
animals 16.7
male 16.4
pet 15.6
wild 14.8
mammal 14.1
brown 14
two 13.5
adult 12.4
head 11.8
canine 11.7
child 11.7
person 11.6
summer 11.6
cute 11.5
trainer 11.3
rest 11.1
grass 11.1
farm 10.7
wildlife 10.7
safari 10.6
sand 10.5
horse 10.4
smile 10
outdoor 9.9
people 9.5
sitting 9.4
happy 9.4
desert 9.3
uniform 9.1
camel 9
sunny 8.6
structure 8.5
travel 8.4
fur 8.4
mountains 8.3
domestic 8.1
military uniform 8.1
sun 8
rural 7.9
together 7.9
riding 7.8
laborer 7.8
breed 7.7
fun 7.5
leisure 7.5
park 7.4
fall 7.2
smiling 7.2
black 7.2
portrait 7.1
country 7

Google
created on 2019-07-20

People 94.5
Human 74.7
Street dog 66.9
Canidae 57.9
Village 57.4
Child 52
Street 51.1

Microsoft
created on 2019-07-20

ground 99.8
person 97.7
dog 97.6
outdoor 94.5
carnivore 93.7
clothing 91.2
animal 88.3
mammal 58.2
man 58.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 4-9
Gender Female, 61.4%
Calm 66.8%
Surprised 5.1%
Confused 5.2%
Sad 12%
Happy 4.7%
Angry 4%
Disgusted 2.1%

AWS Rekognition

Age 4-9
Gender Male, 95.6%
Disgusted 1.3%
Angry 3.3%
Calm 23%
Sad 68.2%
Confused 2.8%
Happy 0.3%
Surprised 1.2%

AWS Rekognition

Age 26-43
Gender Male, 70%
Surprised 8%
Angry 6.7%
Disgusted 10.4%
Calm 41%
Confused 16.6%
Happy 3.3%
Sad 13.9%

AWS Rekognition

Age 35-52
Gender Female, 80.2%
Happy 7%
Calm 70.4%
Confused 3.6%
Angry 4.9%
Sad 9.1%
Disgusted 0.9%
Surprised 4.1%

AWS Rekognition

Age 48-68
Gender Male, 52%
Happy 0.4%
Calm 1.1%
Angry 1.1%
Surprised 0.3%
Confused 1.2%
Sad 95.6%
Disgusted 0.3%

AWS Rekognition

Age 35-52
Gender Male, 53.2%
Calm 53.2%
Confused 45.2%
Surprised 45.2%
Sad 45.6%
Happy 45.1%
Disgusted 45.3%
Angry 45.4%

AWS Rekognition

Age 26-43
Gender Male, 54.5%
Sad 49.5%
Happy 45.4%
Calm 49.1%
Surprised 45.3%
Disgusted 45.1%
Angry 45.4%
Confused 45.3%

Microsoft Cognitive Services

Age 9
Gender Female

Microsoft Cognitive Services

Age 25
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Dog 97.9%

Captions

Microsoft

a group of people standing next to a dog 85.9%
a group of people sitting around a dog 71.9%
a group of people standing in front of a dog 71.8%

Text analysis

Google

e Coca-Cola
Coca-Cola
e