Human Generated Data

Title

Prison Yard for the Insane

Date

1989

People

Artist: Marcus Halevi, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.638

Human Generated Data

Title

Prison Yard for the Insane

People

Artist: Marcus Halevi, American 20th century

Date

1989

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.638

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 99.7
Face 99.7
Person 99.5
Person 98.9
Person 97.9
Beard 91.7
Apparel 91.5
Clothing 91.5
Sleeve 75.8
Outdoors 75
Nature 73.7
Portrait 65.6
Photography 65.6
Photo 65.6
Ice 64.2
Long Sleeve 64.1
Overcoat 62.7
Coat 62.7
People 58.2
Snow 56.8

Clarifai
created on 2023-10-25

people 99.9
portrait 99.6
man 99.2
street 98.8
group 98
adult 97.5
monochrome 96.5
group together 95.5
boy 93.8
child 92.7
lid 91.4
woman 90.9
winter 90.7
two 90.5
three 90.3
music 89.6
wear 87.6
art 86.8
family 86.1
son 84.8

Imagga
created on 2022-01-09

people 31.2
person 30.9
man 29.6
adult 25.3
male 24.9
world 24.5
snow 23.5
cold 23.2
winter 23
clothing 22.7
portrait 20.1
robe 16.7
black 16.6
garment 15.4
city 15
ice 14.6
clothes 14
business 14
face 13.5
couple 13.1
outdoor 13
men 12.9
street 12
walk 11.4
walking 11.4
urban 11.4
human 11.2
season 10.9
covering 10.8
travel 10.6
one 10.4
outdoors 10.4
kin 10.4
women 10.3
dark 10
silhouette 9.9
fashion 9.8
old 9.8
businessman 9.7
crowd 9.6
hat 9.4
attractive 9.1
shovel 9
active 9
landscape 8.9
looking 8.8
lifestyle 8.7
day 8.6
casual 8.5
window 8.2
guy 8.2
alone 8.2
happy 8.1
dress 8.1
happiness 7.8
boy 7.8
scene 7.8
corporate 7.7
outside 7.7
wall 7.7
mature 7.4
child 7.3
jacket 7.3
exercise 7.3
smiling 7.2
smile 7.1
worker 7.1
love 7.1
weather 7.1
together 7

Google
created on 2022-01-09

Smile 97.6
Window 88.8
Sleeve 85.3
Gesture 85.3
Black-and-white 84.7
Style 83.8
Happy 75.9
Tints and shades 75.9
Monochrome photography 75.6
Building 73.6
Monochrome 73
Snow 69.7
Event 69.5
Room 66.6
Stock photography 62.4
Winter 60.9
Tree 60.9
Photographic paper 58.9
History 57.2
Laugh 55.8

Microsoft
created on 2022-01-09

text 96.9
man 96.4
clothing 94.7
smile 94.2
standing 92.8
black and white 92.7
person 91
posing 89.1
human face 85.8
monochrome 71.1
street 53.9
picture frame 7.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 51-59
Gender Male, 100%
Happy 92.1%
Disgusted 2.7%
Confused 2.3%
Angry 0.8%
Sad 0.7%
Calm 0.7%
Fear 0.4%
Surprised 0.4%

AWS Rekognition

Age 22-30
Gender Male, 100%
Calm 63.9%
Fear 23.9%
Surprised 2.5%
Confused 2.3%
Happy 2.3%
Sad 2.1%
Angry 1.9%
Disgusted 1.1%

AWS Rekognition

Age 27-37
Gender Male, 99.5%
Fear 98.7%
Angry 0.3%
Sad 0.3%
Surprised 0.3%
Calm 0.2%
Confused 0.1%
Happy 0.1%
Disgusted 0.1%

Microsoft Cognitive Services

Age 65
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%