Human Generated Data

Title

Medicine show, Huntingdon, Tennessee
Date

1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3000

Human Generated Data

Title

Medicine show, Huntingdon, Tennessee

People

Artist: Ben Shahn, American 1898 - 1969

Date

1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3000

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Helmet 99.7
Clothing 99.7
Apparel 99.7
Person 99.3
Human 99.3
Person 97.6
Person 97.4
Person 96.9
Face 90.4
Person 86.4
Person 85
Person 82.8
Head 77.2
People 68.6
Person 64.5
Undershirt 60.7
Coat 59.7
Hat 57.5
Overcoat 55.7

Clarifai
created on 2023-10-15

people 99.9
monochrome 99.4
child 99.2
group 98.9
adult 98.3
portrait 98
two 97.7
three 97.2
woman 96.8
street 95.2
group together 95.1
documentary 94.2
offspring 93.3
man 93.1
four 93
wear 92.9
boy 92.4
facial expression 90.8
veil 89.2
son 89

Imagga
created on 2021-12-15

man 23.5
person 20.9
kin 19.4
people 19
black 16.8
city 15.8
male 15.5
adult 14.9
child 14.5
portrait 14.2
machinist 12.8
old 12.5
family 11.6
men 11.2
wheelchair 11.1
love 11
urban 10.5
ancient 10.4
happiness 10.2
street 10.1
chair 10.1
parent 10
dress 9.9
human 9.7
smiling 9.4
stretcher 9.1
dad 9
seller 8.8
happy 8.8
athlete 8.7
statue 8.7
bride 8.6
planner 8.6
mother 8.6
culture 8.5
travel 8.4
vintage 8.3
mask 8.2
lifestyle 7.9
couple 7.8
face 7.8
conveyance 7.6
historical 7.5
outdoors 7.5
tourism 7.4
sport 7.4
girls 7.3
father 7.2
litter 7.2
home 7.2
history 7.2

Google
created on 2021-12-15

Photograph 94.2
Smile 93.5
Black-and-white 84.9
Toddler 79.2
Adaptation 79.2
Art 78
Monochrome photography 74.6
Snapshot 74.3
Monochrome 73.7
Happy 68
Vintage clothing 67.5
Room 67.2
Child 66.2
History 64.6
Stock photography 63.3
Visual arts 60.6
Street 59.3
Photo caption 58.4
Sitting 57.6
Photographic paper 56.3

Microsoft
created on 2021-12-15

text 99.7
human face 98.2
clothing 97.3
person 97.1
smile 92.2
man 82
drawing 71.3
black and white 54.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-40
Gender Female, 72.1%
Fear 88.6%
Calm 3.3%
Sad 3.2%
Surprised 2.6%
Angry 0.8%
Confused 0.7%
Happy 0.5%
Disgusted 0.4%

AWS Rekognition

Age 1-7
Gender Male, 84.1%
Calm 74.3%
Sad 17.2%
Angry 6%
Happy 0.8%
Fear 0.7%
Confused 0.4%
Disgusted 0.3%
Surprised 0.2%

AWS Rekognition

Age 23-35
Gender Male, 88.7%
Calm 95.6%
Surprised 2.8%
Angry 0.9%
Sad 0.4%
Happy 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0%

Microsoft Cognitive Services

Age 45
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Helmet
Person
Helmet 99.7%
Person 99.3%
Person 97.6%
Person 97.4%
Person 96.9%
Person 86.4%
Person 85%
Person 82.8%
Person 64.5%

Categories

Imagga

people portraits 87.3%
paintings art 10.9%

Captions

Microsoft
created on 2021-12-15

an old photo of a person 76.6%
a person holding a book 30.8%
a person standing in front of a book 30.7%