Human Generated Data

Title

Kentucky coal miners, Jenkins, Kentucky

Date

1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3101

Human Generated Data

Title

Kentucky coal miners, Jenkins, Kentucky

People

Artist: Ben Shahn, American 1898 - 1969

Date

1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3101

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.5
Human 99.5
Person 99.4
Person 99.3
Person 99
Person 98.9
Sitting 98
Tie 94
Accessories 94
Accessory 94
Tie 93.6
Clothing 92.6
Apparel 92.6
Outdoors 91
Nature 88.9
Tie 82.2
Housing 77.7
Building 77.7
Countryside 77.5
Wood 74.7
Pants 71.9
Airplane 66.1
Transportation 66.1
Vehicle 66.1
Aircraft 66.1
People 65.4
Rural 64.2
Hut 63
Shoe 61.1
Footwear 61.1
Shoe 59.4
Ground 58.1
Shack 58
Performer 55.7

Clarifai
created on 2023-10-15

people 100
group 99.7
adult 99.6
group together 99.3
man 99
woman 95.4
portrait 95.3
three 95
child 93
sit 92.4
many 90.6
administration 90.4
monochrome 90
furniture 89.6
war 88.8
leader 88.4
actor 87.2
several 86.2
chair 85.3
four 84.5

Imagga
created on 2021-12-15

man 24.9
people 24
person 22.9
male 18.4
old 18.1
statue 14.7
kin 14.6
world 13.9
adult 13.9
men 13.7
sitting 12.9
couple 12.2
two 11.9
religion 11.6
portrait 11.6
home 11.2
history 10.7
sculpture 10.6
architecture 10.2
bride 9.6
love 9.5
uniform 9.4
smiling 9.4
religious 9.4
outdoor 9.2
vintage 9.1
outdoors 9
room 8.9
happy 8.8
mother 8.6
smile 8.5
senior 8.4
monument 8.4
musical instrument 8.4
clothing 8.3
holding 8.3
park 8.2
family 8
groom 7.7
faith 7.7
house 7.5
leisure 7.5
wedding 7.4
historic 7.3
protection 7.3
art 7.3
dress 7.2
building 7.2
women 7.1
face 7.1
bench 7.1
working 7.1
day 7.1

Google
created on 2021-12-15

Footwear 98
Style 84
Black-and-white 82.9
Adaptation 79.3
Monochrome 75.4
Monochrome photography 74.3
Crew 69.6
Room 69.6
Hat 69.5
Sitting 69.4
Recreation 68.6
Boot 68.3
Vintage clothing 67.2
Stock photography 63.5
History 62.2
Team 59.9
Art 58
Chair 55.4
Suit 50.2

Microsoft
created on 2021-12-15

person 99.5
clothing 98.6
man 95.4
outdoor 92.9
text 91.2
smile 76.2
footwear 70.2
black and white 66
group 64.9
old 60.1
people 60
posing 37.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 27-43
Gender Male, 92%
Confused 46.9%
Calm 18.3%
Angry 14.1%
Sad 6.5%
Surprised 5.6%
Fear 5.3%
Disgusted 1.9%
Happy 1.4%

AWS Rekognition

Age 21-33
Gender Male, 89.6%
Fear 92.5%
Calm 3.3%
Surprised 1.8%
Confused 0.7%
Sad 0.6%
Angry 0.5%
Disgusted 0.5%
Happy 0.1%

AWS Rekognition

Age 19-31
Gender Male, 98.6%
Fear 40.7%
Angry 20.8%
Calm 20.5%
Sad 7%
Surprised 5.7%
Confused 3.9%
Happy 0.8%
Disgusted 0.6%

AWS Rekognition

Age 21-33
Gender Male, 98.2%
Calm 97%
Sad 1.4%
Angry 1.3%
Happy 0.1%
Confused 0.1%
Fear 0.1%
Surprised 0%
Disgusted 0%

AWS Rekognition

Age 44-62
Gender Male, 99.9%
Calm 87.3%
Angry 11.3%
Sad 0.7%
Disgusted 0.2%
Confused 0.2%
Happy 0.2%
Surprised 0.1%
Fear 0.1%

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Tie 94%
Airplane 66.1%
Shoe 61.1%

Categories

Imagga

paintings art 60.3%
people portraits 37.7%