Human Generated Data

Title

Untitled (Horse Dance, Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5180

Human Generated Data

Title

Untitled (Horse Dance, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5180

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Person 98.5
Person 98
Person 97.5
Adult 97.5
Male 97.5
Man 97.5
Person 97.3
Person 96.3
Person 96.1
Adult 96.1
Male 96.1
Man 96.1
Person 96
Person 94.9
Adult 94.9
Female 94.9
Woman 94.9
Person 94.6
Machine 90.5
Wheel 90.5
Musical Instrument 89.2
Person 88
Person 85.7
Adult 85.7
Adult 85.7
Female 85.7
Female 85.7
Woman 85.7
Bride 85.7
Wedding 85.7
Face 78.1
Head 78.1
Wheel 59.4
Outdoors 57.7
Leisure Activities 56.5
Music 56.5
Musician 56.5
Performer 56.5
Gong 56.4
Drum 55.9
Percussion 55.9

Clarifai
created on 2018-05-10

people 100
group together 99.6
group 99.2
many 98.6
adult 98.5
vehicle 98
man 95.7
military 94.2
several 92.9
transportation system 91.1
administration 90.9
war 90.6
home 89.5
leader 88
child 86.7
soldier 85.1
four 83.2
three 80
street 79.1
uniform 78.8

Imagga
created on 2023-10-06

machine 41.4
vehicle 35.1
tractor 25.6
concrete mixer 25.1
device 24.8
cart 19.3
industry 18.8
wheeled vehicle 18.5
transport 18.3
old 17.4
work 17.3
farm 16.9
landscape 16.4
industrial 16.3
percussion instrument 16.3
equipment 16.3
transportation 16.1
rural 15.9
grass 15.8
agriculture 15.8
wheel 15.1
oxcart 14.6
machinery 14.6
heavy 14.3
wagon 14.1
musical instrument 13.6
field 13.4
travel 13.4
child 13.1
barrow 13
sky 12.8
outdoor 12.2
truck 12.1
hay 11.6
construction 11.1
road 10.8
gong 10.8
electrical device 10.7
plow 10.6
handcart 10.4
farmer 10.4
building 10.3
architecture 10.2
yellow 9.9
scene 9.5
farming 9.5
earth 9.1
summer 9
religion 9
person 8.8
tire 8.8
man 8.7
driving 8.7
ancient 8.6
tree 8.5
religious 8.4
vintage 8.3
tourism 8.2
outdoors 8.2
working 8
chime 7.9
sand 7.9
people 7.8
agricultural 7.8
dirt 7.6
power 7.6
house 7.5
harvest 7.5
crop 7.5
site 7.5
traditional 7.5
tradition 7.4
land 7.4
vacation 7.4
historic 7.3
dirty 7.2
male 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

outdoor 98.2
old 77.1
white 73.6
black 71.1
people 64.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 18-26
Gender Male, 91%
Calm 97.9%
Surprised 6.6%
Fear 5.9%
Sad 2.2%
Confused 0.9%
Angry 0.2%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 33-41
Gender Male, 99.5%
Calm 65.1%
Sad 43.9%
Fear 7.2%
Surprised 6.5%
Confused 2.7%
Angry 2.4%
Disgusted 0.7%
Happy 0.5%

AWS Rekognition

Age 40-48
Gender Male, 99.8%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 2.6%
Confused 0.2%
Angry 0.1%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 16-22
Gender Female, 98.7%
Calm 89.5%
Surprised 10.2%
Fear 6.9%
Sad 2.4%
Angry 0.4%
Disgusted 0.3%
Confused 0.3%
Happy 0.2%

AWS Rekognition

Age 21-29
Gender Male, 99.7%
Confused 68.3%
Calm 23.7%
Surprised 6.9%
Fear 6%
Sad 4.2%
Disgusted 0.8%
Angry 0.6%
Happy 0.3%

AWS Rekognition

Age 24-34
Gender Male, 99.4%
Sad 99.9%
Calm 20.3%
Fear 6.9%
Surprised 6.8%
Disgusted 1.3%
Happy 0.7%
Confused 0.6%
Angry 0.5%

AWS Rekognition

Age 21-29
Gender Male, 99.8%
Calm 78.6%
Surprised 7.3%
Fear 6.1%
Confused 5%
Sad 4.4%
Disgusted 3.8%
Angry 2.7%
Happy 2.3%

Microsoft Cognitive Services

Age 12
Gender Male

Microsoft Cognitive Services

Age 9
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%
Adult 97.5%
Male 97.5%
Man 97.5%
Female 94.9%
Woman 94.9%
Wheel 90.5%
Bride 85.7%

Text analysis

Amazon

SEKAR
CULANC
SEKAR 1 CULANC
1