Human Generated Data

Title

Untitled (Horse Dance, Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5077

Human Generated Data

Title

Untitled (Horse Dance, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5077

Machine Generated Data

Tags

Amazon
created on 2023-10-07

People 99.8
Walking 99.1
Person 98.4
Adult 98.4
Male 98.4
Man 98.4
Person 98.1
Adult 98.1
Male 98.1
Man 98.1
Person 98.1
Person 97.5
Person 97.4
Person 96.4
Person 95.6
Person 95.6
Person 94.4
Person 94.3
Person 93.9
Person 92.8
Person 91.2
Person 85.2
Person 84.2
Car 83.6
Transportation 83.6
Vehicle 83.6
Face 81.3
Head 81.3
Outdoors 80.1
Person 78.3
Person 77.3
Person 77.2
Nature 68.8
Person 67.5
Formal Wear 63.4
Person 62
Crowd 61.3
City 57.4
Road 57.4
Street 57.4
Urban 57.4
Clothing 57.3
Footwear 57.3
Shoe 57.3
Dress 57.2
Garden 57.2
Accessories 57.1
Bag 57.1
Handbag 57.1
Shoe 56.7
Bus Stop 56.7
Electrical Device 56.4
Microphone 56.4

Clarifai
created on 2018-05-10

people 100
many 99.4
group 99.3
group together 99.2
man 97.3
adult 96.3
military 94.9
war 92.7
child 92.7
soldier 91.2
crowd 90.5
woman 90
several 89.1
administration 88.2
transportation system 85.6
vehicle 83.2
leader 79.8
uniform 79.1
street 79
boy 78.3

Imagga
created on 2023-10-07

musical instrument 41.3
brass 31.5
trombone 29.1
snow 28.8
wind instrument 27.7
uniform 26.6
military uniform 25.9
percussion instrument 25.3
man 24.8
winter 23
cold 21.5
steel drum 20
people 18.4
clothing 18
male 17.7
outdoor 17.6
mountain 16.3
landscape 14.9
sport 14.5
outdoors 14.5
military 14.5
season 13.2
sky 12.7
travel 12.7
horse 12.3
covering 12.3
person 12
outside 12
leisure 11.6
boy 11.3
active 11
field 10.9
soldier 10.7
war 10.6
consumer goods 10.6
weapon 10.5
gun 10.1
tree 10
history 9.8
vacation 9.8
snowy 9.7
hiking 9.6
couple 9.6
forest 9.6
happy 9.4
weather 9.3
rifle 9.3
city 9.1
danger 9.1
old 9.1
recreation 9
private 8.9
grass 8.7
adult 8.4
hill 8.4
mountains 8.3
fun 8.2
lifestyle 7.9
together 7.9
day 7.8
backpack 7.8
army 7.8
animal 7.6
walking 7.6
equipment 7.6
pedestrian 7.4
ski 7.4
sports 7.4
tourist 7.4
suit 7.2
transportation 7.2
activity 7.2
trees 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

outdoor 98.5
tree 97.7
people 95.6
group 91.3
old 41.6
vintage 25.7

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 29-39
Gender Male, 90.9%
Sad 81.2%
Surprised 27.4%
Happy 21.9%
Calm 11.5%
Fear 6.6%
Confused 5.5%
Disgusted 1.2%
Angry 1.1%

AWS Rekognition

Age 45-53
Gender Male, 99.9%
Calm 99.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0%
Happy 0%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 1-7
Gender Male, 100%
Calm 90.8%
Sad 6.8%
Surprised 6.3%
Fear 5.9%
Confused 0.6%
Angry 0.1%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 4-10
Gender Female, 96.7%
Sad 96.9%
Angry 26.3%
Confused 18.2%
Surprised 7.4%
Fear 6.2%
Calm 1.1%
Disgusted 0.4%
Happy 0.3%

AWS Rekognition

Age 37-45
Gender Male, 100%
Calm 92.8%
Surprised 6.6%
Fear 6.4%
Sad 2.6%
Happy 1.7%
Angry 1.5%
Confused 0.4%
Disgusted 0.3%

AWS Rekognition

Age 29-39
Gender Female, 80.5%
Calm 66.5%
Disgusted 10.1%
Sad 9.1%
Surprised 7%
Fear 6.4%
Angry 6.1%
Confused 3%
Happy 0.9%

AWS Rekognition

Age 23-31
Gender Male, 99.9%
Sad 98.6%
Confused 30.6%
Fear 7.6%
Surprised 6.7%
Calm 5.7%
Angry 1%
Disgusted 0.7%
Happy 0.3%

AWS Rekognition

Age 16-22
Gender Male, 93.7%
Sad 93.1%
Calm 36.1%
Angry 8.1%
Confused 7.2%
Surprised 6.8%
Fear 6.3%
Disgusted 0.8%
Happy 0.7%

AWS Rekognition

Age 21-29
Gender Male, 99.5%
Calm 77%
Sad 12.9%
Fear 6.7%
Surprised 6.6%
Confused 2.4%
Happy 1.7%
Angry 1.6%
Disgusted 1.2%

AWS Rekognition

Age 23-31
Gender Female, 94.3%
Sad 85.1%
Fear 39.2%
Calm 20.4%
Surprised 6.7%
Disgusted 2.1%
Confused 1.5%
Angry 1%
Happy 0.4%

AWS Rekognition

Age 19-27
Gender Male, 99.8%
Angry 72.3%
Sad 16.7%
Confused 7.5%
Surprised 6.6%
Fear 6.2%
Disgusted 2%
Calm 0.9%
Happy 0.3%

AWS Rekognition

Age 29-39
Gender Female, 54.7%
Calm 99.3%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%
Happy 0.1%

AWS Rekognition

Age 12-20
Gender Female, 86.4%
Sad 98.5%
Calm 34.7%
Surprised 6.6%
Fear 6.5%
Confused 3.8%
Angry 1.1%
Happy 1.1%
Disgusted 0.9%

AWS Rekognition

Age 1-7
Gender Male, 79%
Calm 42.7%
Confused 23.5%
Angry 16.3%
Surprised 7.5%
Fear 7%
Sad 6.5%
Disgusted 2.7%
Happy 1.5%

AWS Rekognition

Age 25-35
Gender Female, 99.7%
Sad 100%
Surprised 6.3%
Fear 6.1%
Happy 1.4%
Disgusted 1%
Angry 0.6%
Calm 0.5%
Confused 0.1%

AWS Rekognition

Age 16-22
Gender Female, 88.4%
Sad 77.6%
Calm 46.3%
Confused 10.2%
Surprised 7.1%
Fear 6.5%
Disgusted 1.8%
Happy 1.7%
Angry 1.5%

AWS Rekognition

Age 6-14
Gender Male, 80.9%
Calm 89.6%
Fear 7.6%
Surprised 6.6%
Happy 2.9%
Sad 2.6%
Angry 0.7%
Disgusted 0.3%
Confused 0.2%

AWS Rekognition

Age 13-21
Gender Female, 99.2%
Confused 49.9%
Calm 23.3%
Fear 8.9%
Surprised 6.8%
Sad 6.5%
Disgusted 5.7%
Angry 4.4%
Happy 1%

AWS Rekognition

Age 36-44
Gender Male, 98.9%
Calm 80%
Surprised 7.6%
Fear 6.9%
Confused 4.1%
Sad 3.9%
Happy 3.7%
Angry 1.7%
Disgusted 1.1%

AWS Rekognition

Age 1-7
Gender Female, 100%
Angry 88.5%
Sad 9.9%
Surprised 6.3%
Fear 5.9%
Calm 0.1%
Confused 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 26-36
Gender Male, 99.8%
Calm 88.9%
Sad 6.7%
Surprised 6.5%
Fear 5.9%
Confused 1.4%
Disgusted 0.3%
Angry 0.2%
Happy 0.2%

AWS Rekognition

Age 21-29
Gender Male, 99.3%
Calm 60.6%
Sad 17.9%
Surprised 11.6%
Fear 7.2%
Angry 6.7%
Disgusted 3.3%
Happy 1.3%
Confused 1%

AWS Rekognition

Age 35-43
Gender Male, 84.6%
Sad 100%
Surprised 6.3%
Fear 6%
Calm 0.7%
Confused 0.3%
Disgusted 0.3%
Happy 0.2%
Angry 0.1%

AWS Rekognition

Age 18-26
Gender Male, 76%
Sad 42.1%
Angry 29%
Fear 21.3%
Surprised 13.2%
Calm 9.7%
Confused 2.6%
Disgusted 2%
Happy 0.8%

AWS Rekognition

Age 18-26
Gender Male, 85.5%
Calm 39.8%
Sad 20.1%
Angry 14%
Happy 9.5%
Surprised 8.7%
Fear 8%
Disgusted 7.3%
Confused 3.2%

AWS Rekognition

Age 16-24
Gender Male, 96.6%
Fear 90%
Calm 8.1%
Happy 7.5%
Surprised 6.9%
Sad 3.4%
Disgusted 2.6%
Angry 2.6%
Confused 0.7%

AWS Rekognition

Age 25-35
Gender Male, 98.1%
Angry 82.5%
Calm 9%
Surprised 7.5%
Fear 6%
Disgusted 3.4%
Sad 2.5%
Happy 1%
Confused 0.4%

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 22
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 4
Gender Female

Feature analysis

Amazon

Person 98.4%
Adult 98.4%
Male 98.4%
Man 98.4%
Car 83.6%
Shoe 57.3%