Human Generated Data

Title

Untitled (Horse Dance, Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5168

Human Generated Data

Title

Untitled (Horse Dance, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5168

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 99.9
Dress 99.9
Adult 98.8
Male 98.8
Man 98.8
Person 98.8
Male 98.7
Person 98.7
Boy 98.7
Child 98.7
Fashion 98.5
Formal Wear 98.5
Gown 98.5
Person 98.4
Child 98.4
Female 98.4
Girl 98.4
People 98.1
Person 97.2
Machine 96.5
Wheel 96.5
Person 95.1
Person 94.4
Bicycle 94.1
Transportation 94.1
Vehicle 94.1
Person 94.1
Baby 94.1
Person 92
Person 90.3
Person 89.9
Face 87.3
Head 87.3
Person 80.3
Outdoors 79.8
Cycling 79.4
Sport 79.4
Shorts 64.8
Nature 61.8
City 55.6
Road 55.6
Street 55.6
Urban 55.6
Walking 55.3
Slum 55.1

Clarifai
created on 2018-05-10

people 100
group 99.7
child 99.7
group together 99.3
many 98
adult 97.2
man 94.6
boy 94.5
several 92.5
woman 92.4
recreation 90.9
wear 89.9
family 88.9
military 87.4
offspring 87.4
five 86.2
war 85.7
administration 85.7
home 83.5
son 82.3

Imagga
created on 2023-10-06

weapon 61.5
uniform 55.5
military uniform 55
clothing 37.3
bow and arrow 31.9
instrument 30.6
man 26.9
covering 24.3
consumer goods 22.1
male 22
military 21.3
bow 20.7
people 20.6
war 20.3
soldier 16.6
outdoor 16.1
gun 15.7
travel 14.8
horse 14.2
army 13.7
person 13.3
old 13.2
outdoors 13.1
tourist 12.9
two 12.7
rifle 12.5
sport 12.5
boy 12.2
active 11.7
history 11.6
leisure 11.6
commodity 10.9
danger 10.9
hiking 10.6
walking 10.4
protection 10
camouflage 9.8
walk 9.5
child 9.3
device 9.3
tourism 9.1
private 9
recreation 9
battle 8.8
defense 8.8
adult 8.5
desert 8.4
animal 8.4
vacation 8.2
family 8
together 7.9
combat 7.9
day 7.8
backpack 7.8
riding 7.8
fight 7.7
men 7.7
outside 7.7
protect 7.7
mask 7.7
historic 7.3
competition 7.3
game 7.1
grass 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

outdoor 99
tree 98.4
person 92
group 86.6
posing 79.6
people 79.3
standing 78.8
old 77.1
team 43.3
family 15.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-27
Gender Female, 99.7%
Calm 93.5%
Surprised 6.4%
Fear 6.1%
Sad 2.6%
Confused 2.5%
Disgusted 0.6%
Angry 0.6%
Happy 0.5%

AWS Rekognition

Age 0-3
Gender Male, 99.6%
Sad 87.7%
Calm 58.8%
Surprised 6.3%
Fear 5.9%
Angry 0.4%
Disgusted 0.1%
Confused 0.1%
Happy 0.1%

AWS Rekognition

Age 0-4
Gender Male, 99.9%
Calm 84.8%
Sad 8.9%
Surprised 6.4%
Fear 6.1%
Angry 3.6%
Disgusted 0.2%
Confused 0.1%
Happy 0.1%

AWS Rekognition

Age 54-62
Gender Female, 94.8%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 2.4%
Angry 1.6%
Confused 0.1%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 0-3
Gender Male, 97.3%
Calm 54.9%
Surprised 45.2%
Angry 6.4%
Fear 6.1%
Sad 6%
Confused 0.6%
Disgusted 0.5%
Happy 0.2%

AWS Rekognition

Age 23-31
Gender Female, 100%
Happy 99.6%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Calm 0.1%
Angry 0.1%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 4-12
Gender Male, 86.3%
Sad 99.6%
Calm 14.6%
Surprised 11.1%
Confused 7.7%
Fear 7.3%
Disgusted 0.8%
Angry 0.6%
Happy 0.4%

AWS Rekognition

Age 27-37
Gender Female, 98.6%
Angry 53.2%
Sad 26.1%
Calm 16.2%
Confused 7.1%
Surprised 6.9%
Fear 6.1%
Disgusted 1.7%
Happy 0.4%

AWS Rekognition

Age 16-22
Gender Female, 87.4%
Sad 100%
Calm 9.6%
Surprised 6.3%
Fear 5.9%
Angry 2.2%
Confused 0.4%
Disgusted 0.3%
Happy 0.1%

AWS Rekognition

Age 0-3
Gender Female, 100%
Sad 100%
Calm 6.6%
Surprised 6.3%
Fear 6%
Angry 0.3%
Confused 0.2%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 23-33
Gender Female, 74.6%
Calm 96.6%
Surprised 6.3%
Fear 6%
Sad 2.8%
Happy 0.6%
Disgusted 0.2%
Angry 0.1%
Confused 0%

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 2
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 3
Gender Female

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 34
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Adult 98.8%
Male 98.8%
Man 98.8%
Person 98.8%
Boy 98.7%
Child 98.7%
Female 98.4%
Girl 98.4%
Wheel 96.5%
Bicycle 94.1%
Baby 94.1%