Human Generated Data

Title

Untitled (Horse Dance, Java)
Date

January 26, 1960-February 2, 1960
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5080

Human Generated Data

Title

Untitled (Horse Dance, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5080

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Clothing 99.9
Shorts 99.9
Plant 99.5
Tree 99.5
People 99
Person 96.7
Person 95.6
Person 94.3
Adult 94.3
Female 94.3
Woman 94.3
Person 93.7
Person 93.2
Person 92.5
Person 91.7
Person 90.7
Person 88.3
Outdoors 87.1
Person 86.7
Person 85.3
Hat 82.6
Person 81.2
Person 79.9
Person 79.4
Machine 78.9
Wheel 78.9
Face 78.9
Head 78.9
Person 78.8
Person 78.5
Skirt 77.1
Vegetation 75.5
Person 75
Hula 73.6
Toy 73.6
Person 72.8
Nature 68
Person 67.6
Person 64.7
Person 63.1
Person 62.1
Summer 61.4
Person 61.1
Person 60.8
Person 60.5
Person 60.1
Person 59.2
Transportation 57.8
Vehicle 57.8
Photography 57.1
Portrait 57.1
Crowd 56.4
Bicycle 56.1
City 56
Road 55.9
Street 55.9
Urban 55.9
Motorcycle 55.4
Dress 55.4
Stilts 55.4

Clarifai
created on 2018-05-10

people 99.9
many 98.9
group 98
group together 97.8
crowd 96.1
adult 93.4
man 91.9
woman 91.6
child 91.3
military 88.8
administration 88.4
street 88.1
war 87.3
soldier 84.8
recreation 84.4
vehicle 84.1
wear 83.8
boy 82.9
uniform 82.5
transportation system 80.4

Imagga
created on 2023-10-05

man 32.9
pedestrian 31.5
sport 28.2
bicycle 28
outdoors 27
people 26.8
bike 23.4
park 23
active 22
wheelchair 22
male 22
outdoor 21.4
outside 20.5
lifestyle 20.2
cycling 18.7
couple 18.3
cycle 17.6
person 16.9
transportation 16.1
riding 15.6
ride 15.5
wheeled vehicle 15.2
unicycle 15
happy 15
city 15
recreation 14.3
together 14
street 13.8
exercise 13.6
adult 13.6
activity 13.4
chair 13.3
vehicle 13
summer 12.9
family 12.4
leisure 11.6
smiling 11.6
boy 11.5
seat 11.4
group 11.3
fun 11.2
cyclist 11.1
winter 11.1
two 11
mountain 10.8
healthy 10.7
retired 10.7
husband 10.5
walk 10.5
old 10.4
walking 10.4
men 10.3
fitness 9.9
road 9.9
bikes 9.9
travel 9.8
full length 9.7
love 9.5
snow 9.4
senior 9.4
spectator 9.4
health 9
helmet 9
urban 8.7
child 8.7
athlete 8.7
wheel 8.5
fit 8.3
silhouette 8.3
countryside 8.2
day 7.8
retirement 7.7
elderly 7.7
wife 7.6
enjoying 7.6
friends 7.5
care 7.4
vacation 7.4
speed 7.3
transport 7.3
sunlight 7.1
trees 7.1

Google
created on 2018-05-10

photograph 94.9
black and white 89.9
standing 77.6
history 73.2
monochrome photography 72
tree 69.3
crowd 68.1
monochrome 62.4
stock photography 59.2
recreation 55.5

Microsoft
created on 2018-05-10

outdoor 99.2
group 94.9
people 90.3
old 89.6
person 88.8
standing 80
posing 76.9
black 67.6
white 61.9

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 18-26
Gender Male, 99.9%
Calm 65.1%
Sad 60.8%
Surprised 6.8%
Fear 6.2%
Confused 1.4%
Angry 1%
Disgusted 0.5%
Happy 0.2%

AWS Rekognition

Age 6-14
Gender Female, 99.9%
Happy 95.5%
Surprised 6.3%
Fear 6%
Calm 3.3%
Sad 2.2%
Disgusted 0.2%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 23-33
Gender Female, 99%
Calm 79.4%
Sad 7.5%
Surprised 6.7%
Fear 6.3%
Confused 5.7%
Angry 2.6%
Disgusted 0.8%
Happy 0.5%

AWS Rekognition

Age 24-34
Gender Male, 83.8%
Calm 99.5%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.1%
Confused 0.1%
Disgusted 0.1%
Angry 0%

AWS Rekognition

Age 12-20
Gender Female, 99.9%
Sad 64.5%
Surprised 48.9%
Calm 23.8%
Fear 8.1%
Confused 6.2%
Angry 1.6%
Disgusted 1.3%
Happy 0.2%

AWS Rekognition

Age 6-12
Gender Female, 61.4%
Sad 97%
Calm 48.4%
Surprised 6.3%
Fear 5.9%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 18-26
Gender Male, 82.2%
Confused 82.3%
Calm 12.3%
Surprised 6.5%
Fear 6.1%
Sad 3.3%
Disgusted 0.5%
Angry 0.4%
Happy 0.2%

AWS Rekognition

Age 23-31
Gender Female, 98.8%
Sad 100%
Fear 8.7%
Surprised 6.4%
Calm 6%
Confused 0.5%
Happy 0.5%
Angry 0.4%
Disgusted 0.3%

AWS Rekognition

Age 19-27
Gender Male, 99.9%
Sad 95.5%
Calm 43.1%
Fear 7.8%
Surprised 6.6%
Angry 1.7%
Disgusted 1.2%
Confused 0.5%
Happy 0.2%

AWS Rekognition

Age 2-8
Gender Male, 65.2%
Sad 48.6%
Calm 40.6%
Fear 25%
Surprised 7.9%
Disgusted 3.7%
Angry 0.6%
Happy 0.4%
Confused 0.4%

AWS Rekognition

Age 13-21
Gender Female, 99.8%
Sad 70.4%
Calm 60.8%
Fear 7.7%
Surprised 6.4%
Confused 1.1%
Angry 0.4%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 7-17
Gender Female, 99.4%
Calm 88.6%
Sad 8.7%
Surprised 6.3%
Fear 6%
Confused 0.3%
Angry 0.2%
Happy 0.2%
Disgusted 0.1%

AWS Rekognition

Age 16-24
Gender Female, 99.6%
Sad 99.6%
Calm 33%
Surprised 6.3%
Fear 6.1%
Confused 0.5%
Angry 0.2%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 31-41
Gender Female, 99.9%
Calm 83.1%
Sad 9.9%
Surprised 7.1%
Fear 6.1%
Confused 1.5%
Angry 0.8%
Disgusted 0.8%
Happy 0.5%

AWS Rekognition

Age 20-28
Gender Male, 99.8%
Happy 63.1%
Calm 11.9%
Fear 11.1%
Surprised 10.4%
Sad 3.1%
Confused 2.7%
Angry 2.1%
Disgusted 0.9%

AWS Rekognition

Age 37-45
Gender Female, 99.7%
Surprised 61.9%
Calm 50.7%
Fear 6%
Disgusted 5.7%
Confused 3.3%
Sad 2.8%
Angry 0.4%
Happy 0.4%

AWS Rekognition

Age 37-45
Gender Male, 99.9%
Calm 81.1%
Sad 15.2%
Fear 6.9%
Surprised 6.3%
Happy 0.8%
Angry 0.3%
Confused 0.2%
Disgusted 0.2%

AWS Rekognition

Age 16-24
Gender Male, 90.9%
Calm 97.1%
Surprised 6.4%
Fear 5.9%
Sad 2.3%
Confused 0.9%
Disgusted 0.5%
Angry 0.3%
Happy 0.2%

AWS Rekognition

Age 23-31
Gender Male, 66.5%
Sad 99.9%
Calm 19.9%
Surprised 6.6%
Fear 6.4%
Happy 1.2%
Disgusted 0.4%
Confused 0.4%
Angry 0.3%

AWS Rekognition

Age 18-24
Gender Female, 97.5%
Surprised 40.1%
Disgusted 32.6%
Calm 20.4%
Fear 6.9%
Happy 5.7%
Confused 4.6%
Sad 4.1%
Angry 2.7%

AWS Rekognition

Age 24-34
Gender Female, 99.9%
Sad 99.4%
Calm 31.9%
Surprised 6.5%
Fear 6.1%
Angry 2.2%
Confused 0.6%
Disgusted 0.6%
Happy 0.4%

AWS Rekognition

Age 6-16
Gender Male, 94.8%
Sad 99.9%
Calm 17%
Surprised 6.4%
Fear 6.1%
Confused 1.7%
Happy 0.4%
Angry 0.3%
Disgusted 0.2%

AWS Rekognition

Age 2-8
Gender Female, 98.3%
Calm 80.7%
Disgusted 10.4%
Surprised 9.2%
Fear 5.9%
Angry 2.7%
Sad 2.2%
Confused 0.6%
Happy 0.2%

AWS Rekognition

Age 40-48
Gender Female, 99.6%
Sad 99.9%
Calm 21.6%
Fear 6.9%
Surprised 6.3%
Confused 0.9%
Disgusted 0.2%
Happy 0.2%
Angry 0.2%

AWS Rekognition

Age 35-43
Gender Male, 98.6%
Calm 84.6%
Sad 12.7%
Surprised 6.4%
Fear 5.9%
Angry 1%
Confused 0.3%
Happy 0.2%
Disgusted 0.2%

AWS Rekognition

Age 6-12
Gender Male, 95%
Sad 74.4%
Calm 59%
Surprised 6.6%
Fear 6%
Confused 3.7%
Angry 1.5%
Happy 0.5%
Disgusted 0.3%

AWS Rekognition

Age 2-10
Gender Female, 99.4%
Sad 100%
Calm 13.7%
Surprised 6.8%
Fear 6.1%
Angry 1.6%
Confused 1.3%
Disgusted 1.2%
Happy 0.4%

AWS Rekognition

Age 2-10
Gender Male, 73.4%
Sad 99.9%
Calm 26%
Surprised 6.3%
Fear 6.1%
Angry 0.4%
Happy 0.4%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 13-21
Gender Male, 99.8%
Calm 52.5%
Fear 25.2%
Surprised 14.8%
Happy 3.9%
Sad 2.8%
Angry 2%
Disgusted 1.8%
Confused 1.6%

AWS Rekognition

Age 39-47
Gender Female, 53.8%
Happy 99.3%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Calm 0.1%
Angry 0.1%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 18-24
Gender Male, 94.5%
Calm 80.7%
Sad 7.7%
Surprised 6.5%
Fear 6.2%
Happy 5.2%
Angry 2.3%
Disgusted 0.6%
Confused 0.6%

AWS Rekognition

Age 40-48
Gender Female, 100%
Angry 42.6%
Sad 31.9%
Calm 24.8%
Fear 7.6%
Surprised 7%
Confused 3.5%
Disgusted 1.3%
Happy 0.9%

AWS Rekognition

Age 27-37
Gender Female, 66.6%
Sad 83.6%
Calm 58.8%
Surprised 6.4%
Fear 6%
Angry 2%
Happy 0.4%
Confused 0.2%
Disgusted 0.1%

AWS Rekognition

Age 19-27
Gender Male, 97.1%
Calm 59.4%
Happy 24.8%
Fear 10.7%
Surprised 6.7%
Sad 3.7%
Confused 0.6%
Angry 0.5%
Disgusted 0.4%

AWS Rekognition

Age 26-36
Gender Female, 95.7%
Surprised 54.5%
Happy 51.2%
Fear 8.2%
Calm 4.9%
Sad 2.4%
Disgusted 2.1%
Confused 1.1%
Angry 0.9%

AWS Rekognition

Age 4-12
Gender Male, 86.9%
Sad 94.7%
Calm 45.5%
Surprised 6.7%
Fear 6.1%
Angry 4.5%
Confused 1.1%
Disgusted 0.3%
Happy 0.3%

AWS Rekognition

Age 6-16
Gender Male, 86.4%
Calm 38.1%
Fear 15.3%
Surprised 14%
Happy 9.8%
Sad 7.2%
Confused 6.9%
Angry 6.3%
Disgusted 3.9%

AWS Rekognition

Age 20-28
Gender Male, 54.4%
Sad 99.3%
Calm 36.6%
Surprised 6.3%
Fear 6%
Angry 0.5%
Disgusted 0.4%
Confused 0.3%
Happy 0.1%

AWS Rekognition

Age 14-22
Gender Male, 98.4%
Sad 100%
Surprised 6.4%
Fear 6%
Confused 1.6%
Calm 1.2%
Angry 0.5%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 10-18
Gender Female, 97.5%
Sad 98.3%
Confused 39.5%
Surprised 6.3%
Fear 5.9%
Calm 4.1%
Angry 0.7%
Happy 0.2%
Disgusted 0.2%

AWS Rekognition

Age 11-19
Gender Female, 92.6%
Calm 39.7%
Fear 17%
Surprised 16.6%
Sad 10.6%
Angry 8.1%
Disgusted 3.6%
Happy 3.6%
Confused 2.8%

AWS Rekognition

Age 26-36
Gender Female, 60.9%
Happy 59.6%
Calm 25.5%
Surprised 6.7%
Sad 6.6%
Fear 6%
Confused 2%
Disgusted 1.8%
Angry 1.7%

AWS Rekognition

Age 20-28
Gender Male, 66.7%
Happy 84.9%
Surprised 6.5%
Fear 6.3%
Calm 5.9%
Sad 4.8%
Disgusted 0.8%
Angry 0.5%
Confused 0.3%

AWS Rekognition

Age 23-33
Gender Female, 89.9%
Sad 100%
Surprised 6.3%
Fear 5.9%
Angry 0.2%
Confused 0%
Calm 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 18-24
Gender Female, 92%
Sad 100%
Calm 10.2%
Surprised 6.7%
Fear 6.1%
Confused 1.1%
Happy 1.1%
Angry 0.9%
Disgusted 0.7%

AWS Rekognition

Age 1-7
Gender Male, 74.2%
Calm 96%
Surprised 6.6%
Fear 6%
Sad 2.4%
Confused 1%
Angry 0.6%
Disgusted 0.4%
Happy 0.3%

AWS Rekognition

Age 23-31
Gender Female, 97.3%
Calm 64.7%
Sad 46.7%
Surprised 7.1%
Fear 6%
Angry 3.4%
Happy 2.6%
Confused 0.8%
Disgusted 0.6%

AWS Rekognition

Age 23-31
Gender Female, 82.1%
Calm 39.4%
Disgusted 14.8%
Happy 14.1%
Confused 10.4%
Sad 10.2%
Surprised 7.3%
Fear 6.8%
Angry 5.6%

AWS Rekognition

Age 6-12
Gender Male, 76.1%
Sad 100%
Calm 13.7%
Surprised 6.3%
Fear 6.3%
Happy 0.9%
Confused 0.8%
Angry 0.4%
Disgusted 0.2%

AWS Rekognition

Age 21-29
Gender Male, 53.7%
Sad 92.6%
Fear 31.8%
Calm 17%
Surprised 6.6%
Confused 3.3%
Disgusted 1.9%
Angry 1.9%
Happy 0.7%

AWS Rekognition

Age 20-28
Gender Male, 89.3%
Happy 81.7%
Calm 9.4%
Surprised 6.4%
Fear 6%
Sad 4.4%
Confused 2.2%
Angry 0.7%
Disgusted 0.3%

Microsoft Cognitive Services

Age 24
Gender Male

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 22
Gender Male

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 37
Gender Female

Microsoft Cognitive Services

Age 25
Gender Female

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 8
Gender Male

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 31
Gender Female

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 8
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 12
Gender Female

Microsoft Cognitive Services

Age 36
Gender Female

Feature analysis

Amazon

Person 96.7%
Adult 94.3%
Female 94.3%
Woman 94.3%
Wheel 78.9%

Categories

Imagga

paintings art 94.9%
interior objects 2.7%