Human Generated Data

Title

Untitled (Horse Dance, Java)
Date

January 26, 1960-February 2, 1960
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5135

Human Generated Data

Title

Untitled (Horse Dance, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5135

Machine Generated Data

Tags

Amazon
created on 2023-10-06

People 100
Person 98.3
Person 98.1
Adult 98.1
Male 98.1
Man 98.1
Person 97.7
Person 95.9
Person 95.5
Person 94.1
Person 92.8
Person 92.2
Person 89.9
Person 89.9
Person 88.5
Person 88.2
Person 86.9
Person 86.7
Person 85.4
Person 85.1
Person 83.7
Person 82.5
Person 81.2
Person 79.3
Person 77
Person 72.3
Weapon 69.1
Head 67.4
Person 67
Sport 65.1
Volleyball 65.1
Volleyball Game 65.1
Person 64.8
Person 63.8
Person 62.6
Swordfight 57.7
Bullfighter 55.9
Face 55.8
Duel 55.5
Person 55.4
Person 55.3

Clarifai
created on 2018-05-10

people 100
many 99.8
group together 99.7
group 99.5
adult 97.3
man 96.5
military 92.2
war 90.7
several 90.4
child 89.1
crowd 85.9
soldier 85.8
spectator 83.3
recreation 80.8
administration 80.2
woman 77.5
dancing 75.3
wear 72.4
skirmish 72
weapon 70.2

Imagga
created on 2023-10-06

beach 44.5
sand 34.7
sea 29.7
vacation 29.5
summer 25.7
outdoors 25.2
travel 23.2
ocean 22.4
people 22.3
water 20
child 19.9
man 19.5
sky 19.1
sport 18.1
coast 18
active 17.4
male 17.2
swimsuit 16.9
shore 16.7
lifestyle 16.6
running 16.3
swimming trunks 16.2
walking 16.1
outdoor 14.5
person 14.3
couple 13.9
boy 13.9
holiday 13.6
fun 13.5
family 13.3
garment 12.8
two 12.7
happy 12.5
leisure 12.5
walk 12.4
mother 12.3
together 12.3
engineer 12.2
tropical 11.9
clothing 11.6
run 11.6
animal 11.4
sun 11.3
sunny 11.2
men 11.2
playing 10.9
parent 10.6
pedestrian 10.5
father 10.4
love 10.3
waves 10.2
adult 9.8
kid 9.8
relax 9.3
sunset 9
recreation 9
landscape 8.9
dad 8.8
jump 8.6
happiness 8.6
outside 8.6
horse 8.5
vacations 8.5
joy 8.4
life 8.2
group 8.1
athlete 8
mountain 8
son 7.9
rock 7.8
play 7.8
attractive 7.7
coastline 7.5
desert 7.5
park 7.4
joyful 7.4
tourist 7.4
women 7.1

Google
created on 2018-05-10

people 96.9
photograph 95.5
black and white 89.5
tree 84.4
standing 79.1
history 73
monochrome photography 71.6
monochrome 67.2
recreation 60.2
stock photography 60.1

Microsoft
created on 2018-05-10

outdoor 96.9
sport 88.4
player 67.6
white 61.7
old 42.1
dirt 20.6

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 13-21
Gender Female, 82.2%
Disgusted 33.1%
Angry 28.1%
Calm 19.5%
Surprised 12.9%
Fear 6.6%
Confused 4.2%
Sad 3.1%
Happy 1.4%

AWS Rekognition

Age 4-12
Gender Female, 99.4%
Sad 80.8%
Calm 59.2%
Surprised 6.3%
Fear 6%
Angry 3%
Confused 0.4%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 7-17
Gender Male, 100%
Calm 74.4%
Fear 14%
Surprised 6.7%
Angry 5.9%
Sad 2.7%
Happy 1.6%
Confused 0.7%
Disgusted 0.6%

AWS Rekognition

Age 14-22
Gender Male, 90.2%
Calm 66.1%
Fear 22.4%
Surprised 7%
Confused 4.1%
Angry 3.1%
Sad 2.6%
Happy 0.6%
Disgusted 0.6%

AWS Rekognition

Age 24-34
Gender Female, 79.9%
Calm 60.5%
Confused 14.7%
Angry 12.8%
Surprised 8%
Fear 6.1%
Disgusted 3.4%
Sad 3%
Happy 2.7%

AWS Rekognition

Age 22-30
Gender Male, 89.9%
Calm 90.5%
Fear 6.8%
Surprised 6.8%
Sad 2.7%
Angry 2.4%
Happy 0.8%
Disgusted 0.8%
Confused 0.4%

AWS Rekognition

Age 20-28
Gender Female, 54.2%
Sad 100%
Surprised 7.3%
Fear 7%
Calm 3%
Disgusted 2.9%
Angry 1.4%
Happy 0.6%
Confused 0.6%

AWS Rekognition

Age 11-19
Gender Male, 72.9%
Angry 91.3%
Calm 6.5%
Surprised 6.5%
Fear 5.9%
Sad 2.3%
Confused 0.5%
Disgusted 0.5%
Happy 0.1%

AWS Rekognition

Age 13-21
Gender Female, 91.8%
Calm 71.7%
Sad 13.2%
Fear 6.8%
Angry 6.7%
Surprised 6.7%
Confused 2.1%
Happy 1.7%
Disgusted 0.9%

AWS Rekognition

Age 2-8
Gender Female, 96.8%
Calm 87.1%
Fear 7.3%
Surprised 6.7%
Sad 3.6%
Happy 1.9%
Angry 1.4%
Disgusted 0.8%
Confused 0.8%

AWS Rekognition

Age 23-31
Gender Male, 98.5%
Sad 92.3%
Calm 34.8%
Confused 12.6%
Surprised 7.2%
Fear 6.3%
Disgusted 2.8%
Angry 1.4%
Happy 1.3%

AWS Rekognition

Age 14-22
Gender Male, 59.5%
Fear 97.1%
Surprised 6.9%
Sad 3%
Calm 2%
Confused 0.4%
Angry 0.3%
Happy 0.2%
Disgusted 0.2%

AWS Rekognition

Age 22-30
Gender Male, 99.6%
Calm 85.4%
Fear 8.6%
Surprised 6.5%
Angry 4.8%
Sad 2.6%
Happy 0.6%
Disgusted 0.5%
Confused 0.5%

AWS Rekognition

Age 22-30
Gender Female, 95%
Surprised 99.7%
Fear 5.9%
Sad 2.2%
Calm 0.1%
Confused 0%
Angry 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 9-17
Gender Male, 67.5%
Disgusted 49%
Fear 18.4%
Angry 11.6%
Calm 7.5%
Surprised 7%
Sad 7%
Confused 1.5%
Happy 1.2%

AWS Rekognition

Age 19-27
Gender Male, 99.5%
Calm 86.4%
Surprised 8.1%
Fear 6.1%
Angry 5.1%
Sad 2.8%
Confused 1.4%
Disgusted 0.7%
Happy 0.7%

AWS Rekognition

Age 20-28
Gender Male, 98.1%
Calm 97.6%
Surprised 6.8%
Fear 5.9%
Sad 2.2%
Angry 0.4%
Disgusted 0.3%
Happy 0.2%
Confused 0.2%

AWS Rekognition

Age 16-22
Gender Female, 64%
Calm 91.1%
Surprised 6.6%
Fear 6%
Sad 3.4%
Angry 2.8%
Confused 1.2%
Disgusted 0.4%
Happy 0.3%

AWS Rekognition

Age 4-12
Gender Female, 74.9%
Sad 70.1%
Calm 43.7%
Fear 11.6%
Surprised 7%
Angry 4.6%
Happy 3.9%
Disgusted 1.7%
Confused 1.1%

AWS Rekognition

Age 2-8
Gender Male, 99.8%
Calm 83.3%
Surprised 8.5%
Fear 6.1%
Angry 6%
Disgusted 2.6%
Sad 2.4%
Happy 2.1%
Confused 0.8%

AWS Rekognition

Age 2-8
Gender Male, 98.9%
Sad 78.5%
Angry 31.1%
Calm 19%
Fear 7.8%
Surprised 6.8%
Confused 3.8%
Happy 3.1%
Disgusted 1.6%

AWS Rekognition

Age 9-17
Gender Female, 95.6%
Fear 72.3%
Calm 32.6%
Surprised 6.5%
Sad 4.1%
Angry 3.2%
Happy 1.7%
Disgusted 1.4%
Confused 0.4%

AWS Rekognition

Age 18-26
Gender Male, 66.1%
Fear 82.7%
Calm 28.2%
Surprised 6.5%
Sad 3%
Happy 2.5%
Angry 0.8%
Confused 0.6%
Disgusted 0.5%

AWS Rekognition

Age 10-18
Gender Male, 95.1%
Angry 51.1%
Surprised 29.5%
Calm 14.2%
Fear 6.8%
Sad 3.6%
Confused 3.3%
Happy 2.7%
Disgusted 1.5%

AWS Rekognition

Age 2-10
Gender Female, 83.5%
Fear 44.5%
Calm 27.5%
Happy 12.4%
Angry 8.2%
Surprised 7.8%
Sad 5.9%
Confused 2.8%
Disgusted 1.1%

AWS Rekognition

Age 18-26
Gender Male, 97.1%
Calm 94.3%
Surprised 6.6%
Fear 6.1%
Sad 2.8%
Angry 1.3%
Disgusted 0.6%
Happy 0.5%
Confused 0.4%

AWS Rekognition

Age 6-14
Gender Male, 87%
Calm 90.8%
Surprised 6.7%
Fear 6%
Angry 5.2%
Sad 2.9%
Confused 0.3%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 2-10
Gender Male, 96%
Calm 95%
Surprised 6.5%
Fear 6.1%
Sad 2.4%
Happy 1.3%
Confused 0.7%
Angry 0.6%
Disgusted 0.5%

AWS Rekognition

Age 4-10
Gender Female, 79.1%
Fear 93.2%
Sad 8.8%
Surprised 6.6%
Calm 3.9%
Confused 3%
Happy 0.7%
Angry 0.6%
Disgusted 0.4%

AWS Rekognition

Age 12-20
Gender Male, 74.8%
Calm 95.7%
Surprised 6.3%
Fear 5.9%
Sad 2.9%
Angry 0.8%
Happy 0.6%
Confused 0.2%
Disgusted 0.1%

AWS Rekognition

Age 6-16
Gender Male, 99.2%
Calm 71.8%
Angry 15.2%
Surprised 6.8%
Confused 6.3%
Fear 6.1%
Sad 3.3%
Disgusted 1.2%
Happy 1.1%

AWS Rekognition

Age 27-37
Gender Male, 99.4%
Sad 99.9%
Calm 11.1%
Fear 6.7%
Surprised 6.6%
Happy 3.8%
Confused 1.4%
Angry 1.4%
Disgusted 1.3%

AWS Rekognition

Age 22-30
Gender Male, 99.3%
Sad 99.9%
Surprised 13.9%
Fear 10.7%
Angry 1.8%
Disgusted 1.6%
Calm 1.5%
Happy 0.7%
Confused 0.4%

AWS Rekognition

Age 20-28
Gender Male, 96.2%
Calm 97.1%
Surprised 6.4%
Fear 5.9%
Sad 2.5%
Confused 0.6%
Angry 0.5%
Happy 0.2%
Disgusted 0.1%

AWS Rekognition

Age 19-27
Gender Male, 95.4%
Calm 57.6%
Happy 34.6%
Surprised 6.5%
Fear 6%
Sad 4.2%
Angry 1.2%
Disgusted 0.5%
Confused 0.4%

AWS Rekognition

Age 13-21
Gender Female, 73.7%
Sad 99.5%
Calm 32.7%
Surprised 6.4%
Fear 6%
Happy 1.4%
Angry 1%
Disgusted 0.6%
Confused 0.5%

AWS Rekognition

Age 2-8
Gender Male, 94.8%
Calm 66.1%
Sad 10.8%
Angry 7.4%
Fear 6.9%
Surprised 6.9%
Happy 4.6%
Confused 3.8%
Disgusted 2.3%

AWS Rekognition

Age 9-17
Gender Female, 52.9%
Calm 93.9%
Surprised 6.6%
Fear 6.2%
Sad 2.6%
Angry 1.5%
Happy 0.8%
Confused 0.7%
Disgusted 0.3%

AWS Rekognition

Age 23-31
Gender Male, 98.9%
Calm 84.9%
Fear 8.4%
Surprised 7%
Sad 2.8%
Angry 2.2%
Happy 1.9%
Disgusted 1.4%
Confused 0.7%

AWS Rekognition

Age 21-29
Gender Male, 98.4%
Sad 98.8%
Calm 37.3%
Surprised 6.5%
Fear 6.1%
Happy 1.7%
Confused 0.9%
Angry 0.8%
Disgusted 0.5%

AWS Rekognition

Age 10-18
Gender Male, 99.2%
Calm 76.1%
Sad 18.4%
Surprised 6.5%
Fear 6.2%
Happy 2.9%
Angry 1.3%
Confused 1.1%
Disgusted 0.9%

Feature analysis

Amazon

Person 98.3%
Adult 98.1%
Male 98.1%
Man 98.1%

Captions

Microsoft
created on 2018-05-10

a vintage photo of a person 87.2%
a vintage photo of a group of people 85.3%
a vintage photo of some people 85.2%