Human Generated Data

Title

Untitled (cremation ceremony, Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5045

Human Generated Data

Title

Untitled (cremation ceremony, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5045

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Human 99.7
Person 99.7
Person 99.6
Person 99.4
Person 99.1
Person 99
Person 98.8
Person 97.9
Person 97.6
Person 96.9
Person 95.7
Person 94.7
Person 93.4
Crowd 92.9
Person 90.5
Person 87.7
Meal 85.6
Food 85.6
Person 85.4
Person 84.8
Person 84.4
People 83
Person 82.6
Apparel 74
Clothing 74
Tree 72.4
Plant 72.4
Person 71.3
Urban 67.7
Leisure Activities 66.2
Person 63.3
Outdoors 63.2
Vehicle 62.2
Bicycle 62.2
Transportation 62.2
Bike 62.2
Person 61.1
Picnic 60.8
Vacation 60.8
Parade 57.5
Musician 57.2
Musical Instrument 57.2
Festival 56.5
Female 55.6

Clarifai
created on 2018-03-23

people 100
many 99.9
group 99.6
group together 99.4
adult 98.4
crowd 96.2
child 94.6
man 94.4
war 93.3
woman 93
military 92.9
administration 92.9
soldier 89.8
several 89.5
wear 87
vehicle 85.3
interaction 85
skirmish 82.2
recreation 81.5
spectator 80.4

Imagga
created on 2018-03-23

kin 35.6
park 24.7
tree 20.1
people 19.5
outdoor 19.1
outdoors 18.3
man 18.1
forest 17.4
person 17
water 16
landscape 15.6
pedestrian 15
summer 14.8
adult 13.8
group 13.7
fan 13.6
walk 13.3
male 12.9
hiking 12.5
couple 12.2
life 12
travel 12
walking 11.4
happy 11.3
scene 11.2
beach 11
child 11
fountain 10.9
lifestyle 10.8
environment 10.7
autumn 10.5
grass 10.3
winter 10.2
follower 10.2
lake 10.1
leisure 10
fall 9.9
river 9.8
trees 9.8
old 9.7
clothing 9.7
fun 9.7
serene 9.4
two 9.3
city 9.1
girls 9.1
sky 8.9
color 8.9
country 8.8
leaves 8.7
birds 8.7
women 8.7
day 8.6
happiness 8.6
holiday 8.6
men 8.6
active 8.5
world 8.4
spectator 8.4
peaceful 8.2
tranquil 8.1
standing 7.8
snow 7.6
vacations 7.5
tourism 7.4
natural 7.4
light 7.3
national 7.2
bench 7.2
sexy 7.2
recreation 7.2
activity 7.2
smile 7.1
sunlight 7.1
mountain 7.1
love 7.1
sea 7

Google
created on 2018-03-23

people 97.1
crowd 93.9
black and white 88.1
tree 87.5
recreation 71.9
monochrome photography 69.9
monochrome 65.9
plant 59.8
vehicle 54.8
history 54.2
style 51.1

Microsoft
created on 2018-03-23

person 99.9
tree 99.8
outdoor 99.3
group 94.9
people 90.3
posing 69.9
old 65.4
crowd 28.4

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 26-43
Gender Male, 51.9%
Calm 47.2%
Surprised 45.3%
Confused 45.7%
Angry 48.4%
Sad 47.6%
Happy 45.2%
Disgusted 45.6%

AWS Rekognition

Age 26-43
Gender Male, 51.7%
Disgusted 45.2%
Happy 45.1%
Surprised 45.4%
Sad 46.8%
Calm 51.3%
Angry 45.6%
Confused 45.5%

AWS Rekognition

Age 26-43
Gender Female, 54.4%
Happy 45.4%
Confused 46.8%
Calm 47.2%
Sad 45.3%
Angry 45.8%
Disgusted 48.6%
Surprised 45.9%

AWS Rekognition

Age 29-45
Gender Male, 54.2%
Surprised 45.2%
Confused 45.3%
Calm 45.3%
Sad 46.4%
Happy 45.2%
Disgusted 51%
Angry 46.6%

AWS Rekognition

Age 26-43
Gender Male, 51.8%
Disgusted 45.7%
Surprised 45.5%
Happy 46.1%
Confused 45.6%
Calm 49.4%
Sad 46.5%
Angry 46.3%

AWS Rekognition

Age 26-43
Gender Female, 50%
Confused 49.5%
Sad 49.9%
Calm 49.8%
Happy 49.7%
Surprised 49.5%
Angry 49.5%
Disgusted 49.5%

AWS Rekognition

Age 23-38
Gender Female, 50.4%
Happy 49.7%
Disgusted 49.5%
Calm 49.5%
Sad 49.9%
Confused 49.5%
Angry 49.7%
Surprised 49.5%

AWS Rekognition

Age 26-43
Gender Male, 50.1%
Calm 49.6%
Disgusted 49.6%
Sad 50.1%
Angry 49.6%
Confused 49.5%
Surprised 49.5%
Happy 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Disgusted 49.5%
Calm 49.9%
Happy 49.5%
Angry 49.8%
Sad 49.7%
Confused 49.5%
Surprised 49.6%

AWS Rekognition

Age 6-13
Gender Male, 50.2%
Sad 49.6%
Angry 49.8%
Disgusted 49.5%
Surprised 49.5%
Calm 49.9%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 4-9
Gender Female, 50.5%
Disgusted 49.5%
Calm 49.6%
Confused 49.5%
Surprised 49.5%
Sad 49.9%
Happy 49.5%
Angry 49.9%

AWS Rekognition

Age 20-38
Gender Female, 50.1%
Calm 49.7%
Confused 49.6%
Surprised 49.6%
Disgusted 49.6%
Happy 49.6%
Angry 49.9%
Sad 49.7%

AWS Rekognition

Age 27-44
Gender Male, 50.2%
Disgusted 49.5%
Surprised 49.6%
Happy 49.7%
Confused 49.6%
Calm 49.9%
Sad 49.7%
Angry 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Happy 49.7%
Confused 49.5%
Sad 49.7%
Angry 49.6%
Calm 49.6%
Disgusted 49.6%
Surprised 49.6%

AWS Rekognition

Age 26-43
Gender Female, 54%
Disgusted 45.2%
Happy 45.2%
Surprised 45.1%
Sad 45.8%
Calm 53.5%
Angry 45.1%
Confused 45.1%

AWS Rekognition

Age 29-45
Gender Female, 50.5%
Sad 49.9%
Calm 49.5%
Angry 49.6%
Surprised 49.6%
Confused 49.5%
Happy 49.6%
Disgusted 49.7%

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 11
Gender Female

Feature analysis

Amazon

Person 99.7%
Bicycle 62.2%