Human Generated Data

Title

Untitled (Nijo Palace, Kyoto, Japan)

Date

March 15, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5449

Human Generated Data

Title

Untitled (Nijo Palace, Kyoto, Japan)

People

Artist: Ben Shahn, American 1898 - 1969

Date

March 15, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5449

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Formal Wear 100
People 99.9
Walking 99.9
Fashion 99.9
Suit 99.8
Dress 99.8
Gown 99.7
Person 99
Adult 99
Male 99
Man 99
Person 98.7
Adult 98.7
Male 98.7
Man 98.7
Person 98.6
Person 98.5
Adult 98.5
Female 98.5
Woman 98.5
Person 98.4
Plant 98.1
Tree 98.1
Person 98.1
Adult 98.1
Female 98.1
Woman 98.1
Person 97
Person 97
Person 96.8
Person 96.6
Overcoat 96.3
Outdoors 86.1
Coat 79.7
Nature 75.3
Face 67.5
Head 67.5
Accessories 64.7
Bag 64.7
Handbag 64.7
Garden 64.6
Footwear 58.4
Shoe 58.4
Architecture 57.9
Building 57.9
Monastery 57.9
Grass 57.5
Robe 57.3
Vegetation 56.5
Shoe 55.5
Park 55.5
Long Sleeve 55.1
Sleeve 55.1

Clarifai
created on 2018-05-10

people 99.8
group 98.6
group together 97.8
adult 97
many 96.3
man 96.1
child 95.5
woman 94.8
administration 94.5
leader 86.9
war 86.6
military 86.5
recreation 86.4
several 86
wear 86
home 85.8
family 82.6
boy 82.5
street 81.8
uniform 76.3

Imagga
created on 2023-10-06

pedestrian 49.1
people 26.8
walking 22.7
park 22.2
walk 20.9
man 20.9
person 20
child 18.3
outdoors 18
summer 16.7
grass 16.6
outdoor 16.1
male 15.2
sport 15
couple 14.8
clothing 14.2
tree 13.9
world 12.4
uniform 12.4
street 12
day 11.8
fall 11.8
city 11.6
trees 11.6
forest 11.3
travel 11.3
old 11.1
tourist 11
holding 10.7
boy 10.4
women 10.3
happiness 10.2
military uniform 9.9
life 9.7
landscape 9.7
together 9.6
love 9.5
men 9.4
spring 9.4
lifestyle 9.4
season 9.4
statue 8.6
field 8.4
environment 8.2
to 8
autumn 7.9
mother 7.7
hiking 7.7
youth 7.7
winter 7.7
two 7.6
path 7.6
happy 7.5
friends 7.5
friendship 7.5
fun 7.5
light 7.5
tourism 7.4
peaceful 7.3
adult 7.3
active 7.3
danger 7.3
group 7.3
road 7.2
black 7.2
religion 7.2
family 7.1
sky 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

outdoor 99.6
tree 99
person 92.9
standing 78.5
group 72.3
white 69.7
people 66.6
old 50.4
posing 37

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 31-41
Gender Female, 89.7%
Sad 100%
Calm 9%
Surprised 6.4%
Fear 6.2%
Confused 1.7%
Happy 0.4%
Angry 0.3%
Disgusted 0.2%

AWS Rekognition

Age 23-33
Gender Female, 66%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 0.5%
Confused 0.2%
Angry 0.1%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 33-41
Gender Female, 87.4%
Sad 100%
Surprised 6.3%
Fear 5.9%
Confused 0%
Disgusted 0%
Angry 0%
Happy 0%
Calm 0%

AWS Rekognition

Age 35-43
Gender Female, 100%
Sad 100%
Angry 6.8%
Surprised 6.6%
Disgusted 6.2%
Fear 6.1%
Confused 2.1%
Calm 0.7%
Happy 0.3%

AWS Rekognition

Age 23-33
Gender Female, 100%
Sad 92.3%
Disgusted 22.8%
Confused 12.9%
Fear 11.8%
Surprised 8%
Angry 2.6%
Calm 2.4%
Happy 0.7%

AWS Rekognition

Age 28-38
Gender Female, 98.2%
Sad 100%
Surprised 7%
Fear 6.1%
Confused 0.3%
Calm 0.2%
Angry 0.2%
Happy 0.2%
Disgusted 0.1%

AWS Rekognition

Age 49-57
Gender Male, 100%
Sad 81.6%
Confused 44.4%
Calm 14.7%
Surprised 7.1%
Fear 5.9%
Angry 1.3%
Disgusted 0.5%
Happy 0.1%

AWS Rekognition

Age 28-38
Gender Female, 99.9%
Sad 99.3%
Confused 20.8%
Surprised 14.8%
Fear 6.5%
Disgusted 2.6%
Calm 1.3%
Angry 0.8%
Happy 0.3%

AWS Rekognition

Age 22-30
Gender Male, 100%
Calm 71.6%
Sad 53.2%
Surprised 6.3%
Fear 5.9%
Confused 0.4%
Disgusted 0.1%
Angry 0.1%
Happy 0%

AWS Rekognition

Age 45-51
Gender Male, 77.6%
Sad 99.7%
Calm 13%
Confused 10.1%
Surprised 6.9%
Fear 6.8%
Angry 4%
Disgusted 0.9%
Happy 0.4%

AWS Rekognition

Age 21-29
Gender Male, 53.7%
Sad 97.9%
Calm 18%
Surprised 9.9%
Fear 9.5%
Angry 6.4%
Disgusted 4.4%
Confused 2.2%
Happy 1.7%

AWS Rekognition

Age 23-31
Gender Female, 77.4%
Calm 45.1%
Sad 29.9%
Fear 16.5%
Surprised 7.7%
Disgusted 6.6%
Angry 5.5%
Confused 1.3%
Happy 0.9%

AWS Rekognition

Age 23-31
Gender Female, 50.7%
Calm 85.6%
Surprised 6.7%
Fear 6.5%
Sad 6.1%
Confused 1.2%
Happy 1.2%
Angry 0.9%
Disgusted 0.8%

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 49
Gender Female

Microsoft Cognitive Services

Age 44
Gender Female

Microsoft Cognitive Services

Age 28
Gender Female

Feature analysis

Amazon

Person 99%
Adult 99%
Male 99%
Man 99%
Female 98.5%
Woman 98.5%
Coat 79.7%
Shoe 58.4%

Categories