Human Generated Data

Title

Untitled (Nijo Palace, Kyoto, Japan)

Date

March 15, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5471

Human Generated Data

Title

Untitled (Nijo Palace, Kyoto, Japan)

People

Artist: Ben Shahn, American 1898 - 1969

Date

March 15, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5471

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Dress 100
Fashion 100
Formal Wear 100
Gown 100
Walking 99.7
Architecture 99.1
Building 99.1
Outdoors 99.1
Shelter 99.1
Person 98.3
Person 98.3
Robe 98.2
Person 98.2
Person 98.2
Person 98.1
Person 98.1
Person 97.8
Person 97.8
Suit 97.6
Person 97.1
Person 97.1
Person 96.6
People 96.4
Person 95.6
Person 95.3
Person 95.3
Person 95.2
Person 93.6
Person 93.3
Monastery 87.8
Person 85.8
Person 83.4
Person 82.3
Person 82.1
Kimono 68.9
City 65.3
Coat 63.6
Person 62.2
Footwear 58.9
Shoe 58.9
Housing 56.3
Shoe 56
Overcoat 55.9
Urban 55.4

Clarifai
created on 2018-05-10

people 99.9
group 98.4
adult 97.3
group together 97.3
many 96.9
man 96.8
child 96.1
woman 93.3
street 87.7
wear 87
administration 86.6
military 86.2
education 86.2
leader 84.8
boy 84.8
home 84.5
several 84.1
uniform 82.1
war 81.3
school 75.5

Imagga
created on 2023-10-06

architecture 49.7
tourist 48.5
temple 44.7
building 38.1
traveler 27.9
city 27.4
travel 26.8
ancient 25.9
tourism 24.8
old 23.7
history 23.3
monument 22.4
landmark 20.8
religion 19.7
center 19.3
culture 17.1
construction 16.3
stone 16
house 16
china 16
person 15.7
roof 15.6
sky 15.3
church 13.9
hall 13.5
traditional 13.3
historic 12.8
office 12.7
palace 12.7
structure 12.7
sculpture 12.4
historical 12.2
famous 12.1
statue 11.6
worship 11.6
column 11.5
town 11.1
exterior 11.1
facade 10.4
religious 10.3
place 10.2
wall 10
new 9.7
urban 9.6
home 9.6
people 8.9
arch 8.9
england 8.6
wood 8.3
street 8.3
wooden 7.9
museum 7.7
garden 7.5
window 7.4
brick 7.4
square 7.2

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

building 99.4
outdoor 93.2
group 84.5
people 78.4
several 13.1

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 20-28
Gender Male, 97.6%
Fear 96.1%
Surprised 6.5%
Sad 4.7%
Calm 2.6%
Happy 1%
Angry 0.5%
Disgusted 0.5%
Confused 0.4%

AWS Rekognition

Age 23-33
Gender Female, 97.1%
Calm 77.1%
Fear 13.5%
Surprised 6.8%
Disgusted 2.7%
Sad 2.6%
Angry 1.5%
Happy 1.4%
Confused 1.1%

AWS Rekognition

Age 20-28
Gender Male, 88.5%
Fear 97.9%
Surprised 6.3%
Sad 2.3%
Calm 0.9%
Happy 0.2%
Confused 0.2%
Angry 0.1%
Disgusted 0%

AWS Rekognition

Age 18-26
Gender Male, 85.5%
Sad 99.3%
Calm 37.2%
Surprised 6.3%
Fear 6%
Angry 0.7%
Disgusted 0.2%
Happy 0.2%
Confused 0.1%

AWS Rekognition

Age 19-27
Gender Male, 99.1%
Happy 53%
Angry 13.4%
Calm 10.5%
Fear 10.1%
Surprised 7.9%
Sad 4.1%
Confused 3.8%
Disgusted 3%

AWS Rekognition

Age 12-20
Gender Female, 98.1%
Calm 81.9%
Fear 9.6%
Surprised 6.8%
Sad 3.5%
Confused 1.5%
Happy 1.5%
Angry 1.4%
Disgusted 1.3%

AWS Rekognition

Age 13-21
Gender Female, 88.4%
Calm 80.2%
Fear 11%
Surprised 6.5%
Sad 3.9%
Disgusted 1.7%
Happy 1.5%
Angry 1.3%
Confused 0.4%

AWS Rekognition

Age 29-39
Gender Male, 99.9%
Calm 71.8%
Sad 22.2%
Fear 6.7%
Surprised 6.4%
Angry 3.1%
Happy 2.4%
Disgusted 1.6%
Confused 0.7%

AWS Rekognition

Age 18-24
Gender Female, 98.2%
Angry 94%
Surprised 6.4%
Fear 6%
Sad 2.8%
Calm 1.8%
Happy 0.7%
Disgusted 0.7%
Confused 0.1%

AWS Rekognition

Age 19-27
Gender Male, 86.8%
Sad 83.6%
Calm 48.8%
Fear 6.9%
Surprised 6.7%
Confused 6.2%
Angry 2.1%
Happy 0.9%
Disgusted 0.7%

AWS Rekognition

Age 18-26
Gender Male, 98.3%
Sad 100%
Calm 8.1%
Surprised 6.4%
Fear 6%
Confused 1.1%
Angry 1.1%
Disgusted 0.3%
Happy 0.2%

Feature analysis

Amazon

Person 98.3%
Coat 63.6%
Shoe 58.9%

Categories