Human Generated Data

Title

Untitled (Nijo Palace, Kyoto, Japan)

Date

March 15, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5467

Human Generated Data

Title

Untitled (Nijo Palace, Kyoto, Japan)

People

Artist: Ben Shahn, American 1898 - 1969

Date

March 15, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5467

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Person 99.7
Human 99.7
Person 99.6
Person 99.6
Person 99.4
Person 99.4
Person 99.2
Person 99
Person 98.9
Person 98.6
Person 97.2
Person 94
Pedestrian 93.6
Clothing 92.7
Apparel 92.7
People 88.2
Crowd 86.7
Walking 86.3
Marching 75.6
Outdoors 75.4
Coat 71.9
Overcoat 71.5
Footwear 70.8
Shoe 70.8
Military 65.7
Parade 64.4
Officer 63.6
Military Uniform 63.6
Suit 57.2
Shoe 55.5
Shoe 52.3
Shoe 51.5
Shoe 51

Clarifai
created on 2018-03-23

people 99.9
group together 99.9
many 99.5
group 99.4
adult 97.9
child 97.2
several 97.1
man 96.2
leader 95.4
uniform 94.9
woman 94.8
administration 94.4
military 94.3
wear 93.1
war 91.8
five 90.5
outfit 89
recreation 86.4
soldier 84.6
education 84.1

Imagga
created on 2018-03-23

man 32.9
sport 30.9
people 26.2
male 23.7
walking 22.7
outdoors 22.3
pedestrian 21.8
couple 20.9
person 20.9
walk 20
snow 18
winter 17.9
child 17.6
grass 17.4
world 16.5
park 16.5
outdoor 16.1
lifestyle 15.2
city 15
men 14.6
adult 14.6
outside 14.6
skate 14.3
together 14
ball 13.9
cold 13.8
fun 13.5
golf 13.4
street 12.9
exercise 12.7
recreation 12.6
trees 12.5
course 12.4
active 12.3
weapon 12.2
happy 11.9
women 11.9
day 11.8
sword 11.7
boy 11.3
senior 11.3
love 11
golfer 11
happiness 11
life 10.8
leisure 10.8
play 10.3
girls 10
tree 10
travel 9.9
family 9.8
forest 9.6
drive 9.5
healthy 9.5
swing 9.3
action 9.3
tourist 9.3
summer 9
vacation 9
tee 8.8
standing 8.7
retirement 8.6
season 8.6
two 8.5
father 8.4
playing 8.2
urban 7.9
old 7.7
sky 7.7
mother 7.6
landscape 7.4
group 7.3
fitness 7.2
cute 7.2
portrait 7.1
kid 7.1
to 7.1
spring 7.1

Google
created on 2018-03-23

white 95.8
photograph 95.4
black 95.3
infrastructure 88.1
black and white 87.1
snapshot 81.8
photography 80.2
standing 76.9
monochrome photography 72.5
car 71.3
recreation 71.1
vehicle 69.1
tree 68.9
monochrome 66.9
street 64.9
road 52.4
crowd 52.2
style 51.6

Microsoft
created on 2018-03-23

outdoor 100
person 99.6
road 98.4
group 70.2
sport 66.7
dancer 66.5

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 14-25
Gender Male, 53.8%
Disgusted 45.7%
Surprised 45.3%
Angry 46%
Sad 50%
Confused 46%
Happy 45.2%
Calm 46.8%

AWS Rekognition

Age 19-36
Gender Male, 53.2%
Confused 45.4%
Surprised 45.4%
Happy 45.2%
Angry 45.5%
Disgusted 45.3%
Sad 46.3%
Calm 52%

AWS Rekognition

Age 26-43
Gender Female, 51.3%
Confused 45.2%
Sad 46.6%
Calm 52.4%
Happy 45.1%
Surprised 45.2%
Angry 45.3%
Disgusted 45.1%

AWS Rekognition

Age 15-25
Gender Male, 54.3%
Calm 54.7%
Disgusted 45.1%
Angry 45%
Surprised 45.1%
Confused 45.1%
Sad 45.1%
Happy 45%

AWS Rekognition

Age 27-44
Gender Male, 50.1%
Confused 45%
Surprised 45.1%
Angry 45.1%
Sad 45.1%
Happy 45%
Calm 54.7%
Disgusted 45%

AWS Rekognition

Age 26-43
Gender Male, 50.2%
Disgusted 45%
Surprised 45.1%
Angry 45.1%
Sad 45.1%
Confused 45%
Happy 45%
Calm 54.7%

AWS Rekognition

Age 14-23
Gender Male, 54.7%
Disgusted 45.8%
Confused 45.4%
Angry 45.4%
Surprised 45.5%
Happy 45.1%
Sad 45.3%
Calm 52.5%

AWS Rekognition

Age 26-43
Gender Female, 52.6%
Surprised 45.6%
Confused 45.3%
Disgusted 45.4%
Calm 52.6%
Angry 45.5%
Sad 45.3%
Happy 45.2%

AWS Rekognition

Age 26-44
Gender Female, 51.6%
Confused 45.9%
Calm 45.5%
Angry 50.2%
Sad 47.6%
Surprised 45.4%
Disgusted 45.1%
Happy 45.2%

AWS Rekognition

Age 26-43
Gender Male, 51.9%
Disgusted 49.2%
Confused 45.6%
Angry 46.5%
Surprised 45.8%
Calm 45.7%
Happy 45.9%
Sad 46.3%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Angry 49.5%
Calm 50.4%
Happy 49.5%
Disgusted 49.5%
Surprised 49.5%
Sad 49.5%
Confused 49.5%

Microsoft Cognitive Services

Age 19
Gender Female

Feature analysis

Amazon

Person 99.7%
Shoe 70.8%