Human Generated Data

Title

Untitled (Yogyakarta, Java)
Date

January 26, 1960-February 2, 1960
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5052

Human Generated Data

Title

Untitled (Yogyakarta, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5052

Machine Generated Data

Tags

Amazon
created on 2023-10-05

People 99.8
Formal Wear 99.1
Clothing 98.7
Suit 98.7
Person 97.5
Adult 97.5
Bride 97.5
Female 97.5
Wedding 97.5
Woman 97.5
Architecture 96.8
Building 96.8
Monastery 96.8
Person 96.8
Person 96.6
Person 96
Dress 95.3
Person 94
Outdoors 93.3
Shelter 93.3
Person 92.8
Person 92.2
Person 90.8
Person 89.7
Person 89.5
Person 89.1
Person 89.1
Person 87.8
House 87
Housing 87
Villa 87
Person 85.6
Person 80.1
Person 78.7
Face 76.7
Head 76.7
Person 76.6
Fashion 76.5
Gown 76.5
Plant 75.7
Tree 75.7
Person 75.4
Coat 72.9
Person 72.8
Baby 72.8
Person 67.8
Person 61.3
Person 59.5
Staircase 57.7
Photography 57.5
Portrait 57.5
Wedding Gown 57.1
Nature 56.7
Bridegroom 56.5
Male 56.5
Man 56.5
Crowd 56.1
Accessories 55.9
Pool 55.9
Water 55.9
School 55.8
Potted Plant 55.7
Bag 55.6
Handbag 55.6
City 55.6
Shorts 55.6
Door 55.5
Animal 55.4
Canine 55.4
Mammal 55.4
Pet 55.4
Shirt 55.2
Urban 55.1
Hospital 55.1

Clarifai
created on 2018-05-10

people 99.8
adult 95.6
child 94.4
man 94.3
military 91.5
group 90.5
many 90.2
administration 89.6
group together 89.4
woman 88.1
war 86
wear 85.8
uniform 83.3
home 82.2
education 82.1
soldier 81.9
family 78.2
monochrome 76
boy 75.7
school 71.4

Imagga
created on 2023-10-05

architecture 27.5
statue 26.2
city 21.6
travel 21.1
uniform 20.9
tourism 19.8
building 19.2
military uniform 18.6
sculpture 18.2
landmark 18.1
war 16.3
old 16
stone 15.9
monument 15.9
clothing 15.8
historic 15.6
history 15.2
military 14.5
metropolitan 13
culture 12.8
tourist 12.6
religion 12.5
people 11.2
temple 11
private 10.8
ancient 10.4
famous 10.2
street 10.1
column 10
national 10
pedestrian 9.9
covering 9.7
structure 9.6
memorial 9.5
weapon 9.5
art 9.1
soldier 8.8
urban 8.7
consumer goods 8.5
cemetery 8.5
traditional 8.3
park 8.2
landscape 8.2
new 8.1
world 7.9
army 7.8
scene 7.8
tree 7.7
sky 7.6
gun 7.6
place 7.4
town 7.4
man 7.4
vacation 7.4
station 7.3
activity 7.2
palace 7.1

Google
created on 2018-05-10

photograph 95.9
black and white 87.3
snapshot 81.8
history 80.3
monochrome photography 66.5
monochrome 61.7
stock photography 52.5
team 51.2

Microsoft
created on 2018-05-10

outdoor 87.3
group 84.1
posing 82.7
old 72.6
clothes 15.3

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 18-26
Gender Male, 77.2%
Calm 81.9%
Surprised 6.5%
Fear 6.1%
Sad 4.8%
Disgusted 3.8%
Angry 3.3%
Confused 2.6%
Happy 1.5%

AWS Rekognition

Age 23-33
Gender Male, 99.8%
Calm 90%
Surprised 6.5%
Fear 5.9%
Confused 4.9%
Sad 3.3%
Angry 0.6%
Happy 0.4%
Disgusted 0.3%

AWS Rekognition

Age 16-22
Gender Female, 99.6%
Sad 99.9%
Happy 9.5%
Fear 7.4%
Surprised 6.9%
Confused 4.2%
Disgusted 1.6%
Calm 1.6%
Angry 0.8%

AWS Rekognition

Age 30-40
Gender Female, 57.2%
Sad 100%
Surprised 6.8%
Fear 6.2%
Confused 3.6%
Disgusted 1.1%
Angry 0.3%
Happy 0.2%
Calm 0.2%

AWS Rekognition

Age 6-16
Gender Male, 82.9%
Sad 84.1%
Surprised 39.9%
Calm 16%
Fear 9.9%
Angry 5.8%
Confused 2%
Happy 1.5%
Disgusted 1.2%

AWS Rekognition

Age 22-30
Gender Female, 100%
Happy 99.5%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Calm 0.3%
Disgusted 0%
Angry 0%
Confused 0%

AWS Rekognition

Age 18-26
Gender Female, 98.4%
Sad 50.8%
Fear 31.1%
Happy 21.9%
Calm 14.6%
Surprised 7.1%
Disgusted 2.2%
Angry 1.9%
Confused 1.4%

AWS Rekognition

Age 23-31
Gender Male, 55.3%
Fear 51.9%
Happy 47.4%
Surprised 6.6%
Sad 5.8%
Angry 0.8%
Calm 0.7%
Disgusted 0.5%
Confused 0.3%

AWS Rekognition

Age 22-30
Gender Female, 93.7%
Happy 50%
Calm 42.8%
Surprised 6.4%
Fear 6%
Sad 4.8%
Confused 0.3%
Disgusted 0.3%
Angry 0.2%

AWS Rekognition

Age 31-41
Gender Female, 89.1%
Sad 100%
Surprised 6.3%
Fear 6.1%
Confused 3.4%
Angry 3%
Calm 0.7%
Disgusted 0.5%
Happy 0.2%

AWS Rekognition

Age 28-38
Gender Male, 97.9%
Happy 93.1%
Surprised 6.3%
Fear 6.2%
Calm 4.4%
Sad 2.4%
Confused 0.3%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 27-37
Gender Female, 99.8%
Sad 96.6%
Happy 35.2%
Fear 6.7%
Surprised 6.6%
Angry 4.2%
Disgusted 3%
Calm 2.6%
Confused 2%

AWS Rekognition

Age 16-24
Gender Male, 92.6%
Happy 70.4%
Calm 14.4%
Surprised 8.7%
Fear 7.7%
Angry 3.8%
Sad 2.6%
Confused 1.2%
Disgusted 0.6%

AWS Rekognition

Age 19-27
Gender Female, 60.9%
Sad 83.8%
Happy 30.8%
Calm 15.9%
Surprised 7.2%
Fear 7%
Disgusted 5.1%
Confused 2.7%
Angry 2.6%

AWS Rekognition

Age 16-22
Gender Male, 98.6%
Sad 100%
Fear 6.9%
Surprised 6.5%
Disgusted 2.5%
Calm 2.3%
Angry 1.4%
Confused 0.8%
Happy 0.4%

AWS Rekognition

Age 23-31
Gender Male, 86%
Happy 90.7%
Surprised 6.5%
Fear 6.2%
Angry 3.5%
Sad 2.7%
Calm 2.1%
Disgusted 0.3%
Confused 0.3%

AWS Rekognition

Age 23-33
Gender Female, 57.2%
Happy 92.5%
Surprised 6.4%
Fear 5.9%
Calm 4.7%
Sad 2.6%
Confused 0.6%
Disgusted 0.2%
Angry 0.2%

AWS Rekognition

Age 19-27
Gender Male, 89.2%
Happy 59.1%
Surprised 25.6%
Fear 9%
Disgusted 5.1%
Sad 3.7%
Calm 2.5%
Confused 2.4%
Angry 1.2%

AWS Rekognition

Age 26-36
Gender Male, 90.4%
Happy 81.9%
Fear 9.6%
Surprised 6.8%
Sad 4.1%
Angry 3.2%
Disgusted 0.7%
Calm 0.4%
Confused 0.2%

AWS Rekognition

Age 9-17
Gender Female, 98%
Happy 78.9%
Calm 19.2%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Disgusted 0.6%
Angry 0.5%
Confused 0.3%

AWS Rekognition

Age 29-39
Gender Male, 99.8%
Calm 98.7%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Angry 0.3%
Disgusted 0.2%
Happy 0.1%
Confused 0.1%

AWS Rekognition

Age 25-35
Gender Male, 99.8%
Happy 94.8%
Fear 6.8%
Surprised 6.6%
Sad 2.2%
Angry 0.7%
Calm 0.6%
Disgusted 0.3%
Confused 0.2%

AWS Rekognition

Age 21-29
Gender Male, 98.4%
Calm 87.3%
Surprised 7%
Fear 6.2%
Happy 3.6%
Sad 3.6%
Disgusted 1.2%
Angry 1.1%
Confused 1%

AWS Rekognition

Age 20-28
Gender Male, 99.7%
Surprised 90.3%
Calm 33.6%
Fear 7.8%
Sad 2.4%
Angry 1.1%
Happy 1.1%
Disgusted 1.1%
Confused 0.7%

AWS Rekognition

Age 16-24
Gender Female, 93.8%
Surprised 52.1%
Angry 24.9%
Happy 16.6%
Disgusted 11.8%
Fear 6.5%
Sad 5.7%
Calm 3.8%
Confused 1.8%

AWS Rekognition

Age 24-34
Gender Female, 89.8%
Happy 79.8%
Calm 7.2%
Sad 6.9%
Surprised 6.7%
Fear 6.1%
Angry 1.4%
Disgusted 1.1%
Confused 0.4%

AWS Rekognition

Age 27-37
Gender Male, 97.2%
Sad 39.3%
Disgusted 35.5%
Confused 10.1%
Calm 9.7%
Happy 9.2%
Surprised 9%
Fear 6.7%
Angry 5.1%

AWS Rekognition

Age 18-26
Gender Male, 95.3%
Sad 64.2%
Happy 59.5%
Surprised 7.2%
Fear 6.6%
Angry 2.9%
Calm 1.6%
Confused 1%
Disgusted 0.4%

AWS Rekognition

Age 21-29
Gender Male, 99.8%
Calm 57.7%
Happy 35.6%
Surprised 6.8%
Fear 6.5%
Sad 2.6%
Confused 1.5%
Disgusted 0.9%
Angry 0.3%

AWS Rekognition

Age 14-22
Gender Female, 52.5%
Surprised 99.5%
Fear 6.6%
Calm 2.7%
Sad 2.5%
Confused 0.9%
Happy 0.3%
Angry 0.2%
Disgusted 0.2%

AWS Rekognition

Age 6-14
Gender Female, 82.3%
Confused 45.2%
Happy 20.7%
Sad 16.9%
Surprised 9.9%
Calm 9.2%
Fear 6.4%
Disgusted 1.2%
Angry 1.1%

Feature analysis

Amazon

Person 97.5%
Adult 97.5%
Bride 97.5%
Female 97.5%
Woman 97.5%
Baby 72.8%