Human Generated Data

Title

Pilgrimage to Tashilunpo, Tibet

Date

1992

People

Artist: Antonia DuBrul, American born 1936

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Melvin R. Seiden and Janine Luke, P2002.6

Human Generated Data

Title

Pilgrimage to Tashilunpo, Tibet

People

Artist: Antonia DuBrul, American born 1936

Date

1992

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 98.8
Human 98.8
Person 98
Flagstone 97.8
Pet 97.6
Dog 97.6
Mammal 97.6
Animal 97.6
Canine 97.6
Clothing 96.1
Apparel 96.1
Person 91.7
Person 90.5
Dog 87.5
Person 73.7
Cloak 70.2
Fashion 70.2
Person 62.1
Path 61.8
Walkway 56.1

Imagga
created on 2022-02-26

monk 42.1
stone 27
travel 26
rock 19.1
white 17.3
people 16.7
outdoors 16.5
mountain 15.1
landscape 14.9
tourism 14.8
old 14.6
person 14.5
desert 14
outdoor 13.8
history 12.5
tree 12.3
sand 12.2
man 12.1
building 12
architecture 11.7
rural 11.5
ancient 11.2
mountains 11.1
sky 10.8
park 10.7
water 10.7
canyon 10.7
camel 9.9
farm 9.8
summer 9.6
walking 9.5
rocks 9.4
wall 9.2
ocean 9.1
pen 8.8
natural 8.7
tourist 8.7
hiking 8.7
construction 8.6
culture 8.5
hill 8.4
monument 8.4
house 8.4
national 8.2
landmark 8.1
light 8
male 7.9
sea 7.8
hike 7.8
antique 7.8
rocky 7.7
outside 7.7
winter 7.7
cattle 7.6
beach 7.6
ranch 7.6
historical 7.5
wood 7.5
city 7.5
rest 7.4
snow 7.4
simpleton 7.4
life 7.3
structure 7.3
sun 7.2
dairy 7.1
work 7.1

Google
created on 2022-02-26

Dog 94.9
Photograph 94.2
Vertebrate 92.3
Light 91.1
Black 89.9
Carnivore 87.9
Mammal 85.5
Adaptation 79.2
Tints and shades 77.4
Art 75.7
Snapshot 74.3
People in nature 74.2
Trunk 72.1
Street 69.3
Companion dog 68.4
Monochrome photography 67.7
Shadow 67.6
Monochrome 67.5
Visual arts 66.8
Tree 65.5

Microsoft
created on 2022-02-26

outdoor 98.5
ground 95.6
street 95.4
dog 95.4
carnivore 89.2
animal 79
man 73.3
text 60.2
clothing 54.6

Face analysis

Amazon

Google

AWS Rekognition

Age 43-51
Gender Female, 50.1%
Sad 85.5%
Calm 7.1%
Angry 1.5%
Disgusted 1.3%
Surprised 1.2%
Fear 1.2%
Happy 1.1%
Confused 1.1%

AWS Rekognition

Age 16-22
Gender Male, 96.4%
Calm 93.6%
Sad 3.4%
Confused 1%
Disgusted 1%
Angry 0.4%
Surprised 0.3%
Fear 0.2%
Happy 0.1%

AWS Rekognition

Age 7-17
Gender Male, 96%
Calm 92%
Sad 4%
Angry 1.4%
Confused 0.9%
Happy 0.5%
Disgusted 0.5%
Surprised 0.4%
Fear 0.3%

AWS Rekognition

Age 22-30
Gender Male, 79.6%
Calm 55.9%
Sad 40.4%
Confused 1.2%
Fear 0.9%
Happy 0.5%
Disgusted 0.5%
Surprised 0.3%
Angry 0.3%

AWS Rekognition

Age 13-21
Gender Male, 80.2%
Calm 48.1%
Sad 31%
Fear 5.5%
Disgusted 5.4%
Angry 3.8%
Surprised 3.4%
Happy 1.6%
Confused 1.2%

AWS Rekognition

Age 21-29
Gender Male, 99.7%
Happy 77.3%
Calm 13.6%
Fear 2.4%
Angry 2.2%
Sad 1.4%
Surprised 1.3%
Confused 1%
Disgusted 0.9%

AWS Rekognition

Age 11-19
Gender Male, 69.6%
Calm 84.2%
Sad 5.6%
Happy 5.4%
Fear 1.8%
Disgusted 1%
Angry 1%
Surprised 0.6%
Confused 0.5%

AWS Rekognition

Age 16-24
Gender Male, 88.8%
Calm 80.4%
Happy 6.1%
Sad 5.7%
Disgusted 2.8%
Fear 1.7%
Angry 1.5%
Surprised 0.9%
Confused 0.9%

AWS Rekognition

Age 16-24
Gender Female, 99.2%
Calm 63%
Fear 15.7%
Happy 10.6%
Sad 7.2%
Confused 1.6%
Surprised 0.8%
Disgusted 0.7%
Angry 0.6%

AWS Rekognition

Age 10-18
Gender Female, 75.4%
Calm 86.1%
Fear 3.9%
Sad 3.4%
Disgusted 1.9%
Surprised 1.9%
Confused 1.1%
Angry 1.1%
Happy 0.6%

AWS Rekognition

Age 16-24
Gender Male, 61.6%
Calm 77.4%
Sad 6.3%
Angry 5.4%
Surprised 4.1%
Happy 3.6%
Fear 1.8%
Confused 0.8%
Disgusted 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Dog 97.6%

Captions

Microsoft

a person standing next to a dog 59.1%
a person standing in front of a brick building 59%
a person standing in front of a building 58.9%