Human Generated Data

Title

C53 Japanese Shoe Shop

Date

1890s

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Daniel Tassel and Janet Tassel, P2004.74

Human Generated Data

Title

C53 Japanese Shoe Shop

People

Artist: Unidentified Artist,

Date

1890s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.4
Human 99.4
Person 99.1
Shop 98.9
Person 98.4
Market 96.7
Person 96.1
Bazaar 90.1
Grocery Store 82.9
Kiosk 63.2
Person 61.9
Butcher Shop 60.2

Imagga
created on 2022-01-08

palanquin 52.2
temple 47.6
litter 41.6
seller 33.5
architecture 32.8
conveyance 31.5
religion 27.8
building 26.2
old 25.1
culture 24.8
china 24.4
travel 23.9
house 22.3
roof 21.1
ancient 20.8
traditional 20
tourism 19
history 18.8
structure 18.7
palace 17.9
village 17.7
religious 16.9
tourist 14.6
oriental 14.5
city 14.1
sky 14
worship 13.5
stone 12.7
stage 12.4
east 12.1
monument 12.1
tradition 12
exterior 12
landmark 11.7
wood 11.7
eastern 11.6
spiritual 11.5
construction 11.1
shrine 11.1
holiday 10.7
scenic 10.5
statue 10.5
park 10.5
outdoors 10.4
historic 10.1
platform 10.1
wooden 9.7
summer 9.6
sculpture 9.6
window 9.4
art 9.1
home 8.8
faith 8.6
wall 8.5
tropical 8.5
gold 8.2
water 8
trees 8
rural 7.9
facade 7.8
lantern 7.8
belief 7.8
antique 7.8
pray 7.8
museum 7.8
holy 7.7
spirituality 7.7
god 7.7
door 7.6
historical 7.5
famous 7.4
detail 7.2
day 7.1

Google
created on 2022-01-08

Temple 86.8
Building 80.4
Selling 79.3
Market 77.2
Vintage clothing 73.4
Hawker 70.1
Shopkeeper 69.3
Facade 68
Marketplace 67.9
City 67.3
Retail 66.3
Street 62.1
Holy places 61.2
History 60.5
Bazaar 59.8
Art 57.6
Monochrome 54.6
House 53.4
Place of worship 51.1
Temple 50.9

Microsoft
created on 2022-01-08

building 99.7
outdoor 94.6
person 90.8
clothing 86.1
christmas tree 62
flower 55.6

Face analysis

Amazon

Google

AWS Rekognition

Age 14-22
Gender Female, 100%
Sad 69.9%
Calm 24.1%
Confused 4.1%
Angry 0.7%
Disgusted 0.5%
Surprised 0.3%
Fear 0.2%
Happy 0.2%

AWS Rekognition

Age 51-59
Gender Female, 97.4%
Sad 98.9%
Calm 0.8%
Confused 0.1%
Fear 0.1%
Angry 0.1%
Disgusted 0%
Happy 0%
Surprised 0%

AWS Rekognition

Age 23-31
Gender Female, 73.8%
Surprised 79.2%
Sad 8.9%
Confused 4.5%
Calm 3.1%
Angry 1.2%
Fear 1.2%
Happy 1%
Disgusted 0.7%

AWS Rekognition

Age 26-36
Gender Female, 81.9%
Calm 47.9%
Sad 31.5%
Fear 13.2%
Confused 2.9%
Happy 2.2%
Disgusted 0.8%
Surprised 0.8%
Angry 0.5%

AWS Rekognition

Age 6-14
Gender Male, 99%
Sad 39.7%
Calm 38%
Disgusted 7.8%
Confused 5.7%
Fear 3.7%
Surprised 2.3%
Angry 2.1%
Happy 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

a group of people standing in front of a building 79.1%
a group of people in front of a building 79%
a man standing in front of a building 74.3%

Text analysis

Amazon

SHOE
SHOP.
C53 JAPANESE SHOE SHOP.
C53
JAPANESE
to
2+5
19

Google

SHOE
SHOP.
:
C53 JAPANESE SHOE SHOP. :十公 ちなや
JAPANESE
C53
ちなや