Human Generated Data

Title

Catching Goldfish (Kingyo sukui), from the series Twelve Scenes of Tokyo (Tokyo jūnidai)

Date

Shōwa period, dated 1928

People

Artist: Yoshida Hiroshi, Japanese 1876 - 1950

Classification

Prints

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Mrs. William L. Payson in memory of her husband, William L. Payson (Class of 1923, Harvard Law School 1926) and of her son William L. Payson, Jr. (Class of 1954), 1983.199

Human Generated Data

Title

Catching Goldfish (Kingyo sukui), from the series Twelve Scenes of Tokyo (Tokyo jūnidai)

People

Artist: Yoshida Hiroshi, Japanese 1876 - 1950

Date

Shōwa period, dated 1928

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-07-06

Apparel 97.9
Clothing 97.9
Person 97.8
Human 97.8
Person 97.7
Person 97.2
Person 97.1
Person 97
Person 96.6
Person 94.7
Person 94.2
Person 93.6
Person 93.4
Person 93
Person 92.6
Person 92.4
Art 91.5
Fashion 89.6
Robe 89.6
Gown 86
Person 85.7
Person 81.2
Person 75.5
Kimono 75.5
Book 69.2
Drawing 65.1
Painting 63.7
Comics 59.5
Person 56.7
Mural 55.8
Person 51.4
Person 47

Clarifai
created on 2019-07-06

people 99.7
painting 99.5
art 98.4
illustration 98.2
group 97.9
adult 97.6
woman 96.5
wear 94
print 93.8
man 93.8
child 92.9
seat 88.9
lithograph 88.9
son 85.2
facial expression 84.5
woodcut 82.5
many 81.7
recreation 80.1
kneeling 78.5
furniture 76.4

Imagga
created on 2019-07-06

comic book 100
print media 65.1
money 20.4
old 18.8
map 18.2
paper 17.2
currency 17
cash 16.5
financial 16
art 15.8
finance 15.2
vintage 14.9
geography 14.4
decoration 13.5
business 13.4
economy 13
states 12.6
design 12.5
bank 11.6
cartoon 11.6
gold 11.5
retro 11.5
country 11.4
capital 11.4
antique 11.2
card 11.1
world 10.9
travel 10.6
dollar 10.2
banking 10.1
wealth 9.9
atlas 9.8
stamp 9.7
pattern 9.6
trade 9.6
journey 9.4
graffito 9.4
grunge 9.4
game 9.3
note 9.2
letter 9.2
city 9.1
close 9.1
tourism 9.1
painting 9
banknotes 8.8
economics 8.8
man 8.7
continent 8.7
planet 8.7
navigation 8.7
mail 8.6
exchange 8.6
direction 8.6
flag 8.5
nation 8.5
people 8.4
globe 8.3
global 8.2
road 8.1
symbol 8.1
postmark 7.9
colorful 7.9
holiday 7.9
postage 7.9
navigate 7.8
location 7.8
route 7.8
sepia 7.8
notes 7.7
international 7.6
plan 7.6
commerce 7.5
artwork 7.3
black 7.2
religion 7.2

Google
created on 2019-07-06

Art 88.2
Illustration 75.9
Tapestry 75.8
Textile 71.8
Mural 70.5
Visual arts 59.3
Painting 58.3

Microsoft
created on 2019-07-06

drawing 98.4
cartoon 97.5
clothing 95.4
person 93.7
illustration 83.5
child art 79.3
painting 75.4
human face 68.4
art 65.6
man 50.1

Face analysis

Amazon

AWS Rekognition

Age 11-18
Gender Female, 55%
Sad 45%
Confused 45.1%
Happy 50.3%
Calm 49.3%
Angry 45.1%
Surprised 45.1%
Disgusted 45.1%

AWS Rekognition

Age 26-43
Gender Female, 50.6%
Surprised 45.1%
Calm 45.2%
Sad 54.1%
Disgusted 45%
Confused 45.2%
Angry 45.2%
Happy 45.2%

AWS Rekognition

Age 26-43
Gender Female, 54.8%
Angry 45.3%
Disgusted 45.2%
Confused 45.1%
Calm 45.8%
Surprised 45.3%
Happy 45.9%
Sad 52.4%

AWS Rekognition

Age 4-9
Gender Female, 53.5%
Sad 51.7%
Angry 45.6%
Happy 45.9%
Disgusted 45.2%
Calm 45.4%
Confused 45.4%
Surprised 45.9%

AWS Rekognition

Age 14-25
Gender Female, 54.9%
Surprised 45.1%
Happy 45.4%
Angry 45.2%
Calm 45.3%
Disgusted 45.1%
Confused 45.1%
Sad 53.8%

AWS Rekognition

Age 23-38
Gender Female, 51.6%
Sad 50.1%
Angry 45.2%
Happy 45.1%
Calm 49.2%
Disgusted 45.1%
Surprised 45.2%
Confused 45.1%

AWS Rekognition

Age 11-18
Gender Female, 54.8%
Angry 45.1%
Calm 53.8%
Sad 45.3%
Happy 45.6%
Surprised 45.1%
Disgusted 45.1%
Confused 45%

AWS Rekognition

Age 20-38
Gender Female, 54.6%
Angry 45.1%
Happy 45.1%
Sad 54.4%
Calm 45.1%
Surprised 45.1%
Disgusted 45.1%
Confused 45.1%

AWS Rekognition

Age 23-38
Gender Female, 54.9%
Happy 53.5%
Angry 45.2%
Calm 45.3%
Surprised 45.2%
Sad 45.5%
Disgusted 45.1%
Confused 45.1%

AWS Rekognition

Age 20-38
Gender Female, 53.6%
Surprised 51.4%
Calm 45.4%
Sad 45.2%
Disgusted 45.1%
Confused 45.2%
Angry 45.2%
Happy 47.5%

AWS Rekognition

Age 26-43
Gender Female, 54.2%
Angry 45.9%
Disgusted 45.4%
Happy 45.3%
Calm 49.3%
Sad 48.5%
Surprised 45.4%
Confused 45.2%

AWS Rekognition

Age 26-43
Gender Male, 54.4%
Disgusted 47.7%
Calm 45.2%
Confused 45.2%
Angry 51.1%
Surprised 45.3%
Happy 45.2%
Sad 45.3%

AWS Rekognition

Age 23-38
Gender Female, 55%
Happy 50.7%
Sad 45.4%
Calm 47.2%
Surprised 45.9%
Angry 45.3%
Confused 45.2%
Disgusted 45.3%

AWS Rekognition

Age 6-13
Gender Female, 54.9%
Happy 51.3%
Calm 46.3%
Confused 45.3%
Angry 45.4%
Disgusted 45.3%
Sad 45.9%
Surprised 45.4%

AWS Rekognition

Age 20-38
Gender Female, 51.8%
Sad 46.5%
Angry 47.5%
Happy 46.2%
Disgusted 45.8%
Calm 46.7%
Confused 45.9%
Surprised 46.3%

AWS Rekognition

Age 16-27
Gender Female, 53.1%
Sad 47.4%
Happy 48.7%
Surprised 45.7%
Disgusted 45.6%
Angry 45.3%
Calm 47.1%
Confused 45.3%

AWS Rekognition

Age 23-38
Gender Female, 54.2%
Surprised 46.3%
Angry 46%
Disgusted 45.4%
Sad 46%
Calm 50.5%
Happy 45.3%
Confused 45.4%

AWS Rekognition

Age 23-38
Gender Male, 54.4%
Angry 47.8%
Calm 46.6%
Sad 47.2%
Happy 45.7%
Surprised 46%
Disgusted 45.5%
Confused 46.2%

AWS Rekognition

Age 26-43
Gender Male, 54.9%
Surprised 45.6%
Happy 45.3%
Angry 45.4%
Calm 51.8%
Disgusted 45.1%
Confused 45.4%
Sad 46.3%

AWS Rekognition

Age 19-36
Gender Male, 53.4%
Angry 45.4%
Disgusted 45.1%
Happy 45.2%
Calm 53.5%
Sad 45.4%
Surprised 45.2%
Confused 45.2%

AWS Rekognition

Age 14-23
Gender Female, 53.8%
Happy 51.9%
Sad 46.6%
Calm 45.4%
Surprised 45.4%
Angry 45.3%
Confused 45.1%
Disgusted 45.2%

AWS Rekognition

Age 45-66
Gender Female, 53.8%
Disgusted 45.5%
Calm 49.2%
Happy 45.7%
Surprised 45.9%
Angry 46%
Confused 45.7%
Sad 46.9%

AWS Rekognition

Age 14-23
Gender Female, 50.4%
Happy 45.2%
Sad 45.9%
Calm 46.1%
Surprised 52%
Angry 45.6%
Confused 45.2%
Disgusted 45.1%

Feature analysis

Amazon

Person 97.8%
Painting 63.7%

Captions

Microsoft

a group of people posing for the camera 66%
a group of people posing for a picture 65.9%
a group of people posing for a photo 57%

Text analysis

Amazon

wek
6m
1
pMsT