Human Generated Data

Title

Transit of an American Steam Locomotive (Amerika koku jōkisha ōrai), published by Maruya Jimpachi

Date

Late Edo period, tenth month of 1861

People

Artist: Utagawa Yoshikazu, Japanese active 1850 - 1870

Classification

Prints

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of William S. Lieberman, 2007.214.32.3

Human Generated Data

Title

Transit of an American Steam Locomotive (Amerika koku jōkisha ōrai), published by Maruya Jimpachi

People

Artist: Utagawa Yoshikazu, Japanese active 1850 - 1870

Date

Late Edo period, tenth month of 1861

Classification

Prints

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of William S. Lieberman, 2007.214.32.3

Machine Generated Data

Tags

Amazon
created on 2019-09-28

Person 99.6
Human 99.6
Person 99.6
Person 99.5
Person 99.4
Person 98.5
Person 98.3
Person 97.5
Person 97
Person 95
Person 89
Person 88.6
Person 88.4
Art 84
Person 80.9
Painting 79.3
Person 66.1
Person 65.1
Leisure Activities 64.7
Person 62
People 59.8
Poster 56.2
Advertisement 56.2

Clarifai
created on 2019-09-28

people 100
group 99.5
group together 99.2
many 98.7
adult 97.6
administration 95.9
several 95.7
leader 93.8
man 93.8
wear 93.3
woman 89.4
outfit 88
five 85
home 82.6
child 77.6
military 74.8
four 73.9
uniform 73.1
education 73
three 72.9

Imagga
created on 2019-09-28

architecture 31.7
building 30.5
old 24.4
city 24.1
tourism 23.1
history 20.6
art 19.6
ancient 19
monument 18.7
religion 17.9
brass 17.5
facade 16.7
church 16.6
sculpture 16.5
travel 16.2
stone 16.2
arch 15.9
palace 15.1
wind instrument 14.6
structure 13.8
wall 13.7
window 12.3
historical 12.2
famous 12.1
historic 11.9
cathedral 11.8
marble 11.6
statue 11.5
culture 11.1
musical instrument 11.1
exterior 11.1
vintage 10.7
tourist 10.6
urban 10.5
door 10.5
memorial 10.4
house 10.1
landmark 9.9
decoration 9.7
balcony 9.5
column 9.4
place 9.3
town 9.3
street 9.2
trombone 9
prison 8.7
entrance 8.7
pillory 8.7
antique 8.7
people 8.4
instrument of punishment 7.6
buildings 7.6
religious 7.5
destination 7.5
man 7.5
detail 7.2
tower 7.2
correctional institution 7

Google
created on 2019-09-28

Art 62.5
Illustration 57.7
History 57.6
Collection 54

Microsoft
created on 2019-09-28

text 99.5
clothing 98.5
person 98
old 93.1
posing 81.6
man 62.4
vintage 25.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 41-59
Gender Female, 90.5%
Disgusted 0.4%
Sad 0.7%
Angry 0.8%
Calm 97.5%
Confused 0.3%
Surprised 0.3%
Happy 0%
Fear 0%

AWS Rekognition

Age 29-45
Gender Female, 66.9%
Angry 4.3%
Disgusted 2.3%
Happy 0.5%
Calm 74.5%
Surprised 1.2%
Fear 1.4%
Sad 13.5%
Confused 2.2%

AWS Rekognition

Age 31-47
Gender Female, 96.1%
Happy 0.4%
Disgusted 4.7%
Calm 36.1%
Surprised 1.5%
Sad 25.6%
Angry 27.9%
Confused 1.7%
Fear 2.1%

AWS Rekognition

Age 31-47
Gender Male, 66.6%
Sad 76.6%
Angry 1.9%
Fear 1.2%
Disgusted 0.4%
Confused 0.5%
Happy 0%
Surprised 0.1%
Calm 19.2%

AWS Rekognition

Age 41-59
Gender Male, 97.8%
Sad 1%
Calm 90.4%
Angry 5.7%
Surprised 1.6%
Fear 0.5%
Disgusted 0.2%
Confused 0.7%
Happy 0.1%

AWS Rekognition

Age 32-48
Gender Male, 87.4%
Sad 0.3%
Fear 0.4%
Angry 0.3%
Happy 0.4%
Confused 0.2%
Calm 96.9%
Surprised 1.4%
Disgusted 0.1%

AWS Rekognition

Age 27-43
Gender Male, 83.4%
Disgusted 1.8%
Happy 0.1%
Fear 0.1%
Confused 0.6%
Angry 2%
Surprised 0.5%
Calm 94.2%
Sad 0.7%

AWS Rekognition

Age 27-43
Gender Male, 53.2%
Fear 45.1%
Surprised 45.1%
Happy 45%
Confused 45.1%
Sad 45.1%
Angry 51.1%
Calm 48.4%
Disgusted 45%

AWS Rekognition

Age 30-46
Gender Female, 50.1%
Sad 49.5%
Surprised 49.5%
Confused 49.5%
Fear 49.5%
Calm 49.6%
Disgusted 49.5%
Angry 50.4%
Happy 49.5%

AWS Rekognition

Age 21-33
Gender Female, 50.1%
Fear 49.5%
Happy 49.5%
Disgusted 49.5%
Calm 49.8%
Confused 49.5%
Surprised 49.7%
Angry 49.8%
Sad 49.5%

AWS Rekognition

Age 20-32
Gender Male, 50.3%
Confused 49.5%
Calm 49.9%
Happy 49.5%
Sad 49.6%
Fear 49.6%
Surprised 49.6%
Disgusted 49.8%
Angry 49.5%

AWS Rekognition

Age 19-31
Gender Female, 50.4%
Calm 49.6%
Disgusted 50%
Sad 49.5%
Angry 49.7%
Confused 49.5%
Surprised 49.5%
Fear 49.5%
Happy 49.6%

AWS Rekognition

Age 15-27
Gender Male, 50%
Angry 49.7%
Happy 49.5%
Disgusted 49.5%
Fear 49.6%
Calm 50%
Sad 49.5%
Surprised 49.7%
Confused 49.5%

Microsoft Cognitive Services

Age 35
Gender Female

Microsoft Cognitive Services

Age 42
Gender Male

Microsoft Cognitive Services

Age 36
Gender Female

Microsoft Cognitive Services

Age 42
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Painting 79.3%

Categories

Text analysis

Amazon

CO