Human Generated Data

Title

Triptych: Transit of an American Steam Locomotive (Amerika koku jōkisha ōrai), published by Maruya Jimpachi
Date

Late Edo period, tenth month of 1861
People

Artist: Utagawa Yoshikazu, Japanese active 1850 - 1870
Classification

Prints
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of William S. Lieberman, 2007.214.32.1-3

Human Generated Data

Title

Triptych: Transit of an American Steam Locomotive (Amerika koku jōkisha ōrai), published by Maruya Jimpachi

People

Artist: Utagawa Yoshikazu, Japanese active 1850 - 1870

Date

Late Edo period, tenth month of 1861

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-09-28

Human 99.5
Person 99.5
Person 99.2
Person 99.1
Person 98.7
Person 98.7
Person 98.6
Person 98.4
Person 98.1
Person 97.9
Person 96
Person 94.9
Person 92.7
Person 92.5
Person 90.2
Person 89.1
Painting 85.9
Art 85.9
Person 85.2
Person 84.9
Person 84.7
Person 84.4
Person 83.7
Person 75.4
Person 75.2
Person 75.2
Person 74.9
Person 64.8
Person 64.4
Person 58.4
People 56.4
Person 43.8

Clarifai
created on 2019-09-28

people 100
many 99.7
group 99.6
group together 99.5
adult 98.8
several 96.4
leader 96.3
man 95.7
administration 95.6
wear 94.4
print 92.3
outfit 92
woman 90.5
uniform 88.5
military 86.6
crowd 83.4
veil 82.6
recreation 81.9
war 79.6
child 76.3

Imagga
created on 2019-09-28

brass 56.7
trombone 55.5
wind instrument 44.5
musical instrument 34.9
city 18.3
sculpture 18.3
architecture 18
art 16.4
building 16
statue 15.3
monument 14.9
history 14.3
old 13.9
travel 13.4
man 12.8
people 12.3
historical 12.2
stone 11.8
tourism 11.5
urban 11.4
wall 11.1
historic 11
ancient 10.4
portrait 10.4
culture 10.3
person 10.2
cornet 10
structure 9.6
symbol 9.4
tourist 9.2
vintage 9.1
landmark 9
world 8.8
male 8.5
business 8.5
prison 8.5
famous 8.4
national 8.2
player 8.1
religion 8.1
group 8.1
adult 7.9
face 7.8
sport 7.7
grunge 7.7
hand 7.6
human 7.5
life 7.4
decoration 7.3
dress 7.2
black 7.2

Google
created on 2019-09-28

History 74
Art 70.9

Microsoft
created on 2019-09-28

text 99.6
person 96.8
clothing 95.7
old 87.9
poster 74.4
posing 73.5
man 70
newspaper 55.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 40-58
Gender Female, 50.9%
Happy 45%
Surprised 45%
Angry 45%
Fear 45%
Calm 54.9%
Sad 45%
Confused 45%
Disgusted 45%

AWS Rekognition

Age 27-43
Gender Male, 54.9%
Disgusted 45%
Sad 45%
Calm 55%
Fear 45%
Surprised 45%
Happy 45%
Confused 45%
Angry 45%

AWS Rekognition

Age 26-42
Gender Female, 52.1%
Disgusted 45.1%
Angry 53.9%
Fear 45.1%
Happy 45%
Calm 45.7%
Confused 45%
Surprised 45.1%
Sad 45.2%

AWS Rekognition

Age 22-34
Gender Male, 51.3%
Sad 45.9%
Disgusted 45.7%
Angry 46.5%
Happy 45.1%
Calm 50%
Surprised 45.7%
Fear 45.3%
Confused 45.8%

AWS Rekognition

Age 28-44
Gender Male, 52%
Angry 46.3%
Fear 45.2%
Sad 45.3%
Disgusted 45.7%
Happy 45.1%
Surprised 45.7%
Calm 48.9%
Confused 47.9%

AWS Rekognition

Age 34-50
Gender Male, 53.2%
Confused 45.1%
Calm 53.6%
Disgusted 45.2%
Sad 45.3%
Fear 45%
Happy 45%
Angry 45.6%
Surprised 45.1%

AWS Rekognition

Age 32-48
Gender Female, 50.7%
Sad 53%
Disgusted 45%
Calm 45.9%
Angry 45.4%
Confused 45.2%
Happy 45%
Surprised 45%
Fear 45.4%

AWS Rekognition

Age 22-34
Gender Male, 54.6%
Angry 45.1%
Disgusted 45.1%
Fear 45%
Happy 45.1%
Calm 54.7%
Confused 45%
Surprised 45.1%
Sad 45%

AWS Rekognition

Age 36-54
Gender Male, 54.8%
Happy 45%
Confused 45%
Sad 46.7%
Fear 45.1%
Surprised 45%
Disgusted 45%
Calm 48%
Angry 50.1%

AWS Rekognition

Age 15-27
Gender Female, 50.6%
Fear 45.1%
Surprised 53.9%
Happy 45.2%
Confused 45%
Sad 45%
Angry 45%
Calm 45.7%
Disgusted 45%

AWS Rekognition

Age 31-47
Gender Male, 52.4%
Confused 45%
Calm 53.5%
Sad 46.4%
Happy 45%
Angry 45%
Disgusted 45%
Fear 45%
Surprised 45%

AWS Rekognition

Age 13-25
Gender Male, 53.7%
Happy 45%
Angry 45%
Calm 54.8%
Surprised 45.1%
Fear 45%
Disgusted 45%
Sad 45%
Confused 45%

AWS Rekognition

Age 39-57
Gender Male, 50.4%
Calm 50.3%
Disgusted 49.5%
Surprised 49.5%
Happy 49.5%
Sad 49.5%
Angry 49.7%
Fear 49.5%
Confused 49.5%

AWS Rekognition

Age 43-61
Gender Male, 54.3%
Angry 45.5%
Calm 54.2%
Surprised 45.1%
Fear 45%
Happy 45%
Disgusted 45%
Sad 45.1%
Confused 45%

AWS Rekognition

Age 23-37
Gender Female, 50.3%
Angry 49.5%
Happy 49.5%
Disgusted 49.5%
Fear 49.5%
Calm 50.1%
Sad 49.7%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 30-46
Gender Male, 50.2%
Angry 49.5%
Disgusted 49.5%
Happy 49.5%
Calm 50%
Surprised 49.5%
Fear 49.5%
Sad 50%
Confused 49.5%

AWS Rekognition

Age 15-27
Gender Female, 50%
Fear 49.5%
Sad 49.5%
Angry 49.5%
Disgusted 49.5%
Calm 49.9%
Confused 49.5%
Happy 49.5%
Surprised 50%

AWS Rekognition

Age 11-21
Gender Male, 50.3%
Sad 49.6%
Confused 49.5%
Happy 49.5%
Angry 49.7%
Surprised 49.7%
Calm 49.8%
Disgusted 49.5%
Fear 49.6%

AWS Rekognition

Age 22-34
Gender Male, 50.3%
Fear 49.5%
Disgusted 49.5%
Sad 49.7%
Angry 50.3%
Calm 49.6%
Surprised 49.5%
Confused 49.5%
Happy 49.5%

AWS Rekognition

Age 38-56
Gender Male, 50.3%
Sad 49.6%
Disgusted 49.5%
Calm 50.3%
Angry 49.5%
Fear 49.5%
Happy 49.5%
Surprised 49.6%
Confused 49.5%

AWS Rekognition

Age 28-44
Gender Female, 50.3%
Disgusted 49.5%
Confused 49.5%
Fear 49.5%
Happy 49.6%
Calm 49.6%
Surprised 49.5%
Angry 49.6%
Sad 50.2%

AWS Rekognition

Age 14-26
Gender Male, 50.1%
Happy 49.5%
Disgusted 49.5%
Angry 49.5%
Fear 49.5%
Confused 49.5%
Sad 50.4%
Calm 49.6%
Surprised 49.5%

AWS Rekognition

Age 29-45
Gender Male, 50.1%
Sad 49.6%
Surprised 49.6%
Confused 49.5%
Fear 49.6%
Angry 49.6%
Disgusted 49.7%
Calm 49.9%
Happy 49.5%

AWS Rekognition

Age 15-27
Gender Male, 50.3%
Angry 49.5%
Calm 49.7%
Surprised 49.6%
Disgusted 49.5%
Fear 49.5%
Confused 49.5%
Happy 50.2%
Sad 49.5%

AWS Rekognition

Age 24-38
Gender Female, 50%
Fear 49.5%
Happy 49.5%
Surprised 49.5%
Angry 50.3%
Sad 49.5%
Confused 49.5%
Calm 49.5%
Disgusted 49.6%

AWS Rekognition

Age 10-20
Gender Female, 50.1%
Sad 49.6%
Angry 49.9%
Happy 49.7%
Confused 49.5%
Fear 49.5%
Disgusted 49.6%
Surprised 49.5%
Calm 49.6%

AWS Rekognition

Age 28-44
Gender Male, 50.5%
Calm 49.5%
Fear 49.6%
Happy 49.5%
Surprised 49.5%
Disgusted 49.5%
Confused 49.5%
Angry 49.5%
Sad 50.4%

AWS Rekognition

Age 24-38
Gender Male, 50.3%
Calm 49.7%
Sad 49.8%
Angry 49.7%
Disgusted 49.5%
Happy 49.5%
Fear 49.6%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 19-31
Gender Female, 50.3%
Angry 50.3%
Confused 49.5%
Fear 49.5%
Disgusted 49.5%
Sad 49.5%
Calm 49.7%
Surprised 49.5%
Happy 49.5%

AWS Rekognition

Age 15-27
Gender Male, 50.3%
Surprised 49.5%
Disgusted 49.5%
Confused 49.5%
Happy 49.5%
Angry 49.5%
Sad 49.5%
Fear 50.5%
Calm 49.5%

Microsoft Cognitive Services

Age 51
Gender Female

Microsoft Cognitive Services

Age 26
Gender Female

Microsoft Cognitive Services

Age 58
Gender Female

Microsoft Cognitive Services

Age 48
Gender Female

Microsoft Cognitive Services

Age 47
Gender Male

Microsoft Cognitive Services

Age 21
Gender Female

Microsoft Cognitive Services

Age 36
Gender Female

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Painting 85.9%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 88.6%
a vintage photo of a group of people posing for a picture 88.5%
an old photo of a group of people posing for the camera 88.4%

Text analysis

Google

芳
員
099999 川芳員
099999
川