Human Generated Data

Title

Triptych: Transit of an American Steam Locomotive (Amerika koku jōkisha ōrai), published by Maruya Jimpachi

Date

Late Edo period, tenth month of 1861

People

Artist: Utagawa Yoshikazu, Japanese active 1850 - 1870

Classification

Prints

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of William S. Lieberman, 2007.214.32.1-3

Human Generated Data

Title

Triptych: Transit of an American Steam Locomotive (Amerika koku jōkisha ōrai), published by Maruya Jimpachi

People

Artist: Utagawa Yoshikazu, Japanese active 1850 - 1870

Date

Late Edo period, tenth month of 1861

Classification

Prints

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of William S. Lieberman, 2007.214.32.1-3

Machine Generated Data

Tags

Amazon
created on 2019-09-28

Human 99.5
Person 99.5
Person 99.2
Person 99.1
Person 98.7
Person 98.7
Person 98.6
Person 98.4
Person 98.1
Person 97.9
Person 96
Person 94.9
Person 92.7
Person 92.5
Person 90.2
Person 89.1
Painting 85.9
Art 85.9
Person 85.2
Person 84.9
Person 84.7
Person 84.4
Person 83.7
Person 75.4
Person 75.2
Person 75.2
Person 74.9
Person 64.8
Person 64.4
Person 58.4
People 56.4
Person 43.8

Clarifai
created on 2019-09-28

people 100
many 99.7
group 99.6
group together 99.5
adult 98.8
several 96.4
leader 96.3
man 95.7
administration 95.6
wear 94.4
print 92.3
outfit 92
woman 90.5
uniform 88.5
military 86.6
crowd 83.4
veil 82.6
recreation 81.9
war 79.6
child 76.3

Imagga
created on 2019-09-28

brass 56.7
trombone 55.5
wind instrument 44.5
musical instrument 34.9
city 18.3
sculpture 18.3
architecture 18
art 16.4
building 16
statue 15.3
monument 14.9
history 14.3
old 13.9
travel 13.4
man 12.8
people 12.3
historical 12.2
stone 11.8
tourism 11.5
urban 11.4
wall 11.1
historic 11
ancient 10.4
portrait 10.4
culture 10.3
person 10.2
cornet 10
structure 9.6
symbol 9.4
tourist 9.2
vintage 9.1
landmark 9
world 8.8
male 8.5
business 8.5
prison 8.5
famous 8.4
national 8.2
player 8.1
religion 8.1
group 8.1
adult 7.9
face 7.8
sport 7.7
grunge 7.7
hand 7.6
human 7.5
life 7.4
decoration 7.3
dress 7.2
black 7.2

Google
created on 2019-09-28

History 74
Art 70.9

Microsoft
created on 2019-09-28

text 99.6
person 96.8
clothing 95.7
old 87.9
poster 74.4
posing 73.5
man 70
newspaper 55.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 40-58
Gender Female, 50.9%
Happy 45%
Surprised 45%
Angry 45%
Fear 45%
Calm 54.9%
Sad 45%
Confused 45%
Disgusted 45%

AWS Rekognition

Age 27-43
Gender Male, 54.9%
Disgusted 45%
Sad 45%
Calm 55%
Fear 45%
Surprised 45%
Happy 45%
Confused 45%
Angry 45%

AWS Rekognition

Age 26-42
Gender Female, 52.1%
Disgusted 45.1%
Angry 53.9%
Fear 45.1%
Happy 45%
Calm 45.7%
Confused 45%
Surprised 45.1%
Sad 45.2%

AWS Rekognition

Age 22-34
Gender Male, 51.3%
Sad 45.9%
Disgusted 45.7%
Angry 46.5%
Happy 45.1%
Calm 50%
Surprised 45.7%
Fear 45.3%
Confused 45.8%

AWS Rekognition

Age 28-44
Gender Male, 52%
Angry 46.3%
Fear 45.2%
Sad 45.3%
Disgusted 45.7%
Happy 45.1%
Surprised 45.7%
Calm 48.9%
Confused 47.9%

AWS Rekognition

Age 34-50
Gender Male, 53.2%
Confused 45.1%
Calm 53.6%
Disgusted 45.2%
Sad 45.3%
Fear 45%
Happy 45%
Angry 45.6%
Surprised 45.1%

AWS Rekognition

Age 32-48
Gender Female, 50.7%
Sad 53%
Disgusted 45%
Calm 45.9%
Angry 45.4%
Confused 45.2%
Happy 45%
Surprised 45%
Fear 45.4%

AWS Rekognition

Age 22-34
Gender Male, 54.6%
Angry 45.1%
Disgusted 45.1%
Fear 45%
Happy 45.1%
Calm 54.7%
Confused 45%
Surprised 45.1%
Sad 45%

AWS Rekognition

Age 36-54
Gender Male, 54.8%
Happy 45%
Confused 45%
Sad 46.7%
Fear 45.1%
Surprised 45%
Disgusted 45%
Calm 48%
Angry 50.1%

AWS Rekognition

Age 15-27
Gender Female, 50.6%
Fear 45.1%
Surprised 53.9%
Happy 45.2%
Confused 45%
Sad 45%
Angry 45%
Calm 45.7%
Disgusted 45%

AWS Rekognition

Age 31-47
Gender Male, 52.4%
Confused 45%
Calm 53.5%
Sad 46.4%
Happy 45%
Angry 45%
Disgusted 45%
Fear 45%
Surprised 45%

AWS Rekognition

Age 13-25
Gender Male, 53.7%
Happy 45%
Angry 45%
Calm 54.8%
Surprised 45.1%
Fear 45%
Disgusted 45%
Sad 45%
Confused 45%

AWS Rekognition

Age 39-57
Gender Male, 50.4%
Calm 50.3%
Disgusted 49.5%
Surprised 49.5%
Happy 49.5%
Sad 49.5%
Angry 49.7%
Fear 49.5%
Confused 49.5%

AWS Rekognition

Age 43-61
Gender Male, 54.3%
Angry 45.5%
Calm 54.2%
Surprised 45.1%
Fear 45%
Happy 45%
Disgusted 45%
Sad 45.1%
Confused 45%

AWS Rekognition

Age 23-37
Gender Female, 50.3%
Angry 49.5%
Happy 49.5%
Disgusted 49.5%
Fear 49.5%
Calm 50.1%
Sad 49.7%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 30-46
Gender Male, 50.2%
Angry 49.5%
Disgusted 49.5%
Happy 49.5%
Calm 50%
Surprised 49.5%
Fear 49.5%
Sad 50%
Confused 49.5%

AWS Rekognition

Age 15-27
Gender Female, 50%
Fear 49.5%
Sad 49.5%
Angry 49.5%
Disgusted 49.5%
Calm 49.9%
Confused 49.5%
Happy 49.5%
Surprised 50%

AWS Rekognition

Age 11-21
Gender Male, 50.3%
Sad 49.6%
Confused 49.5%
Happy 49.5%
Angry 49.7%
Surprised 49.7%
Calm 49.8%
Disgusted 49.5%
Fear 49.6%

AWS Rekognition

Age 22-34
Gender Male, 50.3%
Fear 49.5%
Disgusted 49.5%
Sad 49.7%
Angry 50.3%
Calm 49.6%
Surprised 49.5%
Confused 49.5%
Happy 49.5%

AWS Rekognition

Age 38-56
Gender Male, 50.3%
Sad 49.6%
Disgusted 49.5%
Calm 50.3%
Angry 49.5%
Fear 49.5%
Happy 49.5%
Surprised 49.6%
Confused 49.5%

AWS Rekognition

Age 28-44
Gender Female, 50.3%
Disgusted 49.5%
Confused 49.5%
Fear 49.5%
Happy 49.6%
Calm 49.6%
Surprised 49.5%
Angry 49.6%
Sad 50.2%

AWS Rekognition

Age 14-26
Gender Male, 50.1%
Happy 49.5%
Disgusted 49.5%
Angry 49.5%
Fear 49.5%
Confused 49.5%
Sad 50.4%
Calm 49.6%
Surprised 49.5%

AWS Rekognition

Age 29-45
Gender Male, 50.1%
Sad 49.6%
Surprised 49.6%
Confused 49.5%
Fear 49.6%
Angry 49.6%
Disgusted 49.7%
Calm 49.9%
Happy 49.5%

AWS Rekognition

Age 15-27
Gender Male, 50.3%
Angry 49.5%
Calm 49.7%
Surprised 49.6%
Disgusted 49.5%
Fear 49.5%
Confused 49.5%
Happy 50.2%
Sad 49.5%

AWS Rekognition

Age 24-38
Gender Female, 50%
Fear 49.5%
Happy 49.5%
Surprised 49.5%
Angry 50.3%
Sad 49.5%
Confused 49.5%
Calm 49.5%
Disgusted 49.6%

AWS Rekognition

Age 10-20
Gender Female, 50.1%
Sad 49.6%
Angry 49.9%
Happy 49.7%
Confused 49.5%
Fear 49.5%
Disgusted 49.6%
Surprised 49.5%
Calm 49.6%

AWS Rekognition

Age 28-44
Gender Male, 50.5%
Calm 49.5%
Fear 49.6%
Happy 49.5%
Surprised 49.5%
Disgusted 49.5%
Confused 49.5%
Angry 49.5%
Sad 50.4%

AWS Rekognition

Age 24-38
Gender Male, 50.3%
Calm 49.7%
Sad 49.8%
Angry 49.7%
Disgusted 49.5%
Happy 49.5%
Fear 49.6%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 19-31
Gender Female, 50.3%
Angry 50.3%
Confused 49.5%
Fear 49.5%
Disgusted 49.5%
Sad 49.5%
Calm 49.7%
Surprised 49.5%
Happy 49.5%

AWS Rekognition

Age 15-27
Gender Male, 50.3%
Surprised 49.5%
Disgusted 49.5%
Confused 49.5%
Happy 49.5%
Angry 49.5%
Sad 49.5%
Fear 50.5%
Calm 49.5%

Microsoft Cognitive Services

Age 48
Gender Female

Microsoft Cognitive Services

Age 36
Gender Female

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 26
Gender Female

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 58
Gender Female

Microsoft Cognitive Services

Age 47
Gender Male

Microsoft Cognitive Services

Age 51
Gender Female

Microsoft Cognitive Services

Age 21
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Painting 85.9%

Categories

Captions

Azure OpenAI

Created on 2024-11-13

This image is a Japanese woodblock print depicting a scene that appears to be from the Bakumatsu period, when Japan ended its isolationist foreign policy and started to integrate with the world. The print shows a steam locomotive on the right, which indicates a time of modernization. There are armed figures in western-style uniforms, possibly representing foreign or modernized Japanese forces, and other figures in civilian attire typical of the 19th-century western fashion, including long dresses with wide skirts for the women. Several flags are visible, including what seems to be an American flag, suggesting international presence or influence. The overall impression is that of an historical event or a depiction of the cultural exchange between Japan and the West during a period of significant political and social changes. The print is intricately detailed and employs a limited color palette. There are Japanese characters on the print, likely describing the event or providing context, as is common in traditional Japanese art.

Anthropic Claude

Created on 2024-11-13

The image appears to depict a bustling scene from the late 19th or early 20th century. It shows a crowded train station or platform, with various people dressed in period clothing, including women in long dresses and men in suits and military uniforms. There are American flags visible, suggesting this is taking place in the United States. The central focus seems to be on the people gathered on the platform, with a large clock and mechanical structure in the background. The overall mood is one of activity and movement, capturing a moment in time from a bygone era.

Text analysis

Google

099999 川芳員
099999