Human Generated Data

Title

Triptych: Street Scene with Geisha and Courtesan (Totō Han'ei no zu)

Date

Late Edo period, circa 1855

People

Artist: Utagawa Yoshikazu, Japanese active 1850 - 1870

Classification

Prints

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of the Friends of Arthur B. Duel, 1933.4.829.-831

Human Generated Data

Title

Triptych: Street Scene with Geisha and Courtesan (Totō Han'ei no zu)

People

Artist: Utagawa Yoshikazu, Japanese active 1850 - 1870

Date

Late Edo period, circa 1855

Classification

Prints

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of the Friends of Arthur B. Duel, 1933.4.829.-831

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 98.6
Human 98.6
Person 97.9
Person 97.2
Person 97.1
Person 96.6
Art 94.7
Person 89.9
Mural 88.7
Clothing 85.6
Apparel 85.6
Painting 59
Leisure Activities 57.1

Clarifai
created on 2023-10-15

people 99.6
art 99.4
painting 98.9
illustration 97.2
print 96.5
sword 96.1
religion 96
group 95.7
man 95.5
veil 95.4
temple 95.1
ancient 95
adult 94.2
gown (clothing) 93.5
culture 93.1
wear 91.2
woman 90
decoration 89.7
old 89.4
god 88.8

Imagga
created on 2021-12-15

city 23.3
art 23
architecture 22.9
football stadium 22.6
old 19.5
athletic facility 18.4
mosaic 18
building 17.6
religion 17
church 16.6
structure 16.3
travel 16.2
landmark 15.3
facility 14.6
stadium 14.3
tourism 14
urban 14
business 12.7
pattern 11.6
vintage 11.6
new 11.3
design 11.3
religious 11.2
famous 11.2
tower 10.7
tourist 10.6
wall 10.6
modern 10.5
antique 10.5
park 10.4
cityscape 10.4
ancient 10.4
culture 10.2
sky 10.2
town 10.2
symbol 10.1
fabric 9.7
god 9.6
jigsaw puzzle 9.5
scene 9.5
skyline 9.5
buildings 9.4
grunge 9.4
colorful 9.3
historic 9.2
map 9.1
texture 9
tartan 9
financial 8.9
technology 8.9
temple 8.7
capital 8.5
oriental 8.5
traditional 8.3
street 8.3
gold 8.2
river 8.2
retro 8.2
painting 8.1
game 7.8
sacred 7.8
color 7.8
transducer 7.7
stained 7.7
downtown 7.7
window 7.6
painted 7.6
person 7.6
finance 7.6
plan 7.6
puzzle 7.5
tall 7.5
exterior 7.4
detail 7.2
world 7.1
decoration 7

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

text 96.2
person 86.2
poster 80.9
cartoon 78.9
clothing 78.7
drawing 70.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-31
Gender Male, 99%
Surprised 89.5%
Calm 5.2%
Confused 4.2%
Happy 0.4%
Angry 0.3%
Fear 0.2%
Disgusted 0.2%
Sad 0.1%

AWS Rekognition

Age 14-26
Gender Male, 80.6%
Fear 46.1%
Surprised 35.1%
Happy 6.6%
Calm 5.5%
Confused 2.7%
Angry 2.1%
Sad 1.2%
Disgusted 0.7%

AWS Rekognition

Age 13-23
Gender Female, 50.1%
Fear 69%
Calm 10.2%
Surprised 10%
Angry 3.8%
Confused 2.7%
Happy 2.7%
Sad 0.9%
Disgusted 0.6%

AWS Rekognition

Age 13-25
Gender Female, 56.9%
Calm 70.8%
Surprised 15.4%
Fear 7.4%
Confused 1.7%
Sad 1.7%
Angry 1.5%
Disgusted 0.9%
Happy 0.7%

AWS Rekognition

Age 19-31
Gender Male, 92.3%
Surprised 82.4%
Confused 16.1%
Calm 0.6%
Fear 0.6%
Sad 0.1%
Angry 0.1%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 14-26
Gender Male, 94.4%
Calm 60.4%
Surprised 20.1%
Fear 7.7%
Angry 5%
Confused 2.5%
Disgusted 1.9%
Happy 1.2%
Sad 1.1%

AWS Rekognition

Age 28-44
Gender Male, 95.2%
Fear 56.1%
Sad 19.9%
Angry 7.7%
Calm 7.2%
Surprised 6.5%
Happy 1.4%
Confused 0.9%
Disgusted 0.3%

Microsoft Cognitive Services

Age 22
Gender Female

Google Vision

Surprise Possible
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%
Painting 59%

Categories

Imagga

paintings art 100%

Captions

Microsoft
created on 2021-12-15

map 34.1%

Text analysis

Amazon

P
a
NE
-
L
R L
te
123RF a
ماد
=
4k
:
R
A
"
(b)
nE
HZ
are
123RF
SCI
BIP
يندم
sand
sk
NEW
عة
it