Human Generated Data

Title

Krishna Dancing with the Gopis, Illustration from a Gita Govinda (Songs of the Lord) series

Date

dated 1799

People

Artist: Unknown Artist,

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, The Stuart Cary Welch Collection, Gift of Edith I. Welch in memory of Stuart Cary Welch, 2009.202.221

Human Generated Data

Title

Krishna Dancing with the Gopis, Illustration from a Gita Govinda (Songs of the Lord) series

People

Artist: Unknown Artist,

Date

dated 1799

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-05-22

Human 93.6
Person 93.6
Art 93
Painting 84.9
Person 75.2
Person 71.4
Applique 69.9
Person 67.1
Advertisement 62.9
Clothing 62.8
Apparel 62.8
Poster 58.1
Person 50.2

Clarifai
created on 2019-05-22

illustration 99.5
vector 96.4
child 96.1
people 96
woman 94.7
sketch 94.6
art 94.5
wear 92.5
man 90.8
graphic 90.8
retro 89.9
fun 89.2
princess 89
adult 88.2
landscape 87.4
painting 87.3
vintage 86.7
group 86.6
girl 84.7
bill 82.2

Imagga
created on 2019-05-22

pillow 100
cushion 86.8
padding 65.5
fun 19.4
holiday 17.9
happy 15.6
celebration 15.1
grass 15
gift 14.6
game 13.6
colorful 13.6
play 12.9
art 11.8
leisure 11.6
man 11.4
flag 11.2
people 11.1
paper 11
present 10.9
cartoon 10.7
color 10.6
outdoors 10.4
card 10.2
sport 9.9
recreation 9.8
old 9.7
ball 9.6
hat 9.5
happiness 9.4
lifestyle 9.4
shopping 9.3
yellow 9.3
decoration 9.2
bag 8.7
party 8.6
design 8.5
outdoor 8.4
box 8.1
person 7.7
outside 7.7
golf 7.6
greeting 7.4
birthday 7.4
toy 7.4
funny 7.3
competition 7.3
cheerful 7.3
playing 7.3
exercise 7.3
child 7.2
cute 7.2
smile 7.1
emblem 7.1
country 7.1
spring 7.1
season 7

Google
created on 2019-05-22

Illustration 73.8
Painting 72.9
Art 67.7
Miniature 58.5

Microsoft
created on 2019-05-22

grass 98.8
cartoon 98.1
painting 87.1
child art 83.4
drawing 82.4
clothing 79.8
person 77.8
woman 58.2
illustration 56.6

Face analysis

Amazon

AWS Rekognition

Age 23-38
Gender Female, 54.4%
Disgusted 47.7%
Angry 45.8%
Confused 45.2%
Happy 48.1%
Calm 46.4%
Surprised 46.1%
Sad 45.7%

AWS Rekognition

Age 15-25
Gender Male, 53.1%
Sad 46.7%
Angry 45.9%
Disgusted 45.3%
Confused 45.6%
Calm 50.7%
Happy 45.1%
Surprised 45.7%

AWS Rekognition

Age 20-38
Gender Female, 51.7%
Disgusted 45.3%
Confused 45.7%
Calm 46.7%
Surprised 45.9%
Angry 45.5%
Sad 46.8%
Happy 49.1%

AWS Rekognition

Age 23-38
Gender Female, 54.8%
Sad 45.1%
Calm 45.4%
Disgusted 45.1%
Confused 45.1%
Angry 45.1%
Happy 53.9%
Surprised 45.3%

AWS Rekognition

Age 23-38
Gender Female, 50.5%
Disgusted 45.4%
Angry 45.5%
Sad 45.5%
Happy 45.2%
Confused 45.4%
Surprised 48.3%
Calm 49.7%

AWS Rekognition

Age 26-43
Gender Male, 54.7%
Surprised 45.4%
Angry 45.5%
Calm 47.2%
Happy 46.1%
Confused 45.7%
Sad 45.2%
Disgusted 49.9%

AWS Rekognition

Age 20-38
Gender Female, 52.9%
Confused 45.2%
Calm 49.6%
Happy 45.9%
Angry 45.4%
Sad 45.3%
Surprised 45.7%
Disgusted 47.9%

AWS Rekognition

Age 16-27
Gender Female, 54.9%
Happy 49%
Disgusted 45.3%
Calm 47.3%
Angry 45.3%
Surprised 45.3%
Sad 47.4%
Confused 45.4%

Feature analysis

Amazon

Person 93.6%

Captions

Microsoft

a close up of a sign 65.3%
a sign on the grass 48.5%
close up of a sign 48.4%