Human Generated Data

Title

Yusuf and Zulaykha

Date

20th century

People
Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of John Goelet, 1958.232

Human Generated Data

Title

Yusuf and Zulaykha

People
Date

20th century

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-06

Art 96.4
Painting 96.4
Tapestry 74.1
Ornament 74.1
Architecture 73.6
Building 73.6
Home Decor 70.5
Human 61.2
Person 61.2
Person 61
Linen 55.7
Archaeology 55.6
Person 55.4
Person 54.8

Clarifai
created on 2018-04-19

illustration 99.5
art 99.2
painting 99.1
print 95.7
old 95.6
antique 93
wall 92.8
paper 92.6
ancient 92.1
religion 91.6
desktop 88.4
pattern 87.8
retro 87.7
artistic 87.1
decoration 86.8
design 86.5
vintage 86.1
picture frame 86
no person 85.8
visuals 84.4

Imagga
created on 2018-04-19

mosaic 100
transducer 100
electrical device 86.3
device 55.3
art 39.9
old 38.3
vintage 33.9
antique 33.7
grunge 30.7
instrumentality 28.8
ancient 27.7
texture 27.1
retro 27
pattern 21.2
paper 20.4
map 19.4
aged 18.1
tile 17.4
wall 15.4
dirty 15.4
design 15.2
obsolete 14.4
religion 14.3
frame 14.2
color 13.9
torn 13.5
geography 13.5
parchment 13.4
travel 13.4
worn 13.4
grungy 13.3
decoration 13
paint 12.7
history 12.5
brown 12.5
stained 12.5
world 12.4
blank 12
close 12
creation 11.9
border 11.8
wallpaper 11.5
culture 11.1
decorative 10.9
traditional 10.8
floral 10.2
church 10.2
letter 10.1
burnt 9.7
surface 9.7
detail 9.7
style 9.6
textured 9.6
god 9.6
canvas 9.5
symbol 9.4
page 9.3
flower 9.2
historic 9.2
material 8.9
manuscript 8.8
artistic 8.7
golden 8.6
empty 8.6
painted 8.6
book 8.2
drawing 7.8
atlas 7.8
faded 7.8
ornament 7.8
rust 7.7
rustic 7.7
tourism 7.4
backdrop 7.4
globe 7.4
gold 7.4
note 7.4
artwork 7.3
global 7.3
rough 7.3
currency 7.2

Google
created on 2018-04-19

art 82.7
tapestry 76.6
history 67
miniature 66.5
painting 61.5
middle ages 51.3
artwork 50.6

Microsoft
created on 2018-04-19

indoor 91.3
fabric 22.9
painting 15.8

Face analysis

Amazon

AWS Rekognition

Age 14-25
Gender Female, 54.8%
Sad 46.9%
Angry 45.7%
Confused 45.3%
Calm 45.4%
Disgusted 46%
Surprised 45.4%
Happy 50.4%

AWS Rekognition

Age 26-43
Gender Female, 54.6%
Disgusted 47.5%
Happy 45.3%
Confused 45.2%
Calm 50.3%
Sad 45.2%
Surprised 45.7%
Angry 45.8%

AWS Rekognition

Age 26-43
Gender Male, 52.8%
Happy 46%
Disgusted 51%
Confused 45.1%
Sad 45.3%
Angry 45.3%
Surprised 45.5%
Calm 46.8%

AWS Rekognition

Age 20-38
Gender Female, 54.8%
Calm 52.6%
Confused 45.2%
Disgusted 45.2%
Sad 45.7%
Happy 45.6%
Surprised 45.5%
Angry 45.3%

AWS Rekognition

Age 23-38
Gender Male, 54%
Surprised 45.2%
Confused 45.2%
Angry 45.1%
Disgusted 45.2%
Happy 53.4%
Sad 45.2%
Calm 45.7%

AWS Rekognition

Age 26-43
Gender Female, 51.7%
Sad 45.6%
Calm 45.9%
Angry 45.3%
Confused 45.2%
Disgusted 45.5%
Happy 52.3%
Surprised 45.3%

AWS Rekognition

Age 17-27
Gender Female, 53.8%
Confused 45.1%
Surprised 45.2%
Calm 45.4%
Sad 45.1%
Disgusted 53.7%
Angry 45.2%
Happy 45.3%

AWS Rekognition

Age 14-23
Gender Female, 50.3%
Sad 45.2%
Angry 45.1%
Disgusted 47.1%
Calm 45.8%
Happy 51.3%
Confused 45.1%
Surprised 45.3%

AWS Rekognition

Age 20-38
Gender Female, 54.8%
Happy 45.4%
Surprised 45.3%
Calm 51.3%
Confused 45.4%
Sad 46.6%
Angry 45.7%
Disgusted 45.5%

AWS Rekognition

Age 19-36
Gender Male, 53.5%
Calm 49.1%
Happy 46.5%
Disgusted 47.5%
Sad 45.8%
Surprised 45.5%
Angry 45.3%
Confused 45.2%

AWS Rekognition

Age 26-43
Gender Male, 52.9%
Sad 47.9%
Surprised 45.5%
Angry 45.8%
Happy 45.7%
Calm 46.3%
Confused 45.4%
Disgusted 48.3%

AWS Rekognition

Age 26-43
Gender Female, 52.7%
Sad 45.2%
Angry 45.9%
Confused 45.1%
Calm 45.8%
Disgusted 51.9%
Surprised 45.4%
Happy 45.7%

AWS Rekognition

Age 38-57
Gender Male, 54.2%
Surprised 45.7%
Disgusted 45.4%
Angry 46.1%
Sad 48.5%
Happy 45.6%
Calm 47.9%
Confused 45.8%

AWS Rekognition

Age 26-43
Gender Male, 53.5%
Disgusted 45.8%
Angry 45.8%
Happy 50.5%
Sad 45.8%
Confused 45.6%
Calm 45.5%
Surprised 46%

AWS Rekognition

Age 14-23
Gender Female, 52.3%
Angry 45.6%
Sad 45.4%
Confused 45.4%
Happy 48.2%
Disgusted 46.4%
Surprised 45.9%
Calm 48.2%

AWS Rekognition

Age 26-43
Gender Male, 54.3%
Angry 45.7%
Surprised 45.4%
Calm 46.6%
Disgusted 50.7%
Sad 45.3%
Happy 46%
Confused 45.2%

AWS Rekognition

Age 11-18
Gender Female, 54.5%
Confused 45.2%
Sad 45.6%
Happy 48%
Disgusted 45.5%
Calm 48.3%
Surprised 46.9%
Angry 45.4%

AWS Rekognition

Age 26-43
Gender Female, 51.1%
Happy 46.9%
Calm 46.2%
Confused 45.6%
Surprised 46.9%
Angry 45.7%
Disgusted 48.3%
Sad 45.4%

AWS Rekognition

Age 26-43
Gender Male, 53.7%
Sad 45.2%
Angry 45.9%
Happy 45.6%
Calm 45.5%
Surprised 45.2%
Disgusted 52.5%
Confused 45.1%

AWS Rekognition

Age 23-38
Gender Male, 53.2%
Sad 45.1%
Surprised 45.1%
Angry 45.2%
Happy 45.2%
Calm 45%
Confused 45.1%
Disgusted 54.3%

AWS Rekognition

Age 23-38
Gender Male, 54.1%
Confused 45.5%
Surprised 45.5%
Angry 46.8%
Calm 45.3%
Happy 46.3%
Disgusted 50%
Sad 45.6%

AWS Rekognition

Age 17-27
Gender Female, 54.1%
Confused 45.8%
Disgusted 46.5%
Angry 45.5%
Calm 48.6%
Sad 45.7%
Happy 46.9%
Surprised 46.1%

AWS Rekognition

Age 16-27
Gender Female, 52.3%
Confused 45.1%
Angry 45.6%
Happy 45.3%
Disgusted 45.1%
Calm 53.3%
Surprised 45.3%
Sad 45.3%

AWS Rekognition

Age 23-38
Gender Male, 52.4%
Angry 45.1%
Calm 45.6%
Confused 45%
Disgusted 45.1%
Happy 54%
Sad 45.1%
Surprised 45.1%

AWS Rekognition

Age 20-38
Gender Male, 52.1%
Disgusted 46.9%
Happy 47.3%
Angry 45.7%
Calm 47.9%
Sad 46.2%
Surprised 45.8%
Confused 45.3%

AWS Rekognition

Age 23-38
Gender Female, 50.5%
Surprised 47.3%
Angry 45.8%
Confused 45.3%
Disgusted 45.3%
Happy 46.6%
Sad 45.8%
Calm 49%

AWS Rekognition

Age 26-43
Gender Female, 52.3%
Sad 45.2%
Disgusted 51.5%
Angry 45.3%
Calm 47.4%
Confused 45.1%
Happy 45.2%
Surprised 45.2%

AWS Rekognition

Age 15-25
Gender Female, 50.4%
Happy 45.4%
Surprised 45.5%
Angry 45.4%
Confused 45.2%
Disgusted 46.2%
Sad 45.5%
Calm 51.8%

AWS Rekognition

Age 20-38
Gender Female, 52.5%
Calm 50.1%
Disgusted 45.8%
Surprised 45.6%
Angry 45.6%
Confused 45.2%
Sad 45.9%
Happy 46.7%

AWS Rekognition

Age 19-36
Gender Female, 52.4%
Confused 45.6%
Calm 46.5%
Happy 47.1%
Sad 46.8%
Disgusted 46.2%
Surprised 46.6%
Angry 46.2%

AWS Rekognition

Age 23-38
Gender Female, 51.6%
Confused 45.3%
Surprised 45.5%
Calm 48.8%
Sad 45.5%
Disgusted 45.7%
Angry 45.3%
Happy 49.1%

AWS Rekognition

Age 15-25
Gender Female, 54.9%
Angry 45.6%
Happy 45.4%
Confused 45.2%
Sad 51.7%
Surprised 45.2%
Calm 45.1%
Disgusted 46.8%

AWS Rekognition

Age 4-9
Gender Female, 51.8%
Confused 45.3%
Surprised 46.1%
Sad 46.9%
Happy 45.7%
Disgusted 46.1%
Angry 46.9%
Calm 48%

AWS Rekognition

Age 26-43
Gender Female, 51.7%
Sad 45.5%
Surprised 46.4%
Calm 46.1%
Disgusted 49.7%
Confused 45.2%
Angry 46%
Happy 46.1%

AWS Rekognition

Age 15-25
Gender Female, 54.8%
Happy 48.1%
Surprised 45.6%
Calm 45.5%
Confused 45.4%
Sad 47%
Angry 45.6%
Disgusted 47.7%

AWS Rekognition

Age 23-38
Gender Female, 50.1%
Calm 49.5%
Confused 49.5%
Disgusted 49.5%
Sad 49.6%
Happy 50.3%
Surprised 49.6%
Angry 49.6%

AWS Rekognition

Age 26-43
Gender Female, 52.4%
Happy 46%
Disgusted 48.8%
Calm 46.3%
Surprised 45.6%
Angry 46.2%
Confused 45.9%
Sad 46.3%

Feature analysis

Amazon

Painting 96.4%
Person 61.2%

Captions

Microsoft

a fabric surface 52.3%
a close up of a fabric surface 52.2%
a close up of fabric 49.7%