Human Generated Data

Title

Photo Album

Date

c. 1857 - c. 1874

People

-

Classification

Photographs

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Transfer from Widener Library, Harvard University, 1978.484.84

Human Generated Data

Title

Photo Album

Date

c. 1857 - c. 1874

Classification

Photographs

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Transfer from Widener Library, Harvard University, 1978.484.84

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 98.6
Human 98.6
Person 97.5
Person 96.6
Person 94.9
Person 94.5
Person 94.4
Person 92.5
Person 91.1
Art 90.8
Painting 90.8
Person 85.5
Person 84.7
Drawing 80.6
Person 76.6
People 75.2
Leisure Activities 71.5
Person 56.3
Doodle 56.2

Clarifai
created on 2023-10-25

people 99.9
group 99.8
art 99.5
adult 99.2
illustration 98.1
man 97.6
woman 96.5
many 96.2
veil 94.4
wear 93.8
print 92.2
monarch 89.5
leader 87.4
child 86.8
several 86.7
facial hair 85.2
sword 84.8
gown (clothing) 84.5
retro 84
painting 83.5

Imagga
created on 2022-01-09

tray 83.6
receptacle 67.7
container 65.3
old 36.2
vintage 35.5
grunge 31.5
texture 27.1
ancient 26.8
art 26
retro 25.4
earthenware 24.7
ceramic ware 22.9
antique 22.5
paper 21.2
decoration 20.7
frame 19.1
design 19
aged 19
pattern 18.4
wall 16.2
decorative 15
utensil 15
ornate 14.6
floral 14.5
chalkboard 13.7
china 13.3
black 13.2
text 13.1
wallpaper 13
symbol 12.8
money 12.8
drawing 12.6
creative 12.3
flower 12.3
letter 11.9
border 11.8
dirty 11.7
graphic 11.7
history 11.6
parchment 11.5
blackboard 11.5
textured 11.4
detail 11.3
finance 11
currency 10.8
backdrop 10.7
sculpture 10.5
grungy 10.4
artistic 10.4
brown 10.3
carving 10.3
culture 10.2
architecture 10.1
artwork 10.1
wood 10
majolica 9.9
sign 9.8
business 9.7
style 9.6
color 9.4
blank 9.4
word 9.4
board 9.3
bag 9.2
cash 9.1
school 9
material 8.9
crumpled 8.7
building 8.7
education 8.7
ornament 8.6
travel 8.4
page 8.3
note 8.3
historic 8.2
paint 8.1
chalk 7.8
empty 7.7
craft 7.6
traditional 7.5
graffito 7.4
element 7.4
close 7.4
idea 7.1

Google
created on 2022-01-09

Rectangle 89.8
Picture frame 87.6
Font 81.4
Art 77.9
Serveware 73.6
Metal 71.4
Antique 67
History 66.8
Visual arts 65
Illustration 61.7
Wood 58
Dishware 57.8
Drawing 56.8
Painting 53.8
Vintage clothing 52.7

Microsoft
created on 2022-01-09

drawing 98
old 93.5
sketch 91.7
person 90.6
indoor 89.8
clothing 84.3
black 78.3
text 77
cartoon 76.6
white 74.9
vintage 53.6
illustration 52.3
posing 43.9
picture frame 10.2
stone 4.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-27
Gender Female, 100%
Calm 90.4%
Surprised 4.3%
Fear 1.9%
Happy 1%
Sad 0.7%
Angry 0.6%
Confused 0.6%
Disgusted 0.6%

AWS Rekognition

Age 22-30
Gender Female, 100%
Calm 61%
Confused 14.3%
Surprised 9%
Angry 8.7%
Disgusted 2.8%
Fear 1.7%
Sad 1.4%
Happy 1%

AWS Rekognition

Age 19-27
Gender Female, 99%
Calm 98.6%
Angry 0.4%
Confused 0.3%
Happy 0.2%
Sad 0.2%
Disgusted 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 23-33
Gender Female, 100%
Calm 87.8%
Fear 6.4%
Sad 1.4%
Surprised 1.3%
Happy 1.3%
Angry 1.1%
Disgusted 0.4%
Confused 0.3%

AWS Rekognition

Age 23-31
Gender Female, 100%
Fear 51%
Surprised 27.1%
Calm 17.5%
Angry 1.2%
Happy 1.1%
Disgusted 0.8%
Confused 0.8%
Sad 0.5%

AWS Rekognition

Age 23-31
Gender Female, 99%
Fear 63.9%
Calm 12%
Angry 10.8%
Surprised 9.2%
Disgusted 1.6%
Confused 1.1%
Sad 1%
Happy 0.4%

AWS Rekognition

Age 18-26
Gender Male, 97.6%
Surprised 74%
Fear 14.8%
Calm 4.6%
Angry 2.6%
Disgusted 2%
Sad 1.2%
Confused 0.4%
Happy 0.4%

AWS Rekognition

Age 20-28
Gender Female, 79.1%
Surprised 51%
Calm 26.8%
Disgusted 7.9%
Confused 5.4%
Fear 3%
Happy 2.3%
Angry 2.2%
Sad 1.4%

AWS Rekognition

Age 45-53
Gender Female, 97.4%
Happy 82.1%
Calm 11.1%
Surprised 1.8%
Confused 1.2%
Sad 1.1%
Angry 1%
Disgusted 0.9%
Fear 0.8%

AWS Rekognition

Age 21-29
Gender Female, 100%
Fear 34.1%
Calm 31.2%
Disgusted 9.2%
Angry 8.6%
Confused 8.1%
Surprised 5.8%
Sad 2%
Happy 1%

AWS Rekognition

Age 33-41
Gender Male, 99.5%
Angry 53%
Calm 27.3%
Confused 10.2%
Sad 3.9%
Disgusted 1.9%
Surprised 1.6%
Fear 1.4%
Happy 0.6%

AWS Rekognition

Age 23-31
Gender Male, 94.7%
Calm 94.3%
Sad 1.5%
Disgusted 1%
Surprised 0.9%
Angry 0.8%
Fear 0.6%
Confused 0.5%
Happy 0.4%

AWS Rekognition

Age 26-36
Gender Female, 83%
Calm 61.9%
Sad 11.4%
Surprised 6.4%
Happy 6.1%
Disgusted 5.9%
Confused 3.5%
Fear 2.9%
Angry 1.9%

Microsoft Cognitive Services

Age 51
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%
Painting 90.8%

Categories

Imagga

paintings art 97.9%