Human Generated Data

Title

Photo Album
Date

c. 1857 - c. 1874
People

-
Classification

Photographs
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Transfer from Widener Library, Harvard University, 1978.484.61

Human Generated Data

Title

Photo Album

Date

c. 1857 - c. 1874

Classification

Photographs

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Transfer from Widener Library, Harvard University, 1978.484.61

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Clothing 99.6
Apparel 99.6
Person 98.5
Human 98.5
Person 98
Painting 97.7
Art 97.7
Outdoors 72.3
Portrait 65.5
Photography 65.5
Photo 65.5
Face 65.5
Hat 61.3
Sun Hat 59.2
Hat 57.5
Tool 56.9

Clarifai
created on 2023-10-25

people 99.9
man 98.6
adult 98.4
lid 98.3
two 98.2
group 97.8
veil 97.4
walking stick 97.3
weapon 97.2
three 97.1
wear 95.1
elderly 93.4
four 91.8
group together 91.5
woman 91.3
farming 91.2
gun 90.3
child 89.9
art 89.8
portrait 89.4

Imagga
created on 2022-01-09

weapon 25.8
helmet 25.6
man 22.2
cowboy hat 17.4
person 17.1
tool 16.4
hat 16.1
old 16
armor plate 15.3
shovel 14.3
clothing 14
halberd 13.4
adult 13
people 12.8
male 12.8
sword 12.3
hand tool 11.9
headdress 10.9
warrior 10.7
pike 10.7
sculpture 10.7
statue 10.6
art 10.5
culture 10.3
protection 10
outdoor 9.9
instrument 9.9
military 9.7
outside 9.4
grunge 9.4
vintage 9.1
sport 9.1
cowboy 9
outdoors 9
costume 8.7
plate 8.7
uniform 8.6
portrait 8.4
staff 8.4
dark 8.4
color 8.3
crutch 8.3
light 8
soldier 7.8
protective 7.8
horror 7.8
war 7.7
attractive 7.7
power 7.6
leisure 7.5
style 7.4
danger 7.3
active 7.2
religion 7.2
history 7.2
posing 7.1
face 7.1
summer 7.1
rustic 7.1
child 7

Google
created on 2022-01-09

Hat 93.5
Sun hat 84.1
Collar 81.2
Art 79.3
Vintage clothing 75
Wind instrument 71.7
Victorian fashion 71.7
Painting 68.9
Illustration 68.2
Picture frame 67.3
Uniform 66.9
Recreation 66.8
Visual arts 65.8
American frontier 65.7
Cowboy hat 64.2
Soldier 62.1
Suit 59.6
Plant 59.4
History 57.2
Fashion accessory 57

Microsoft
created on 2022-01-09

wall 96.1
clothing 92.5
hat 90.8
person 89.8
old 76.2
man 72.5
text 69.6
cowboy hat 67.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 25-35
Gender Male, 100%
Calm 74.9%
Confused 9.6%
Sad 7.1%
Surprised 3%
Angry 2.6%
Fear 1.2%
Disgusted 0.8%
Happy 0.7%

AWS Rekognition

Age 22-30
Gender Male, 99.9%
Sad 44.8%
Calm 27.2%
Fear 11.7%
Surprised 6.6%
Confused 4%
Angry 3.3%
Disgusted 1.8%
Happy 0.7%

Microsoft Cognitive Services

Age 21
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%
Painting 97.7%
Hat 61.3%

Categories

Imagga

events parties 88.1%
paintings art 5.3%
beaches seaside 1.5%
pets animals 1.5%
nature landscape 1.1%

Captions

Microsoft
created on 2022-01-09

an old photo of a man 88%
old photo of a man 85.3%
a old photo of a man 84.9%