Human Generated Data

Title

Untitled (crowd of people on hillside surrounding men with two draft horses pulling man in sledge(?))
Date

20th century
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 4.2002.22222

Human Generated Data

Title

Untitled (crowd of people on hillside surrounding men with two draft horses pulling man in sledge(?))

People

Artist: Unidentified Artist,

Date

20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 4.2002.22222

Machine Generated Data

Tags

Amazon
created on 2022-03-11

Ice 96.3
Nature 96.3
Outdoors 96.3
Person 93.5
Human 93.5
Painting 90.7
Art 90.7
Person 85.9
Person 84.1
Person 83.1
Snow 81.1
Person 80.9
Horse 80.8
Animal 80.8
Mammal 80.8
Frost 80.5
Person 76.6
Person 72.4
Bird 69.7
Person 62.1
Person 47
Person 42.7

Clarifai
created on 2023-10-22

people 99.6
group 99
many 98.8
adult 97.4
illustration 94.6
no person 92.8
art 92.7
cavalry 92.3
group together 91.9
man 91.8
woman 89.2
crowd 88.3
mammal 87
print 86.9
interaction 85.4
leader 80.6
dancing 78.4
home 77.5
tree 76.7
several 76.3

Imagga
created on 2022-03-11

graffito 79.4
gravestone 65.6
grunge 61.4
old 55.1
memorial 54.9
decoration 52.3
texture 52.2
vintage 49.7
wall 48.5
antique 48.5
aged 47.1
stone 44.5
structure 43.3
dirty 36.2
retro 34.4
rusty 34.3
ancient 32.9
damaged 32.5
grungy 32.3
wallpaper 32.2
material 32.2
rough 31
frame 30
doormat 27.8
textured 27.2
pattern 26.7
empty 26.7
aging 25.9
paper 25.9
surface 25.6
weathered 24.7
decay 24.1
canvas 22.8
mat 22
design 22
backgrounds 21.9
space 21.7
border 21.7
grain 20.3
stained 20.2
art 20.2
parchment 20.2
messy 18.4
stain 18.3
dirt 18.2
blank 18
grime 17.6
backdrop 17.3
spot 17.3
paint 17.2
worn 17.2
old fashioned 17.1
color 16.7
floor cover 16.7
text 16.6
faded 16.6
stains 16.6
fracture 15.6
crumpled 15.6
obsolete 15.3
graphic 15.3
brown 14.7
mottled 14.6
crack 14.5
ragged 13.7
torn 13.6
concrete 13.4
tracery 12.7
historic 11.9
burnt 11.7
rust 11.6
textures 11.4
covering 11
broad 10.8
crease 10.8
scratched 10.8
succulent 10.7
sheet 10.3
decorative 10
detail 9.7
black 9.6
document 9.3
dark 9.2
gray 9
history 9
stucco 8.9
cracked 8.8
artistic 8.7
cardboard 8.7
close 8.6
construction 8.6
artwork 8.3
world 8.1
metal 8.1
building 7.9
abandoned 7.8
cement 7.8
broken 7.7
spotted 7.7
age 7.6
china 7.5
map 7.5
iron 7.5
earth 7.4
metallic 7.4
note 7.4
letter 7.3
effect 7.3
yellow 7.3
steel 7.1

Google
created on 2022-03-11

Organism 86.1
Rectangle 82
Art 78.7
Font 78.2
Tree 78.1
Painting 70.2
Visual arts 67.7
History 64.3
Monochrome 64
Stock photography 62.1
Paper product 62
Monochrome photography 60.8
Illustration 59.7
Grass 53.6

Microsoft
created on 2022-03-11

text 94.2
outdoor 91.7
grave 87.8
cemetery 81.8
drawing 80
old 77.7
black and white 64.5
gravestone 59.9
stone 6

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 14-22
Gender Male, 75%
Calm 62%
Fear 14.6%
Happy 8.9%
Sad 7.8%
Confused 2%
Angry 1.8%
Surprised 1.5%
Disgusted 1.4%

AWS Rekognition

Age 24-34
Gender Male, 98.4%
Calm 78.9%
Happy 15.4%
Surprised 3%
Angry 0.7%
Disgusted 0.6%
Confused 0.6%
Sad 0.5%
Fear 0.3%

AWS Rekognition

Age 11-19
Gender Male, 73%
Calm 75.6%
Angry 17.9%
Sad 3%
Happy 1.2%
Surprised 0.9%
Fear 0.7%
Confused 0.4%
Disgusted 0.3%

AWS Rekognition

Age 18-26
Gender Male, 95.6%
Calm 90.4%
Sad 3.9%
Disgusted 1.7%
Confused 1%
Angry 1%
Happy 1%
Fear 0.7%
Surprised 0.4%

AWS Rekognition

Age 37-45
Gender Male, 91.5%
Sad 23.9%
Calm 22.2%
Happy 16.7%
Angry 16.6%
Fear 7.6%
Surprised 6.3%
Confused 3.4%
Disgusted 3.3%

AWS Rekognition

Age 6-14
Gender Female, 65.3%
Sad 62.8%
Calm 20.7%
Fear 5.1%
Confused 4.3%
Happy 2.9%
Disgusted 2%
Angry 1.3%
Surprised 0.8%

AWS Rekognition

Age 38-46
Gender Male, 59.4%
Calm 94.9%
Sad 3%
Confused 0.5%
Angry 0.5%
Disgusted 0.3%
Happy 0.3%
Surprised 0.3%
Fear 0.2%

AWS Rekognition

Age 23-31
Gender Male, 99.5%
Angry 48.5%
Calm 23.9%
Sad 9.3%
Happy 9.1%
Disgusted 3.1%
Fear 2.4%
Surprised 2.3%
Confused 1.4%

AWS Rekognition

Age 25-35
Gender Male, 100%
Calm 90.7%
Happy 6.6%
Sad 1.7%
Angry 0.4%
Disgusted 0.3%
Surprised 0.2%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 20-28
Gender Male, 95.1%
Calm 87.4%
Confused 8.6%
Surprised 0.9%
Fear 0.9%
Disgusted 0.7%
Sad 0.5%
Happy 0.5%
Angry 0.4%

AWS Rekognition

Age 16-22
Gender Male, 73.1%
Calm 92.4%
Happy 2.1%
Angry 1.9%
Sad 1.6%
Surprised 0.7%
Confused 0.4%
Disgusted 0.4%
Fear 0.4%

Feature analysis

Amazon

Person
Painting
Horse
Bird
Person 93.5%
Person 85.9%
Person 84.1%
Person 83.1%
Person 80.9%
Person 76.6%
Person 72.4%
Person 62.1%
Person 47%
Person 42.7%
Painting 90.7%
Horse 80.8%
Bird 69.7%