Human Generated Data

Title

Untitled (male group on donkeys)

Date

1908

People

Artist: Arlington Studio, American active 1910s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2923

Human Generated Data

Title

Untitled (male group on donkeys)

People

Artist: Arlington Studio, American active 1910s

Date

1908

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 98.5
Person 98.5
Person 96.6
Person 96.5
Person 96
Person 95.9
Person 93.8
Person 92.5
Art 92.4
Painting 92.4
Person 92.2
Military 91.4
Military Uniform 91.2
Person 89.6
Horse 79.3
Animal 79.3
Mammal 79.3
Horse 76
Armored 74.8
Army 74.8
People 74
Horse 70.2
Horse 69.6
Horse 68.2
Officer 63.5
Crowd 61.7
Duel 59.8
Troop 59.5
Text 55.8
Funeral 55.5

Imagga
created on 2022-01-23

vintage 43.8
grunge 43.4
old 42.5
aged 38.9
texture 34.7
ancient 32
retro 26.2
paper 24.3
antique 24.2
envelope 23.3
grungy 20.9
dirty 19.9
wall 19.8
worn 19.1
wallpaper 17.6
frame 17.5
old fashioned 17.1
space 17.1
material 17
decoration 16.7
graffito 15.8
grime 15.6
damaged 15.3
art 15
artistic 14.8
grain 14.8
decay 14.5
letter 13.7
container 13.5
structure 13.4
brown 13.2
page 13
empty 12.9
fracture 12.6
design 12.6
crumpled 12.6
cardboard 12.5
dirt 12.4
rusty 12.4
text 12.2
card 12
historic 11.9
artwork 11.9
distressed 11.8
pattern 11.6
silhouette 11.6
textured 11.4
blank 11.1
decorative 10.9
border 10.8
symbol 10.8
ragged 10.7
parchment 10.6
textures 10.4
global 10
paint 10
world 9.9
history 9.8
scratched 9.8
stains 9.7
states 9.7
note 9.2
country 9.1
landscape 8.9
earth 8.9
sand 8.8
manuscript 8.8
geography 8.7
north 8.6
united 8.6
culture 8.5
china 8.5
black 8.4
ocean 8.3
message 8.2
atlas 8.2
backgrounds 8.1
graphic 8
stamp 7.9
surface 7.9
planet 7.9
circa 7.9
postmark 7.9
urban 7.9
postage 7.9
postal 7.8
shabby 7.8
architecture 7.8
color 7.8
stained 7.7
stain 7.7
mail 7.7
japan 7.6
bill 7.6
canvas 7.6
communication 7.6
map 7.5
doormat 7.5
rough 7.3
yellow 7.3
travel 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

old 96.8
text 96.3
person 96.2
black 68.6
posing 68.2
group 61.8
man 51.2
vintage 41.3
plaque 19.5
picture frame 15.8
stone 8.8

Face analysis

Amazon

Google

AWS Rekognition

Age 19-27
Gender Male, 99.9%
Calm 99.9%
Happy 0%
Angry 0%
Surprised 0%
Sad 0%
Confused 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 24-34
Gender Female, 97.9%
Happy 97.1%
Calm 0.9%
Fear 0.6%
Angry 0.5%
Sad 0.3%
Disgusted 0.3%
Confused 0.3%
Surprised 0.2%

AWS Rekognition

Age 29-39
Gender Male, 57%
Calm 48.2%
Disgusted 20.1%
Happy 12.6%
Confused 5.2%
Sad 4.7%
Angry 4.5%
Surprised 2.9%
Fear 1.9%

AWS Rekognition

Age 25-35
Gender Male, 99.9%
Calm 91.2%
Sad 6.9%
Fear 0.9%
Angry 0.5%
Surprised 0.2%
Disgusted 0.1%
Happy 0.1%
Confused 0.1%

AWS Rekognition

Age 25-35
Gender Male, 99.3%
Calm 91.7%
Happy 7.1%
Confused 0.3%
Angry 0.2%
Surprised 0.2%
Sad 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 21-29
Gender Male, 100%
Calm 99.9%
Happy 0%
Angry 0%
Surprised 0%
Confused 0%
Sad 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 22-30
Gender Female, 99.9%
Calm 93.5%
Sad 4.4%
Angry 0.5%
Surprised 0.5%
Disgusted 0.5%
Confused 0.4%
Happy 0.2%
Fear 0.1%

AWS Rekognition

Age 24-34
Gender Male, 99.2%
Happy 22.2%
Sad 21.7%
Calm 20.1%
Disgusted 15%
Angry 6.8%
Surprised 6.4%
Fear 5.4%
Confused 2.3%

AWS Rekognition

Age 39-47
Gender Male, 93.3%
Sad 98.1%
Calm 1.4%
Happy 0.2%
Fear 0.1%
Angry 0.1%
Disgusted 0.1%
Confused 0%
Surprised 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Unlikely

Feature analysis

Amazon

Person 98.5%
Painting 92.4%
Horse 79.3%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 85.1%
a vintage photo of a group of people posing for a picture 85%
a group of people posing for a photo 84.9%

Text analysis

Amazon

Studio
Happy
by
SPRINGS
veterrior Happy Hollow
GT SPRINGS AR4
29688
AR4
veterrior
GT
Hollow

Google

Studio yteterrin ST SPRINGSARI
yteterrin
ST
SPRINGSARI
Studio