Human Generated Data

Title

Untitled (men in Cooper Bros. carriage)

Date

1908

People

Artist: Arlington Studio, American active 1910s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2920

Human Generated Data

Title

Untitled (men in Cooper Bros. carriage)

People

Artist: Arlington Studio, American active 1910s

Date

1908

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.2
Human 99.2
Person 98.9
Machine 98.8
Wheel 98.8
Military 95.3
Person 95.2
Person 93.9
Military Uniform 93.8
Wheel 93
Transportation 92.3
Carriage 92.3
Vehicle 92.3
Person 89.6
Person 86.4
Person 84.7
People 83.2
Armored 81.2
Army 81.2
Soldier 75.3
Officer 75
Person 73.2
Funeral 67
Troop 59.7
Person 44.2

Imagga
created on 2022-01-23

graffito 50.9
grunge 47.7
vintage 42.2
old 39.7
decoration 38.5
retro 36
antique 35.5
aged 31.7
texture 29.9
frame 27.5
paper 25.9
art 25
grungy 24.7
border 22.6
ancient 20.7
structure 20.2
dirty 19.9
pattern 19.8
space 18.6
damaged 18.1
paint 18.1
blank 18
wall 17.2
text 16.6
rough 16.4
dirt 16.2
textured 15.8
design 15.8
black 15
aging 14.4
canvas 14.2
memorial 13.9
torn 13.5
material 13.4
weathered 13.3
graphic 13.1
billboard 12.6
rust 12.5
stained 12.5
old fashioned 12.4
color 12.2
brass 12.2
decorative 11.7
burnt 11.7
parchment 11.5
worn 11.5
empty 11.2
page 11.1
artwork 11
messy 10.6
brown 10.3
floral 10.2
signboard 10.2
drawing 10.1
history 9.8
burned 9.8
noise 9.8
world 9.7
crumpled 9.7
edge 9.6
detailed 9.6
grain 9.2
historic 9.2
element 9.1
digital 8.9
style 8.9
noisy 8.9
mess 8.8
grime 8.8
stains 8.7
states 8.7
layer 8.7
artistic 8.7
obsolete 8.6
wallpaper 8.4
landmark 8.1
newspaper 8.1
film 8
stone 7.9
yellow 7.9
highly 7.9
designed 7.9
layered 7.9
photographic 7.8
frames 7.8
scratch 7.8
collage 7.7
flower 7.7
mask 7.7
spot 7.7
wheeled vehicle 7.6
rusty 7.6
city 7.5
note 7.3
negative 7.2
screen 7.1
vehicle 7.1
sculpture 7.1

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

text 99.4
horse 97.4
old 97.4
drawn 92.3
outdoor 87.5
black 84.9
carriage 84.2
person 77
land vehicle 72.2
horse and buggy 67.6
wheel 55.4
cart 52
vehicle 51.7
pulling 43.7

Face analysis

Amazon

Google

AWS Rekognition

Age 33-41
Gender Male, 100%
Confused 73.3%
Calm 13.5%
Angry 4.9%
Fear 3.1%
Surprised 1.7%
Sad 1.6%
Disgusted 1.3%
Happy 0.6%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Calm 99.9%
Sad 0%
Confused 0%
Disgusted 0%
Angry 0%
Happy 0%
Fear 0%
Surprised 0%

AWS Rekognition

Age 19-27
Gender Male, 99.5%
Calm 98.8%
Confused 0.6%
Sad 0.3%
Surprised 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0%
Happy 0%

AWS Rekognition

Age 39-47
Gender Male, 99.9%
Calm 61.6%
Sad 14%
Angry 10.4%
Confused 8.3%
Disgusted 3.3%
Happy 1%
Fear 0.7%
Surprised 0.7%

AWS Rekognition

Age 23-33
Gender Male, 83.9%
Sad 58%
Fear 17.4%
Calm 17.2%
Confused 3.3%
Surprised 1.4%
Happy 1.2%
Angry 1%
Disgusted 0.5%

AWS Rekognition

Age 24-34
Gender Male, 100%
Calm 98.8%
Confused 0.7%
Angry 0.2%
Sad 0.1%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 43-51
Gender Male, 99.9%
Calm 88%
Happy 8.2%
Confused 1.5%
Angry 1.2%
Sad 0.6%
Disgusted 0.2%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 21-29
Gender Female, 99.6%
Calm 99.8%
Disgusted 0%
Angry 0%
Confused 0%
Sad 0%
Surprised 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 45-51
Gender Male, 100%
Calm 80.2%
Happy 5.3%
Angry 4.5%
Surprised 4.2%
Sad 2.3%
Disgusted 1.5%
Confused 1.3%
Fear 0.7%

AWS Rekognition

Age 19-27
Gender Male, 99.6%
Calm 99.3%
Angry 0.3%
Sad 0.1%
Confused 0.1%
Surprised 0.1%
Happy 0.1%
Fear 0.1%
Disgusted 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Wheel 98.8%

Captions

Microsoft

a vintage photo of a man riding a horse drawn carriage 95.8%
an old photo of a man riding a horse drawn carriage 95.7%
a man riding a horse drawn carriage 95.6%

Text analysis

Amazon

BROS
COOPER BROS
COOPER
Studio,
28145
SPRINGS
by
bad
Verhagion Studio,
HC SPRINGS
orders
Daplicate
CSD
DE
Verhagion
interning
DE votes
HC
votes
TV

Google

COOPER BROS 28145 hagon Stdio, hy reteting aber be ete
COOPER
hy
28145
aber
Stdio,
BROS
hagon
be
ete
reteting