Human Generated Data

Title

Untitled (men in Cooper Bros. carriage)

Date

1908

People

Artist: Arlington Studio, American active 1910s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2921

Human Generated Data

Title

Untitled (men in Cooper Bros. carriage)

People

Artist: Arlington Studio, American active 1910s

Date

1908

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Animal 98.6
Horse 98.6
Mammal 98.6
Horse 98.6
Person 92.5
Human 92.5
Person 90.5
Person 88.1
Transportation 87.9
Vehicle 87.9
Person 87.3
Person 83.8
Wagon 82.5
Horse Cart 82.5
Machine 76
Wheel 76
Outdoors 70.7
Carriage 68.5
Person 68.4
Person 66.4
Nature 61
Text 58.6
Person 58.3
Countryside 55.3
Spoke 55.3

Imagga
created on 2022-01-23

horse 31.3
rural 28.2
pasture 26.8
farm 25.9
wild 24.4
ranch 23.6
landscape 22.3
grass 22.1
horses 21.4
mammal 20.1
ungulate 19.7
wildlife 19.6
brown 19.1
livestock 19
outdoors 18.7
field 18.4
grazing 17.7
animals 17.6
equine 16.6
sky 15.9
snow 15.9
country 15.8
herd 15.7
tree 15.5
sunset 15.3
warthog 15
cow 14.1
travel 14.1
black 13.8
summer 13.5
safari 13.5
swine 13.4
park 12.3
plow 12
winter 11.9
odd-toed ungulate 11.8
mare 11.8
silhouette 11.6
pen 11.5
outdoor 11.5
fence 11.5
bull 11.4
countryside 11
graze 10.8
stallion 10.8
trees 10.7
rhinoceros 10.6
zebra 10.6
cowboy 9.8
enclosure 9.6
wilderness 9.5
tool 9.4
old 9.1
scenery 9
meadow 9
weather 8.9
cows 8.9
sun 8.9
agriculture 8.8
scenic 8.8
cattle 8.7
cold 8.6
south 8.4
sunrise 8.4
hill 8.4
mountains 8.3
peaceful 8.2
hay 8.2
game 8.2
barn 8.1
natural 8
deer 8
structure 7.9
mane 7.8
rock 7.8
scene 7.8
reserve 7.8
dirt 7.6
male 7.6
clouds 7.6
eating 7.6
dry 7.4
tourism 7.4
water 7.3
lake 7.3
national 7.2
mountain 7.1
season 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

horse 99.4
text 97.4
animal 91.3
outdoor 86.6
cart 83.9
old 72
horse and buggy 57.6
mule 55.3
carriage 53.6
rein 51.9
cattle 38.2
picture frame 16.8

Face analysis

Amazon

Google

AWS Rekognition

Age 47-53
Gender Male, 99.8%
Sad 38.1%
Calm 27.9%
Angry 23.1%
Disgusted 6.1%
Confused 1.5%
Happy 1.5%
Fear 0.9%
Surprised 0.9%

AWS Rekognition

Age 26-36
Gender Male, 97.9%
Sad 58.3%
Angry 14.9%
Calm 10%
Happy 7.2%
Disgusted 4.5%
Confused 2.5%
Fear 1.5%
Surprised 1.1%

AWS Rekognition

Age 37-45
Gender Male, 99.9%
Calm 87.2%
Happy 4.3%
Disgusted 2.5%
Sad 1.6%
Surprised 1.3%
Fear 1.2%
Angry 1.2%
Confused 0.6%

AWS Rekognition

Age 16-24
Gender Female, 75.2%
Angry 76.8%
Calm 20%
Confused 1.5%
Sad 0.5%
Disgusted 0.5%
Surprised 0.4%
Happy 0.2%
Fear 0.2%

AWS Rekognition

Age 36-44
Gender Female, 99.9%
Calm 79.9%
Sad 8.5%
Angry 3.7%
Disgusted 3.1%
Happy 1.5%
Fear 1.2%
Confused 1.1%
Surprised 1%

AWS Rekognition

Age 21-29
Gender Male, 99.6%
Calm 94.2%
Confused 2.6%
Surprised 2.1%
Angry 0.3%
Sad 0.3%
Fear 0.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 24-34
Gender Male, 100%
Calm 92.9%
Angry 2.7%
Disgusted 1.5%
Sad 0.8%
Confused 0.7%
Happy 0.5%
Surprised 0.5%
Fear 0.3%

AWS Rekognition

Age 29-39
Gender Male, 83.4%
Calm 99.7%
Confused 0.1%
Sad 0.1%
Disgusted 0%
Surprised 0%
Happy 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 24-34
Gender Male, 92.5%
Calm 39%
Sad 24.3%
Angry 22.9%
Confused 5.3%
Happy 2.8%
Disgusted 2.5%
Fear 1.6%
Surprised 1.5%

AWS Rekognition

Age 22-30
Gender Male, 75.3%
Sad 81.4%
Calm 10.8%
Happy 4.4%
Disgusted 0.9%
Fear 0.9%
Angry 0.7%
Confused 0.4%
Surprised 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Horse 98.6%
Person 92.5%
Wheel 76%

Captions

Microsoft

a herd of cattle standing on top of a horse 55.2%
a herd of cattle standing on top of a horse drawn carriage 37.8%
a herd of cattle standing on top of a field 37.7%

Text analysis

Amazon

Hollow
Happy Hollow
Happy
SPRINGS
HOT
HOT SPRINGS ARK
referring
by
Arlington
Arlington Studio,
Studio,
ARK
to
purplica
20159
DE
DIN
purplica by orders referring CND 06 bas
to DIN Sha DE pielare
bas
06
orders
pielare
CND
Sha

Google

AR
Kagpy
HOT
SPRINGS
pietre
y
tonhar
oe
Nollow
arlington Studio y elersing tonhar oe pietre Kagpy Nollow HOT SPRINGS AR
arlington
Studio
elersing