Human Generated Data

Title

Untitled (two men seated in horse drawn wagon holding shotguns, advertising Phillips 66 gasoline)

Date

c. 1945

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11299

Human Generated Data

Title

Untitled (two men seated in horse drawn wagon holding shotguns, advertising Phillips 66 gasoline)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Machine 99.1
Wheel 99.1
Wheel 98.4
Transportation 96.6
Horse Cart 96.6
Wagon 96.6
Vehicle 96.6
Person 92.4
Human 92.4
Person 90.3
Mammal 87.4
Cattle 87.4
Cow 87.4
Animal 87.4
Horse 87.2
Person 67.8
Carriage 67.3
Spoke 61.2

Imagga
created on 2022-01-23

carriage 100
horse cart 82.6
cart 72.7
wagon 57.4
horse 53.2
wheeled vehicle 32.4
animal 32
horses 26.3
farm 20.5
vehicle 19.1
grass 19
transportation 17
rural 16.7
ride 16.5
equestrian 15.7
mammal 15.2
old 14.6
riding 14.6
animals 13.9
harness 12.7
brown 12.5
outdoor 12.2
sky 11.5
travel 11.3
outdoors 11.2
countryside 11
ranch 10.7
trees 10.7
fence 10.6
country 10.5
historic 10.1
transport 10.1
tourist 10
tourism 9.9
sport 9.9
history 9.8
cow 9.7
agriculture 9.7
man 9.4
male 9.2
field 9.2
saddle 8.9
antique 8.7
architecture 8.6
historical 8.5
tree 8.5
color 8.3
vacation 8.2
landscape 8.2
team 8.1
horseback 7.9
rider 7.9
people 7.8
driver 7.8
western 7.8
summer 7.7
park 7.4
building 7.1
day 7.1
cattle 7.1

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

horse 100
outdoor 100
carriage 99.9
drawn 99.9
tree 99.5
pulling 99.5
cart 93.5
text 93.3
horse-drawn vehicle 85.1
animal 80
land vehicle 79.9
horse and buggy 72.8
vehicle 67
transport 66.2
pulled 64.7
wheel 61.7
old 59.2
wagon 58.2

Face analysis

Amazon

Google

AWS Rekognition

Age 51-59
Gender Male, 98.3%
Calm 88.1%
Happy 7.9%
Sad 1.1%
Surprised 1.1%
Confused 0.8%
Disgusted 0.5%
Angry 0.4%
Fear 0.2%

AWS Rekognition

Age 37-45
Gender Male, 99.9%
Calm 42.5%
Confused 35.4%
Happy 8.1%
Surprised 4.5%
Disgusted 4.1%
Sad 3.5%
Fear 1.4%
Angry 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Wheel 99.1%
Person 92.4%
Cow 87.4%
Horse 87.2%

Captions

Microsoft

a man riding a horse drawn carriage 97.5%
an old photo of a horse drawn carriage 97.4%
a man riding on the back of a horse drawn carriage 95.6%

Text analysis

Amazon

64
POST
TRADIN
the
66
WEST
THAT
THE WEST
THE
Trop-Artic
THAT WON
THE GASOLINE
GASOUNE
the GASOUNE THAT Wow is WES
WON
GASOLINE
FUELFUEL
Wow
is
WES
100wet
CBS
2000
ISM

Google

Artic
GasoUNE
YPOST
THAT
FuE FUEL Trop Artic O the GasoUNE THAr WowaeW 64 O TRADIN PE YPOST E GASOUNE THAT WON HE W
FUEL
O
THAr
TRADIN
E
GASOUNE
HE
FuE
Trop
64
PE
WON
the
WowaeW
W