Human Generated Data

Title

Horse and Buggy Days

Date

c. 1930

People

Artist: Joseph Woodson Whitesell, American 1876 - 1958

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.1701

Human Generated Data

Title

Horse and Buggy Days

People

Artist: Joseph Woodson Whitesell, American 1876 - 1958

Date

c. 1930

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-14

Mammal 99.9
Horse 99.9
Animal 99.9
Person 98
Human 98
Person 98
Carriage 97.7
Transportation 97.7
Vehicle 97.7
Wagon 96.4
Wheel 96.1
Machine 96.1
Horse Cart 94.6
Person 92.4
Wheel 84.3
Person 74.9
Accessory 72.1
Sunglasses 72.1
Accessories 72.1

Imagga
created on 2022-01-14

horse cart 100
cart 100
carriage 89.2
wagon 79.5
horse 57
wheeled vehicle 45.9
animal 33
horses 27.3
vehicle 26.4
harness 23.2
farm 20.5
transportation 18.8
old 17.4
rural 15.9
riding 15.6
ride 15.5
equestrian 14.7
mammal 14.4
animals 13.9
saddle 13.8
transport 13.7
stallion 13.7
outdoors 13.4
grass 13.4
city 13.3
sport 13.2
wheel 12.3
historic 11.9
man 11.4
male 11.3
antique 11.3
street 11
brown 11
sky 10.8
jockey 10.8
outdoor 10.7
travel 10.6
people 10
bridle 9.9
cowboy 9.8
mane 9.8
ranch 9.8
head 9.2
field 9.2
competition 9.1
tourism 9.1
summer 9
rider 8.8
equine 8.8
western 8.7
dirt 8.6
historical 8.5
speed 8.2
countryside 8.2
tourist 8.2
history 8.1
country 7.9
wheels 7.8
black 7.8
driver 7.8
vintage 7.4
support 7.3
team 7.2
day 7.1
architecture 7
agriculture 7

Google
created on 2022-01-14

Microsoft
created on 2022-01-14

horse 100
outdoor 99.5
carriage 98.7
pulling 97.1
drawn 93.8
transport 90.7
text 90.5
animal 85
horse-drawn vehicle 82.3
cart 81.7
horse and buggy 77.2
horse harness 58.1
wagon 57.9
rein 57.3
pulled 53.7
horse tack 52.4
old 47.8
family 24.2

Face analysis

Amazon

Google

AWS Rekognition

Age 42-50
Gender Male, 99.9%
Calm 49%
Angry 35.2%
Sad 6.5%
Confused 2.3%
Surprised 2.1%
Disgusted 1.9%
Fear 1.6%
Happy 1.5%

AWS Rekognition

Age 45-51
Gender Female, 100%
Happy 95.1%
Calm 1.9%
Fear 0.6%
Sad 0.6%
Surprised 0.6%
Confused 0.5%
Disgusted 0.4%
Angry 0.3%

AWS Rekognition

Age 6-14
Gender Female, 60.8%
Calm 37.3%
Sad 30.2%
Angry 20.6%
Happy 2.9%
Fear 2.8%
Confused 2.3%
Surprised 2.1%
Disgusted 1.7%

AWS Rekognition

Age 21-29
Gender Male, 97.2%
Happy 87.6%
Sad 7.8%
Calm 1.4%
Confused 0.7%
Disgusted 0.7%
Surprised 0.7%
Angry 0.6%
Fear 0.4%

AWS Rekognition

Age 23-31
Gender Male, 96%
Calm 39.4%
Angry 32.5%
Surprised 7%
Sad 6.7%
Happy 5.4%
Fear 5%
Confused 2.5%
Disgusted 1.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Horse 99.9%
Person 98%
Wheel 96.1%
Sunglasses 72.1%

Captions

Microsoft

a man riding a horse drawn carriage 96.3%
a man riding a horse drawn carriage in front of a building 93.1%
a man riding on the back of a horse drawn carriage 93%

Text analysis

Amazon

Whitesell
Whitesell h.o.
Harse
h.o.
and Buggy
Harse and Buggy than
than

Google

Harse and Bauggy hays hitesell .o.
and
Harse
Bauggy
hitesell
hays
.o.