Human Generated Data

Title

Horse and Buggy Days

Date

c. 1930

People

Artist: Joseph Woodson Whitesell, American 1876 - 1958

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.1701

Human Generated Data

Title

Horse and Buggy Days

People

Artist: Joseph Woodson Whitesell, American 1876 - 1958

Date

c. 1930

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.1701

Machine Generated Data

Tags

Amazon
created on 2022-01-14

Animal 99.9
Mammal 99.9
Horse 99.9
Human 98
Person 98
Person 98
Carriage 97.7
Transportation 97.7
Vehicle 97.7
Wagon 96.4
Wheel 96.1
Machine 96.1
Horse Cart 94.6
Person 92.4
Wheel 84.3
Person 74.9
Sunglasses 72.1
Accessory 72.1
Accessories 72.1

Clarifai
created on 2023-10-26

people 99.9
cavalry 99.8
transportation system 99.3
two 99.3
carriage 99.2
cart 98.9
wagon 98.7
vehicle 98.3
mammal 97.1
adult 96.8
seated 95.9
man 95.1
group 94.8
driver 93.6
group together 92.1
three 90.1
one 89.4
war 88.2
soldier 87.7
military 87

Imagga
created on 2022-01-14

horse cart 100
cart 100
carriage 89.2
wagon 79.5
horse 57
wheeled vehicle 45.9
animal 33
horses 27.3
vehicle 26.4
harness 23.2
farm 20.5
transportation 18.8
old 17.4
rural 15.9
riding 15.6
ride 15.5
equestrian 14.7
mammal 14.4
animals 13.9
saddle 13.8
transport 13.7
stallion 13.7
outdoors 13.4
grass 13.4
city 13.3
sport 13.2
wheel 12.3
historic 11.9
man 11.4
male 11.3
antique 11.3
street 11
brown 11
sky 10.8
jockey 10.8
outdoor 10.7
travel 10.6
people 10
bridle 9.9
cowboy 9.8
mane 9.8
ranch 9.8
head 9.2
field 9.2
competition 9.1
tourism 9.1
summer 9
rider 8.8
equine 8.8
western 8.7
dirt 8.6
historical 8.5
speed 8.2
countryside 8.2
tourist 8.2
history 8.1
country 7.9
wheels 7.8
black 7.8
driver 7.8
vintage 7.4
support 7.3
team 7.2
day 7.1
architecture 7
agriculture 7

Google
created on 2022-01-14

Microsoft
created on 2022-01-14

horse 100
outdoor 99.5
carriage 98.7
pulling 97.1
drawn 93.8
transport 90.7
text 90.5
animal 85
horse-drawn vehicle 82.3
cart 81.7
horse and buggy 77.2
horse harness 58.1
wagon 57.9
rein 57.3
pulled 53.7
horse tack 52.4
old 47.8
family 24.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 42-50
Gender Male, 99.9%
Calm 49%
Angry 35.2%
Sad 6.5%
Confused 2.3%
Surprised 2.1%
Disgusted 1.9%
Fear 1.6%
Happy 1.5%

AWS Rekognition

Age 45-51
Gender Female, 100%
Happy 95.1%
Calm 1.9%
Fear 0.6%
Sad 0.6%
Surprised 0.6%
Confused 0.5%
Disgusted 0.4%
Angry 0.3%

AWS Rekognition

Age 6-14
Gender Female, 60.8%
Calm 37.3%
Sad 30.2%
Angry 20.6%
Happy 2.9%
Fear 2.8%
Confused 2.3%
Surprised 2.1%
Disgusted 1.7%

AWS Rekognition

Age 21-29
Gender Male, 97.2%
Happy 87.6%
Sad 7.8%
Calm 1.4%
Confused 0.7%
Disgusted 0.7%
Surprised 0.7%
Angry 0.6%
Fear 0.4%

AWS Rekognition

Age 23-31
Gender Male, 96%
Calm 39.4%
Angry 32.5%
Surprised 7%
Sad 6.7%
Happy 5.4%
Fear 5%
Confused 2.5%
Disgusted 1.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Horse 99.9%
Person 98%
Wheel 96.1%
Sunglasses 72.1%

Categories

Text analysis

Amazon

Whitesell
Whitesell h.o.
Harse
h.o.
and Buggy
Harse and Buggy than
than

Google

Harse
and
Harse and Bauggy hays hitesell .o.
Bauggy
hays
hitesell
.o.