Human Generated Data

Title

Costumes of Michaelenses, Azores, Portugal (three men standing, ox harnessed to cart)
Date

c. 1880-c. 1889
People

Artist: A.J. Rapozo, Portuguese active mid- to late-19th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1985.29.12

Human Generated Data

Title

Costumes of Michaelenses, Azores, Portugal (three men standing, ox harnessed to cart)

People

Artist: A.J. Rapozo, Portuguese active mid- to late-19th century

Date

c. 1880-c. 1889

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Wheel 99.7
Machine 99.7
Person 99.2
Human 99.2
Bull 97.7
Animal 97.7
Mammal 97.7
Person 95.5
Cattle 94.5
Cow 94.5
Wheel 93.6
Transportation 84
Vehicle 84
Horse 80.5
Ox 80.2
Tire 64.5
Wagon 57.9
Horse 56.7
Spoke 55.8
Buggy 55.8

Imagga
created on 2022-02-25

cart 100
horse cart 100
wagon 95.2
wheeled vehicle 55.8
carriage 45.3
cattle 44
horse 39.9
farm 36.6
vehicle 31.1
rural 30
ox 28.1
cow 25.3
grass 22.9
oxcart 22.1
agriculture 21.1
bovine 19.2
bull 18.5
animals 17.6
brown 16.9
field 15.9
ranch 15.8
horses 15.6
countryside 15.5
old 15.3
transportation 15.3
farming 14.2
sky 14
pasture 12.5
wheel 12.3
outdoor 12.2
landscape 11.9
cows 11.8
herd 11.8
country 11.4
antique 11.3
dairy 10.8
wheels 10.8
black 10.2
transport 10.1
livestock 9.9
outdoors 9.7
ride 9.7
dirt 9.6
meadow 9
fence 8.7
travel 8.5
head 8.4
summer 8.4
color 8.4
vintage 8.3
historic 8.3
history 8.1
grazing 7.9
hay 7.8
riding 7.8
scene 7.8
harness 7.7
village 7.7
tree 7.7
historical 7.5
tourism 7.4
trees 7.1
day 7.1

Google
created on 2022-02-25

Wheel 97.9
Vehicle 88.8
Working animal 87.2
Cart 84.5
Tire 82.5
Carriage 81.9
Motor vehicle 80.6
Horse supplies 79
Pack animal 77.5
Horse tack 73.9
Art 71.3
Rein 70.3
Wagon 69.6
Livestock 66.8
Horse and buggy 64
Visual arts 64
Stock photography 62.5
Horse harness 58.4
Illustration 57.4
Rectangle 56.2

Microsoft
created on 2022-02-25

text 99.3
horse 97.8
outdoor 93.7
old 83.9
land vehicle 72.1
vehicle 68.5
animal 66.6
wheel 62.6
drawn 60.5
carriage 54.9
cart 50.5
horse and buggy 50.2
pulling 50.1

Face analysis

Amazon

Google

AWS Rekognition

Age 33-41
Gender Male, 99.9%
Calm 92.6%
Disgusted 1.7%
Confused 1.6%
Happy 1.1%
Surprised 0.9%
Angry 0.8%
Fear 0.8%
Sad 0.5%

AWS Rekognition

Age 22-30
Gender Male, 99.8%
Sad 77.8%
Calm 11.7%
Confused 8.3%
Angry 1.7%
Fear 0.2%
Surprised 0.1%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 16-24
Gender Female, 67.7%
Calm 62.8%
Sad 32.6%
Fear 2.2%
Angry 0.8%
Disgusted 0.7%
Confused 0.3%
Happy 0.3%
Surprised 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Wheel 99.7%
Person 99.2%
Cow 94.5%
Horse 80.5%

Captions

Microsoft

an old photo of a horse drawn carriage 95.5%
an old photo of a man riding a horse drawn carriage 89.9%
a man riding a horse drawn carriage 89.8%