Human Generated Data

Title

Costumes of Michaelenses, Azores, Portugal (four figures with two donkeys carrying a large barrel)

Date

c. 1880-c. 1889

People

Artist: A.J. Rapozo, Portuguese active mid- to late-19th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1985.29.2

Human Generated Data

Title

Costumes of Michaelenses, Azores, Portugal (four figures with two donkeys carrying a large barrel)

People

Artist: A.J. Rapozo, Portuguese active mid- to late-19th century

Date

c. 1880-c. 1889

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Animal 99.4
Mammal 99.4
Horse 99.4
Horse 99.4
Bull 92.2
Person 87.8
Human 87.8
Vehicle 86.3
Horse Cart 86.3
Transportation 86.3
Wagon 86.3
Person 83.3
Person 78
Ox 71.6
Cattle 71.6
Horse 71.4
Person 68.7

Imagga
created on 2022-02-25

horse cart 100
cart 88.5
wagon 69.8
horse 69.8
carriage 45.3
wheeled vehicle 43.7
horses 39.9
animal 36.5
ride 22.3
vehicle 21.6
riding 20.5
farm 19.6
cowboy 18.2
saddle 18
jockey 17.7
equestrian 17.6
harness 17.3
animals 16.7
stallion 16.6
mammal 16.1
equine 15.7
brown 15.4
outdoors 14.9
sport 14.8
rider 14.7
travel 13.4
people 12.8
speed 11.9
competition 11.9
western 11.6
ranch 11.1
bridle 11
horseback 10.8
silhouette 10.8
tourism 10.7
country 10.5
outdoor 9.9
mare 9.8
rural 9.7
landscape 9.7
sun 9.7
running 9.6
wild 9.6
tourist 9.1
black 9
sunset 9
transportation 9
sky 8.9
mane 8.8
man 8.7
sand 8.7
grass 8.7
summer 8.4
active 8.1
team 8.1
support 8.1
male 7.8
mammals 7.8
pasture 7.7
race 7.6
journey 7.5
vacation 7.4
historic 7.3
history 7.2
architecture 7

Google
created on 2022-02-25

Microsoft
created on 2022-02-25

text 99.7
horse 99.6
animal 95.1
old 91.2
person 86.4
outdoor 85.4
black 67.1
cart 64.8
white 64.2
rein 63.5
mule 59.2
halter 58.5
bridle 56.1
horse supplies 51.3
horse tack 50.7
clothing 50
vintage 28.6

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Male, 99.7%
Calm 79.2%
Confused 11.1%
Sad 3.2%
Fear 1.7%
Angry 1.4%
Surprised 1.3%
Disgusted 1.3%
Happy 0.8%

AWS Rekognition

Age 23-31
Gender Male, 99.5%
Angry 26.5%
Calm 17.6%
Sad 14.6%
Surprised 12%
Disgusted 12%
Confused 11.4%
Fear 3.8%
Happy 2%

AWS Rekognition

Age 23-31
Gender Male, 95.9%
Sad 52.5%
Calm 27.3%
Fear 8.1%
Angry 4.1%
Happy 2.6%
Surprised 2.5%
Disgusted 1.8%
Confused 1.3%

AWS Rekognition

Age 42-50
Gender Male, 99.9%
Confused 99.4%
Sad 0.2%
Angry 0.2%
Calm 0.1%
Disgusted 0%
Surprised 0%
Fear 0%
Happy 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Horse 99.4%
Person 87.8%

Captions

Microsoft

a vintage photo of a man riding a horse 79.6%
a vintage photo of a man on a horse 79.5%
a vintage photo of a man riding a horse next to a book 58.3%