Human Generated Data

Title

Costumes of Fayal Island, Azores, Portugal (team of oxen pulling cart, man in cart, man standing by ox on right)
Date

c. 1880-c. 1889
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1985.29.30

Human Generated Data

Title

Costumes of Fayal Island, Azores, Portugal (team of oxen pulling cart, man in cart, man standing by ox on right)

People

Artist: Unidentified Artist,

Date

c. 1880-c. 1889

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Mammal 99.9
Bull 99.9
Animal 99.9
Wheel 99.1
Machine 99.1
Human 98.2
Person 98.2
Ox 98.2
Cattle 98.2
Cow 81
Horse 72.1
Cow 61.1

Imagga
created on 2022-02-25

old 26.5
farm 21.4
vintage 20.7
grunge 19.6
ancient 19
cattle 17.6
cow 16.3
sand 15.4
retro 14.7
antique 14.7
texture 14.6
structure 14.5
rural 14.1
field 13.4
dairy 12.9
aged 12.7
livestock 12.5
country 12.3
paper 12
landscape 11.9
dirty 11.7
ranch 11.4
agriculture 11.4
animal 11.3
bull 11.1
grass 11.1
history 10.7
art 10.7
bill 10.5
old fashioned 10.5
horse 10.4
culture 10.2
stone 10.1
earth 10
outdoor 9.9
sunset 9.9
herd 9.8
outdoors 9.7
pasture 9.6
brown 9.6
dirt 9.5
mammal 9.5
sculpture 9.2
historic 9.2
soil 9
sun 8.9
horses 8.8
wild 8.7
grungy 8.5
farming 8.5
space 8.5
head 8.4
hay 8.3
cash 8.2
bank 8.2
meadow 8.1
decoration 8
black 7.8
male 7.8
sepia 7.8
travel 7.7
outside 7.7
money 7.7
sky 7.6
bovine 7.6
pen 7.6
grain 7.6
design 7.5
silhouette 7.4
letter 7.3
countryside 7.3
color 7.2
currency 7.2
face 7.1
architecture 7

Google
created on 2022-02-25

Working animal 88.7
Wheel 85.1
Art 82.5
Pack animal 73.8
Cart 71.3
Vintage clothing 69.8
Rectangle 68.9
Font 68.6
Visual arts 67.1
Carriage 63.6
Paper product 63.6
History 62.5
Landscape 62.2
Bovine 58.7
Livestock 58.2
Terrestrial animal 57.2
Wood 56.2
Room 54.8
Illustration 52.4

Microsoft
created on 2022-02-25

text 98.8
old 93
horse 88.4
animal 80.7
land vehicle 75.6
vehicle 70.4
cart 67.8
posing 54.8
cattle 53.2
mammal 52.2
vintage 41.1

Face analysis

Amazon

Google

AWS Rekognition

Age 21-29
Gender Male, 97.6%
Calm 99.1%
Surprised 0.2%
Angry 0.2%
Sad 0.2%
Confused 0.1%
Fear 0.1%
Disgusted 0.1%
Happy 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Wheel 99.1%
Person 98.2%
Cow 81%
Horse 72.1%

Captions

Microsoft

a vintage photo of a person holding a book 31.5%
a vintage photo of a book 31.4%
a vintage photo of a group of people posing for the camera 31.3%