Human Generated Data

Title

Perils of the Sea

Date

1888

People

Artist: Winslow Homer, American 1836 - 1910

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Paul J. Sachs, M10128

Human Generated Data

Title

Perils of the Sea

People

Artist: Winslow Homer, American 1836 - 1910

Date

1888

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2022-03-04

Human 99
Person 99
Person 98.5
Art 96.2
Painting 91.5
Drawing 88.3
Person 77.6
Sketch 76.6
Person 68
Person 66.8
People 61.3
Person 52.5

Imagga
created on 2022-03-04

hay 100
fodder 80.3
feed 60.6
sky 33.6
landscape 29.8
food 25.5
field 25.1
sunset 20.7
rural 20.3
outdoor 19.9
travel 19.7
rustic 19.7
summer 19.3
man 18.2
grass 17.4
people 17.3
outdoors 17.3
silhouette 16.6
beach 15.4
male 14.2
water 14
farm 13.4
sea 13.3
vacation 13.1
sun 12.9
scenery 12.6
horizon 12.6
mountain 12.5
ocean 12.4
person 12.3
agriculture 12.3
countryside 11.9
clouds 11.8
hill 11.2
meadow 10.8
thresher 10.7
sand 10.6
country 10.5
harvest 10.3
lake 10.1
natural 10
environment 9.9
old 9.8
farm machine 9.6
scene 9.5
cloud 9.5
outside 9.4
sunrise 9.4
wheat 9.4
tree 9.3
tourism 9.1
machine 8.9
scenic 8.8
rock 8.7
sitting 8.6
fisherman 8.4
park 8.4
boat 8.4
leisure 8.3
island 8.2
work 8.2
history 8.1
straw 7.7
dusk 7.6
farming 7.6
cloudy 7.5
desert 7.5
evening 7.5
shore 7.4
relaxing 7.3
holiday 7.2
day 7.1

Google
created on 2022-03-04

Microsoft
created on 2022-03-04

text 98.4
drawing 97.1
outdoor 96.4
painting 92.6
sketch 89.2
man 62.6
person 51.6
picture frame 15.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 21-29
Gender Male, 84.1%
Calm 95.2%
Fear 3.6%
Confused 0.4%
Surprised 0.2%
Happy 0.2%
Sad 0.2%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 16-22
Gender Female, 98.3%
Calm 99.2%
Sad 0.2%
Confused 0.2%
Happy 0.1%
Angry 0.1%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 27
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Painting 91.5%

Captions

Microsoft

a vintage photo of a man riding a horse in the water 57.1%
a vintage photo of a man 57%
a vintage photo of a man riding a horse 56.9%

Text analysis

Amazon

Homer
Homer F
trinston
F

Google

Hom r . A
.
A
Hom
r