Human Generated Data

Title

Arrival at the Inn

Date

19th-20th century

People

Artist: Augustus Vincent Tack, American 1870 - 1949

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.322

Human Generated Data

Title

Arrival at the Inn

People

Artist: Augustus Vincent Tack, American 1870 - 1949

Date

19th-20th century

Classification

Drawings

Machine Generated Data

Tags

Amazon
created on 2020-05-02

Human 99.1
Person 99.1
Person 97.6
Person 96
Nature 93.3
Outdoors 93.2
Painting 86.3
Art 86.3
Drawing 84
People 81
Countryside 80
Building 80
Rural 80
Shelter 80
Military Uniform 75.6
Military 75.6
Person 74.2
Sketch 69.5
Person 66.4
Armored 61.1
Army 61.1
Soldier 60.9
Housing 56.5

Clarifai
created on 2020-05-02

people 100
adult 98.9
art 98.4
man 98.1
child 97.7
group 97.4
print 96.3
two 96
military 95.2
street 95
home 93.7
painting 93.5
wear 92.7
woman 92.5
war 92.1
soldier 87.8
three 86.2
sepia 84.8
group together 84.4
one 82

Imagga
created on 2020-05-02

cell 27.1
building 23.1
man 21.5
old 18.8
snow 16.4
danger 14.6
person 13.6
dark 13.4
people 12.8
grunge 12.8
dirty 12.7
stone 12.7
black 12.6
architecture 12.6
city 12.5
world 12.4
vintage 11.6
antique 11.3
street 11
kin 10.9
destruction 10.8
mask 10.7
wall 10.3
protection 10
travel 9.9
prison 9.8
texture 9.7
male 9.5
house 9.2
history 8.9
child 8.9
nuclear 8.7
gas 8.7
ancient 8.7
crutch 8.4
smoke 8.4
outdoors 8.3
tourism 8.3
soldier 7.8
toxic 7.8
adult 7.8
chemical 7.7
explosion 7.7
weather 7.6
dangerous 7.6
walking 7.6
symbol 7.4
historic 7.3
industrial 7.3
landmark 7.2
sunset 7.2
art 7.2
portrait 7.1
correctional institution 7.1
sky 7

Google
created on 2020-05-02

Microsoft
created on 2020-05-02

drawing 99.2
sketch 98.3
text 97.9
painting 97
old 86.7
person 79.6
vintage 34.2

Face analysis

Amazon

Google

AWS Rekognition

Age 21-33
Gender Male, 54.9%
Surprised 45.9%
Disgusted 45.4%
Happy 45%
Calm 49.7%
Fear 46.8%
Angry 46.4%
Sad 45.5%
Confused 45.1%

AWS Rekognition

Age 26-42
Gender Male, 53.8%
Sad 46%
Fear 49.7%
Disgusted 45%
Angry 46.8%
Confused 45.1%
Surprised 46.8%
Happy 45.1%
Calm 45.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Painting 86.3%

Captions

Microsoft

a vintage photo of an old building 93.2%
a vintage photo of a person 91.6%
a vintage photo of some people that are standing in front of a building 82.9%