Human Generated Data

Title

The Three Apostles
Date

18th-19th century
People

Artist: Johann Friedrich Bause, German 1738 - 1814

Artist after: Michelangelo Merisi da Caravaggio, Italian 1571 - 1610
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R3335

Human Generated Data

Title

The Three Apostles

People

Artist: Johann Friedrich Bause, German 1738 - 1814

Artist after: Michelangelo Merisi da Caravaggio, Italian 1571 - 1610

Date

18th-19th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Human 99.7
Person 99.7
Person 98.5
Person 97.7
Face 88.7
Text 84.5
Drawing 79.5
Art 79.5
Photography 69.3
Photo 69.3
Portrait 66.4
Smoke 66.2
Smoke Pipe 60.6
Smoking 58

Imagga
created on 2022-02-25

newspaper 56
product 42.5
creation 35
man 29.6
male 28.4
people 25.1
person 24.1
portrait 22.6
office 22.5
one 21.6
business 21.3
adult 20.1
face 19.2
old 18.1
businessman 16.8
close 15.4
call 15.1
senior 15
black 14.4
money 13.6
looking 13.6
human 13.5
daily 13.2
vintage 13.2
serious 12.4
happy 11.9
hair 11.9
head 11.8
currency 11.7
working 11.5
finance 11
envelope 10.2
dollar 10.2
world 10.2
cash 10.1
gray 9.9
postmark 9.8
shows 9.8
printed 9.8
stamp 9.7
beard 9.6
computer 9.6
mail 9.6
bill 9.5
painter 9.5
professional 9.5
phone 9.2
banking 9.2
letter 9.2
suit 9
wind instrument 8.9
handsome 8.9
financial 8.9
postage 8.8
postal 8.8
home 8.8
look 8.8
smiling 8.7
happiness 8.6
elderly 8.6
corporate 8.6
men 8.6
desk 8.5
guy 8.5
laptop 8.2
confident 8.2
wealth 8.1
bank 8.1
masterpiece 7.9
known 7.9
work 7.8
smile 7.8
paintings 7.8
tired 7.8
harmonica 7.7
culture 7.7
painted 7.6
fine 7.6
tie 7.6
mature 7.4
closeup 7.4
symbol 7.4
device 7.4
alone 7.3
paper 7.1
indoors 7

Google
created on 2022-02-25

Gesture 85.3
Art 85.2
Font 75.2
Vintage clothing 73.5
Rectangle 68.9
Illustration 68.8
Visual arts 67.8
Painting 67.7
Room 63.3
Stock photography 63.2
Paper product 61.4
Paper 59.4
Collection 58.8
Portrait 57.6
Drawing 57.6
Moustache 57.5
Artwork 57
Beard 55.7
Monochrome 54.9
Photographic paper 52.7

Microsoft
created on 2022-02-25

human face 98.1
text 96.4
baby 96.3
person 95.3
gallery 85.2
child 84.6
clothing 84.3
toddler 83.7
old 81.1
room 79.8
scene 75
painting 67.7
smile 56.7
picture frame 6.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 37-45
Gender Male, 99.8%
Calm 97.2%
Surprised 1.7%
Fear 0.5%
Disgusted 0.3%
Angry 0.1%
Confused 0.1%
Sad 0.1%
Happy 0.1%

AWS Rekognition

Age 33-41
Gender Male, 78.4%
Calm 82.9%
Sad 16%
Fear 0.3%
Surprised 0.2%
Confused 0.2%
Disgusted 0.2%
Happy 0.1%
Angry 0.1%

AWS Rekognition

Age 43-51
Gender Male, 98.2%
Calm 51.6%
Sad 22.2%
Happy 9.6%
Angry 8%
Fear 3.6%
Surprised 1.9%
Disgusted 1.7%
Confused 1.5%

Microsoft Cognitive Services

Age 41
Gender Male

Google Vision

Surprise Unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

an old photo of a person 78.6%
an old photo of a person 72.3%
old photo of a person 72.2%

Text analysis

Amazon

Die
Doctor
Leipzig
in
Prater
Herrn
Dem
for
Apostel.
-
Dem Herrn Doctor Cart Withelm Müller Prater in Leipzig quoidmet
Müller
Withelm
Cart
Die drey Cafe Apostel.
Das
dorch
Night
ist
drey
done
Cafe
бод
quoidmet
JF Book for offer G in
مؤون Night in
G
Das Import Jomishide ist من done
de
JF Book
offer
dorch 417 Duner
Duner
de Hore Gulep Wincelor - Lippy
من
Import
Wincelor
1
Viefafter
Gulep
Jomishide
With 1 Total
de Crospine
With
Total
417
Lippy
Hore
مؤون

Google

Dem
duk
Die drei Upestel. Dem Herrn Dretor Cart Withdm Miller, Preter in Lepzig guridmet Shener duk
drei
Withdm
guridmet
Dretor
in
Lepzig
Die
Upestel.
Cart
Preter
Shener
Herrn
Miller,