Human Generated Data

Title

The Brothers Pixis

Date

1800

People

Artist: Heinrich Sintzenich, German 1752 - 1812

Artist after: Johann Heinrich Schröder, German 1757-1812

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R15125

Human Generated Data

Title

The Brothers Pixis

People

Artist: Heinrich Sintzenich, German 1752 - 1812

Artist after: Johann Heinrich Schröder, German 1757-1812

Date

1800

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Human 99.3
Person 99.3
Person 97.4
Art 78.8
Text 76.9
Leisure Activities 76.2
Painting 69
Photo 63.4
Portrait 63.4
Photography 63.4
Face 63.4
Drawing 59.4
Musical Instrument 57.4

Imagga
created on 2022-02-26

phonograph record 54.3
money 34
currency 33.2
dollar 28.7
cash 28.3
paper 23.5
finance 22.8
business 21.8
banking 21.1
bank 20.6
wealth 19.7
financial 19.6
bill 19
dollars 17.4
close 16.5
one 15.7
art 15.1
vintage 14.9
portrait 14.9
man 14.8
pay 14.4
savings 14
old 13.9
banknote 13.6
hundred 13.5
us 13.5
rich 13
franklin 12.8
finances 12.5
loan 12.4
economy 12
religion 11.6
exchange 11.4
closeup 11.4
stringed instrument 11.3
investment 11
symbol 10.8
payment 10.6
profit 10.5
success 10.4
person 10.4
male 10
bills 9.7
black 9.6
church 9.2
musical instrument 9
sign 9
president 8.8
funds 8.8
banknotes 8.8
face 8.5
adult 8.5
religious 8.4
radio telescope 8.3
note 8.3
style 8.1
people 7.8
antique 7.8
price 7.7
capital 7.6
commerce 7.5
gold 7.4
concepts 7.1
love 7.1
conceptual 7

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

text 99.9
book 99.3
person 98.1
human face 95.9
old 95.7
clothing 92.9
black 87.8
vintage 84.9
posing 80.8
woman 67.3
white 61.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 18-26
Gender Male, 96.7%
Calm 80.5%
Happy 12.5%
Confused 2%
Sad 1.9%
Angry 1.3%
Surprised 0.8%
Disgusted 0.6%
Fear 0.4%

AWS Rekognition

Age 12-20
Gender Male, 97.6%
Calm 79.4%
Sad 9.4%
Happy 3.4%
Confused 2.9%
Angry 2.3%
Fear 1%
Surprised 0.9%
Disgusted 0.8%

Microsoft Cognitive Services

Age 20
Gender Female

Microsoft Cognitive Services

Age 20
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Painting 69%

Captions

Microsoft

a vintage photo of a person holding a book 69.9%
a vintage photo of a person holding a book posing for the camera 66.1%
a vintage photo of a person holding a book 66%

Text analysis

Amazon

1860
Ferères
Browldwing Hef Mahlor 1860 Ferères Picis
Picis
Schoider
gomahlt
yeard
Hef Mahlor
Browldwing
Koreaz
backstand
griboka

Google

foreres es
foreres
es