Human Generated Data

Title

The Birth of Jacob and Esau

Date

1812

People

Artist: Conte Carlo Lasinio, Italian 1759 - 1838

Artist after: Benozzo Gozzoli, Italian 1420 - 1497

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G2168

Human Generated Data

Title

The Birth of Jacob and Esau

People

Artist: Conte Carlo Lasinio, Italian 1759 - 1838

Artist after: Benozzo Gozzoli, Italian 1420 - 1497

Date

1812

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-07

Human 99.2
Person 99.2
Person 98.7
Person 97.1
Art 95.3
Person 94.9
Person 94.8
Person 94.2
Painting 92.2
Person 90.5
Person 87
Person 86.9
Person 86.7
Person 85.4
Person 73
Person 70.4
Person 69.9
Drawing 67.2
Person 62.8
Person 62
Sketch 55.2

Clarifai
created on 2019-11-07

people 97.3
art 96.7
man 95.7
illustration 94.6
architecture 93
print 92.5
old 92.2
engraving 92.1
antique 90.5
building 90.1
sculpture 89
vintage 88.7
group 88
ancient 87.7
paper 87.2
many 83.8
adult 83.8
monument 81.9
administration 81.3
culture 81.1

Imagga
created on 2019-11-07

sketch 100
drawing 94.9
representation 68.4
architecture 38.3
building 30.5
old 25.1
vintage 24.8
landmark 22.6
history 22.4
art 22.1
ancient 19.9
structure 19.1
antique 18.8
stucco 18.3
sculpture 18.2
travel 17.6
city 17.5
palace 17.2
historic 16.5
facade 16.3
grunge 16.2
tourism 15.7
culture 15.4
monument 14.9
paper 14.9
style 14.8
statue 14.3
famous 14
retro 13.9
marble 13.9
column 13.8
treasury 13.5
design 13.5
religion 13.4
ornate 12.8
house 12.7
texture 11.8
stone 11.8
frame 11.7
depository 11.3
historical 11.3
decoration 10.9
sky 10.8
tower 10.7
church 10.2
baroque 9.8
facility 9.7
urban 9.6
cathedral 9.6
wall 9.5
exterior 9.2
pattern 8.9
royal 8.7
scene 8.7
old fashioned 8.6
construction 8.6
capital 8.5
business 8.5
element 8.3
gold 8.2
tourist 8.2
aged 8.1
border 8.1
currency 8.1
artistic 7.8
money 7.7
finance 7.6
traditional 7.5
rich 7.4
classic 7.4
symbol 7.4
arch 7.4
water 7.3
roman 7.1

Google
created on 2019-11-07

Microsoft
created on 2019-11-07

text 99.5
person 92.4
drawing 90.3
sketch 85.5
clothing 82.7
old 82.4
vintage 25.4

Face analysis

Amazon

AWS Rekognition

Age 19-31
Gender Male, 50.3%
Fear 49.5%
Sad 49.8%
Disgusted 49.7%
Surprised 49.5%
Angry 49.7%
Happy 49.5%
Confused 49.6%
Calm 49.6%

AWS Rekognition

Age 12-22
Gender Female, 50.3%
Happy 49.5%
Calm 50.2%
Disgusted 49.5%
Surprised 49.5%
Angry 49.5%
Confused 49.5%
Fear 49.6%
Sad 49.7%

AWS Rekognition

Age 10-20
Gender Female, 50.2%
Fear 49.5%
Disgusted 49.5%
Surprised 49.5%
Calm 50.4%
Angry 49.5%
Sad 49.6%
Confused 49.5%
Happy 49.5%

AWS Rekognition

Age 15-27
Gender Male, 50%
Surprised 49.5%
Fear 49.5%
Disgusted 49.5%
Angry 49.5%
Confused 49.6%
Sad 50.1%
Happy 49.5%
Calm 49.8%

AWS Rekognition

Age 25-39
Gender Male, 50.4%
Disgusted 49.5%
Surprised 49.5%
Angry 49.6%
Happy 49.5%
Calm 50.3%
Fear 49.5%
Sad 49.5%
Confused 49.5%

AWS Rekognition

Age 19-31
Gender Female, 50.1%
Fear 50.1%
Disgusted 49.5%
Calm 49.5%
Surprised 49.8%
Sad 49.5%
Confused 49.6%
Angry 49.5%
Happy 49.5%

AWS Rekognition

Age 51-69
Gender Female, 50.1%
Fear 49.5%
Sad 50.3%
Surprised 49.5%
Calm 49.6%
Happy 49.5%
Disgusted 49.5%
Confused 49.5%
Angry 49.5%

AWS Rekognition

Age 4-14
Gender Female, 50.1%
Fear 49.6%
Confused 49.6%
Calm 49.7%
Sad 49.8%
Happy 49.5%
Surprised 49.5%
Disgusted 49.7%
Angry 49.6%

AWS Rekognition

Age 15-27
Gender Female, 50.3%
Angry 50.5%
Surprised 49.5%
Calm 49.5%
Happy 49.5%
Disgusted 49.5%
Fear 49.5%
Sad 49.5%
Confused 49.5%

AWS Rekognition

Age 10-20
Gender Female, 50.2%
Surprised 49.5%
Fear 49.5%
Sad 49.7%
Calm 49.9%
Confused 49.6%
Angry 49.7%
Happy 49.5%
Disgusted 49.5%

AWS Rekognition

Age 33-49
Gender Male, 50%
Surprised 49.6%
Happy 50.1%
Angry 49.5%
Calm 49.5%
Fear 49.6%
Disgusted 49.5%
Sad 49.6%
Confused 49.5%

AWS Rekognition

Age 16-28
Gender Female, 50.1%
Happy 49.5%
Angry 50.5%
Calm 49.5%
Surprised 49.5%
Fear 49.5%
Confused 49.5%
Sad 49.5%
Disgusted 49.5%

AWS Rekognition

Age 10-20
Gender Female, 50%
Fear 49.6%
Disgusted 49.5%
Calm 49.5%
Surprised 49.5%
Sad 49.5%
Confused 49.5%
Angry 50.3%
Happy 49.5%

AWS Rekognition

Age 23-35
Gender Female, 50.4%
Sad 49.5%
Disgusted 49.5%
Surprised 49.6%
Confused 49.5%
Angry 49.5%
Fear 49.5%
Calm 50.4%
Happy 49.5%

AWS Rekognition

Age 14-26
Gender Male, 50%
Confused 49.5%
Calm 50.3%
Sad 49.5%
Fear 49.5%
Disgusted 49.5%
Happy 49.5%
Angry 49.6%
Surprised 49.5%

AWS Rekognition

Age 4-12
Gender Female, 50.1%
Angry 49.5%
Calm 50.4%
Sad 49.5%
Fear 49.5%
Disgusted 49.5%
Confused 49.5%
Happy 49.5%
Surprised 49.5%

AWS Rekognition

Age 19-31
Gender Male, 50.4%
Angry 49.5%
Surprised 49.8%
Disgusted 49.6%
Sad 49.5%
Calm 50%
Happy 49.5%
Confused 49.5%
Fear 49.6%

AWS Rekognition

Age 28-44
Gender Female, 50.1%
Surprised 49.5%
Fear 49.5%
Disgusted 49.5%
Angry 50%
Confused 49.5%
Sad 49.5%
Happy 49.5%
Calm 49.9%

AWS Rekognition

Age 3-9
Gender Female, 50.3%
Angry 49.5%
Fear 50.3%
Surprised 49.6%
Disgusted 49.5%
Calm 49.6%
Sad 49.5%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 34-50
Gender Male, 50.3%
Fear 49.6%
Happy 49.5%
Calm 50%
Confused 49.5%
Angry 49.5%
Disgusted 49.6%
Surprised 49.5%
Sad 49.6%

AWS Rekognition

Age 13-25
Gender Male, 50.1%
Angry 49.6%
Happy 49.5%
Confused 49.5%
Sad 49.5%
Calm 49.6%
Fear 49.5%
Disgusted 50.3%
Surprised 49.5%

AWS Rekognition

Age 38-56
Gender Male, 50.1%
Happy 49.7%
Calm 49.6%
Sad 49.6%
Surprised 49.5%
Angry 50%
Fear 49.5%
Confused 49.5%
Disgusted 49.5%

AWS Rekognition

Age 24-38
Gender Male, 50.2%
Angry 49.6%
Disgusted 49.6%
Surprised 49.5%
Happy 49.5%
Fear 49.5%
Sad 50.2%
Confused 49.5%
Calm 49.6%

AWS Rekognition

Age 32-48
Gender Female, 50.2%
Calm 49.5%
Surprised 49.5%
Angry 50.4%
Sad 49.5%
Disgusted 49.5%
Happy 49.5%
Fear 49.5%
Confused 49.5%

AWS Rekognition

Age 25-39
Gender Male, 50.5%
Surprised 49.5%
Disgusted 49.5%
Fear 49.8%
Confused 49.5%
Sad 49.7%
Calm 49.5%
Happy 49.5%
Angry 49.9%

AWS Rekognition

Age 5-15
Gender Female, 50.1%
Confused 49.5%
Fear 50.1%
Surprised 49.5%
Disgusted 49.5%
Happy 49.6%
Angry 49.6%
Sad 49.6%
Calm 49.6%

AWS Rekognition

Age 15-27
Gender Male, 50.1%
Angry 50.4%
Confused 49.5%
Sad 49.5%
Disgusted 49.5%
Happy 49.5%
Fear 49.5%
Calm 49.5%
Surprised 49.5%

AWS Rekognition

Age 52-70
Gender Male, 50.3%
Surprised 49.5%
Fear 49.5%
Confused 49.5%
Sad 49.5%
Disgusted 49.5%
Happy 49.5%
Angry 49.5%
Calm 50.5%

AWS Rekognition

Age 13-23
Gender Female, 50.1%
Calm 49.5%
Disgusted 49.5%
Happy 49.5%
Sad 50.2%
Confused 49.5%
Angry 49.5%
Fear 49.7%
Surprised 49.5%

AWS Rekognition

Age 23-35
Gender Male, 50.2%
Disgusted 49.5%
Sad 49.5%
Fear 49.6%
Calm 49.7%
Surprised 49.6%
Happy 50%
Confused 49.5%
Angry 49.5%

AWS Rekognition

Age 23-37
Gender Female, 50.3%
Surprised 49.5%
Angry 50.5%
Confused 49.5%
Happy 49.5%
Calm 49.5%
Fear 49.5%
Sad 49.5%
Disgusted 49.5%

AWS Rekognition

Age 19-31
Gender Male, 50.1%
Happy 49.5%
Angry 49.5%
Disgusted 49.5%
Confused 49.5%
Surprised 49.5%
Fear 49.5%
Calm 50.5%
Sad 49.5%

AWS Rekognition

Age 10-20
Gender Male, 50.1%
Calm 50.3%
Surprised 49.5%
Confused 49.5%
Happy 49.5%
Disgusted 49.5%
Fear 49.5%
Sad 49.5%
Angry 49.6%

Feature analysis

Amazon

Person 99.2%
Painting 92.2%

Captions

Microsoft

a vintage photo of some people 75.9%
a vintage photo of a person 75.7%
a vintage photo of a group of people in a room 75.6%

Text analysis

Amazon

DE
DI
NAISSANCE
JACOB.
ET
D
GIACOBBE.E
NASCITA DI GIACOBBE.E DI ESAI LA NAISSANCE DE JACOB. ET D ESAI)
LA
NASCITA
icrentina
:
(
"
ESAI
ea
ESAI)
shy
Ccrtem
landami
dell
lame
imt
larnate
A mntifinr shy " lame sbullpamw ( larnate imt AML landami
sbullpamw
girik icrentina dell tovmn Ccrtem R: R&io
mntifinr
girik
tovmn
R&io
AML
AVROooN
R:
it
A

Google

EDI
DE
JACOB,
D
NASCITA DI GIACOBBE EDI ESAU) (LA NAISSANCE DE JACOB, ET D ESAU)
NAISSANCE
ESAU)
NASCITA
ET
DI
GIACOBBE
(LA