Human Generated Data

Title

Painting

Date

18th century

People

Artist: Joseph Wagner, Italian 1706 - 1780

Artist after: Jacopo Amigoni, Italian c. 1682 - 1752

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R8933

Human Generated Data

Title

Painting

People

Artist: Joseph Wagner, Italian 1706 - 1780

Artist after: Jacopo Amigoni, Italian c. 1682 - 1752

Date

18th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-06

Human 99.2
Person 99.2
Person 98.6
Person 97.2
Painting 96.5
Art 96.5
Person 93.8
Person 92.2

Clarifai
created on 2019-11-06

people 100
child 100
group 99.9
baby 99.9
son 99.8
family 98.8
offspring 98.8
four 97.3
five 97.2
several 97
sibling 96.8
art 96.8
furniture 96.6
adult 96.4
three 96.2
two 95.9
affection 95.2
sit 94.1
portrait 93.9
many 93.1

Imagga
created on 2019-11-06

kin 97.1
sibling 31
child 27.1
people 22.3
father 21.2
man 20.8
portrait 20.7
dad 19.9
sexy 19.3
parent 19.3
face 19.2
love 17.4
happy 16.9
hair 16.6
attractive 16.1
family 16
body 16
model 15.6
male 15.1
lifestyle 14.5
adult 14.2
happiness 14.1
pretty 14
lady 13.8
fashion 13.6
one 13.4
cute 12.9
person 12.8
mother 12.4
smile 12.1
fun 12
home 12
baby 11.5
world 10.7
statue 10.5
women 10.3
culture 10.3
skin 10.2
religion 9.9
daughter 9.8
old 9.8
cheerful 9.8
couch 9.7
sofa 9.6
smiling 9.4
expression 9.4
two 9.3
girls 9.1
vintage 9.1
childhood 9
sculpture 8.7
brunette 8.7
couple 8.7
ancient 8.6
eyes 8.6
lying 8.5
blond 8.1
looking 8
together 7.9
art 7.9
boy 7.8
antique 7.8
nude 7.8
men 7.7
casual 7.6
erotic 7.6
head 7.6
historical 7.5
rest 7.4
close 7.4
emotion 7.4
decoration 7.3
relaxing 7.3
gorgeous 7.2
dress 7.2
black 7.2
currency 7.2
life 7.2

Google
created on 2019-11-06

Microsoft
created on 2019-11-06

baby 98.8
text 95.4
toddler 95.2
human face 93.3
person 88.7
child 79.4
posing 73.8
clothing 71.2
old 50

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-4
Gender Female, 95.2%
Confused 0%
Sad 0.1%
Disgusted 0%
Happy 20.9%
Fear 0%
Angry 0%
Calm 79%
Surprised 0%

AWS Rekognition

Age 1-5
Gender Female, 85.9%
Fear 0%
Disgusted 0%
Confused 0%
Angry 0%
Calm 97.8%
Happy 0.3%
Surprised 0%
Sad 1.8%

AWS Rekognition

Age 1-5
Gender Female, 53.4%
Calm 96.2%
Angry 0.3%
Fear 0.1%
Happy 0.7%
Disgusted 0.2%
Sad 1.6%
Surprised 0.7%
Confused 0.3%

AWS Rekognition

Age 0-3
Gender Female, 65.5%
Happy 0%
Disgusted 0%
Angry 0%
Sad 0.4%
Fear 0%
Calm 99.5%
Surprised 0%
Confused 0%

AWS Rekognition

Age 4-12
Gender Male, 95.7%
Calm 98.6%
Angry 0%
Fear 0%
Sad 1.1%
Disgusted 0.1%
Happy 0.1%
Surprised 0%
Confused 0%

AWS Rekognition

Age 23-37
Gender Male, 52.9%
Confused 45%
Sad 53.8%
Angry 45.1%
Surprised 45%
Disgusted 45%
Happy 45.3%
Calm 45.6%
Fear 45.2%

Microsoft Cognitive Services

Age 1
Gender Male

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 4
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Painting 96.5%

Captions

Microsoft

a group of teddy bears posing for a photo 67.1%
a vintage photo of a group of stuffed animals 66.6%
a vintage photo of a teddy bear posing for the camera 56%

Text analysis

Amazon

Lungae
da
Che
anni,
fuoi
La
tener
a
guunga,
siapetta.
baone
Che nion ominciar da fuoi tener anni,
Jermin
ominciar
mai
Lungae rtere La filaal, safipretta.
rtere
in Mar
Appmnbo.
nion
Che a baone Jermin mai i siapetta. aiyner in Mar Ancan
safipretta.
Ancan
filaal,
aiyner
i

Google

aliaalinpretta
nen
anne
bucn
n
van
hi
cominca
Che
Lunga'
a
quunga,
nehi
Lunga' Arte aliaalinpretta hi nen cominca da fuer tener anne Che a bucn Sermen mau quunga, n van spella e 1 er in Me nehi
fuer
spella
1
Arte
da
tener
Sermen
mau
e
er
in
Me