Human Generated Data

Title

The Last Supper

Date

1840

People

Artist: Friedrich Wagner, German 1803 - 1876

Artist after: Leonardo da Vinci, Italian 1452 - 1519

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R11924

Human Generated Data

Title

The Last Supper

People

Artist: Friedrich Wagner, German 1803 - 1876

Artist after: Leonardo da Vinci, Italian 1452 - 1519

Date

1840

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-06

Human 99.2
Person 99.2
Person 99.2
Person 98.4
Person 98.4
Person 98.2
Person 96.9
Person 96.1
Person 95
Person 94.4
Art 92.3
Painting 92.3
Person 90.8
People 77
Person 74.8
Clinic 64.1
Indoors 60.3
Room 60.3
Porch 59.7
Bed 56.3
Furniture 56.3

Clarifai
created on 2019-11-06

people 100
group 99.8
many 98.9
adult 98.8
group together 98.7
furniture 98.3
leader 96
administration 95.6
man 94.8
woman 94.7
several 93.9
seat 93.4
room 93.2
music 92.5
child 92.3
outfit 91.9
military 86.2
theater 85.7
wear 85.4
five 85.2

Imagga
created on 2019-11-06

marimba 33
percussion instrument 27.2
classroom 26.7
musical instrument 25.8
room 25.4
old 16.7
hospital 15.2
architecture 14
house 13.4
sculpture 13.2
people 12.8
person 12.7
man 12.1
outdoors 11.9
happy 11.9
women 11.9
child 11.5
male 11.3
adult 11.2
two 11
stone 11
bench 10.8
water 10.7
home 10.4
sitting 10.3
lifestyle 10.1
portrait 9.7
statue 9.5
love 9.5
day 9.4
outdoor 9.2
travel 9.1
city 9.1
sky 8.9
building 8.7
cheerful 8.1
lady 8.1
table 8
interior 8
couple 7.8
ancient 7.8
stringed instrument 7.7
park 7.7
art 7.5
leisure 7.5
vintage 7.4
vacation 7.4
girls 7.3
dress 7.2
structure 7.2
holiday 7.2
smile 7.1
face 7.1
summer 7.1

Google
created on 2019-11-06

Microsoft
created on 2019-11-06

wall 97.8
person 94.3
indoor 91.8
clothing 83.4
text 80.6
woman 62.4
fireplace 27.1

Face analysis

Amazon

AWS Rekognition

Age 14-26
Gender Female, 54.6%
Happy 45%
Angry 45%
Surprised 45%
Sad 45.1%
Confused 45%
Fear 45%
Calm 54.8%
Disgusted 45%

AWS Rekognition

Age 12-22
Gender Female, 50.2%
Sad 50.3%
Happy 49.5%
Fear 49.5%
Surprised 49.5%
Confused 49.5%
Disgusted 49.5%
Angry 49.5%
Calm 49.6%

AWS Rekognition

Age 24-38
Gender Male, 54.1%
Angry 45.5%
Calm 54%
Fear 45%
Surprised 45%
Disgusted 45.1%
Happy 45.1%
Confused 45%
Sad 45.2%

AWS Rekognition

Age 47-65
Gender Male, 54.9%
Angry 45%
Happy 45%
Disgusted 45%
Sad 45%
Confused 45%
Calm 55%
Surprised 45%
Fear 45%

AWS Rekognition

Age 47-65
Gender Male, 53.5%
Angry 54.9%
Fear 45%
Disgusted 45%
Calm 45%
Confused 45%
Happy 45%
Sad 45%
Surprised 45%

AWS Rekognition

Age 35-51
Gender Female, 50.1%
Happy 49.5%
Angry 49.6%
Fear 49.5%
Calm 50.2%
Sad 49.7%
Disgusted 49.5%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 36-52
Gender Male, 54.2%
Fear 45.1%
Angry 49.5%
Disgusted 45.5%
Calm 46.9%
Confused 45.2%
Surprised 45.2%
Happy 45.1%
Sad 47.5%

AWS Rekognition

Age 27-43
Gender Female, 50.2%
Disgusted 49.5%
Happy 49.5%
Fear 49.5%
Confused 49.5%
Calm 49.8%
Surprised 49.5%
Sad 50.2%
Angry 49.5%

AWS Rekognition

Age 22-34
Gender Female, 50.5%
Fear 50.3%
Sad 49.6%
Confused 49.5%
Surprised 49.5%
Disgusted 49.5%
Calm 49.5%
Angry 49.6%
Happy 49.5%

AWS Rekognition

Age 5-15
Gender Female, 54.9%
Disgusted 45%
Angry 45%
Calm 54.4%
Confused 45%
Surprised 45%
Happy 45%
Fear 45%
Sad 45.5%

AWS Rekognition

Age 34-50
Gender Male, 50.5%
Angry 49.5%
Happy 49.5%
Surprised 49.5%
Calm 50.4%
Fear 49.5%
Sad 49.5%
Confused 49.5%
Disgusted 49.5%

AWS Rekognition

Age 22-34
Gender Male, 50.3%
Fear 49.5%
Angry 49.5%
Confused 49.5%
Disgusted 49.5%
Surprised 49.5%
Sad 49.5%
Calm 50.5%
Happy 49.5%

Feature analysis

Amazon

Person 99.2%
Painting 92.3%

Captions

Microsoft

an old photo of a cage 55.4%
a group of people standing in front of a window 38.6%
a group of people sitting in front of a window 27.7%

Text analysis

Amazon

CIINA
INCI

Google

LACHN A ON ARDO DA YINCI
DA
LACHN
YINCI
A
ARDO
ON