Human Generated Data

Title

Helen Keller (1880-1968)
Date

1941
People

Artist: Augustus Vincent Tack, American 1870 - 1949
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.159

Human Generated Data

Title

Helen Keller (1880-1968)

People

Artist: Augustus Vincent Tack, American 1870 - 1949

Date

1941

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-02-09

Person 96.9
Human 96.9
Wood 96.4
Art 90.5
Painting 90.5
Plywood 90.4
Furniture 65.3

Clarifai
created on 2020-02-09

people 99
woman 98.9
portrait 97.9
adult 97.8
one 96.9
book series 95.2
wear 94.7
elderly 93.2
two 88.3
writer 84.3
man 84.2
indoors 82.6
business 81.7
science 80.2
administration 80.2
chair 80.1
theatre 79.4
furniture 78.6
sit 78.2
education 77.8

Imagga
created on 2020-02-09

person 39.4
grandma 39
man 33.6
senior 31.9
home 30.3
computer 30.1
male 29.1
people 27.3
adult 26.5
indoors 26.4
sitting 25.8
happy 25.7
smiling 25.3
office 24.3
laptop 24.2
mature 24.2
elderly 23
business 21.3
desk 20.8
working 20.3
lifestyle 20.2
portrait 19.4
retired 19.4
work 18.8
casual 18.6
old 18.1
couple 17.4
attractive 16.8
looking 16
retirement 15.4
smile 15
hair 14.3
professional 14.2
together 14
glasses 13.9
lady 13.8
interior 13.3
generator 13.2
teacher 13
planner 12.9
grandmother 12.7
technology 12.6
job 12.4
reading 12.4
worker 12.3
education 12.1
table 12.1
clothing 12
businesswoman 11.8
older 11.7
handsome 11.6
businessman 11.5
talking 11.4
room 11.3
color 11.1
blond 11
face 10.7
husband 10.6
writing 10.5
wife 10.4
corporate 10.3
men 10.3
indoor 10
suit 9.9
one 9.7
rustic 9.7
black 9.6
paper 9.5
women 9.5
active 9
human 9
citizen 8.9
middle aged 8.8
class 8.7
using 8.7
day 8.6
happiness 8.6
shirt 8.6
age 8.6
career 8.5
executive 8.5
two 8.5
modern 8.4
pretty 8.4
house 8.4
camera 8.3
phone 8.3
book 8.2
friendly 8.2
notebook 8.2
aged 8.1
bright 7.9
60s 7.8
sofa 7.7
living 7.6
adults 7.6
keyboard 7.5
holding 7.4
inside 7.4
cheerful 7.3
success 7.2
family 7.1
student 7.1
classroom 7.1
secretary 7

Google
created on 2020-02-09

Lady 90.4
Sitting 81.2
Portrait 73.9
Reading 60.3
Art 50.2

Microsoft
created on 2020-02-09

person 98.3
man 91.3
human face 87.5
clothing 79.5
text 72.7
painting 68.7
older 21

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 34-50
Gender Female, 98.5%
Surprised 0.7%
Sad 9.4%
Confused 1.3%
Calm 85.8%
Disgusted 0.2%
Fear 0.4%
Angry 2%
Happy 0.2%

Microsoft Cognitive Services

Age 55
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.9%
Painting 90.5%

Captions

Microsoft

a man sitting on a table 77.6%
a man sitting at a table 77.5%
a man sitting in front of a laptop 63.3%

Text analysis

Amazon

TACK
AVGVSTVS VICENT TACK
AVGVSTVS
VICENT

Google

AvGV
AvGV STV s VINCENT TACK O1941
TACK
O1941
s
VINCENT
STV