Human Generated Data

Title

Francis Welch
Date

19th century
People

Artist: Unidentified Artist,

Sitter: Francis Welch,

Classification

Paintings
Credit Line

Harvard School of Business Administration, H725

Human Generated Data

Title

Francis Welch

People

Artist: Unidentified Artist,

Sitter: Francis Welch,

Date

19th century

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-05

Painting 98.9
Art 98.9
Person 91.6
Human 91.6

Clarifai
created on 2018-03-22

people 99.7
one 99.5
adult 99.2
music 99.2
musician 99
portrait 98.6
violin 96.9
performance 96.7
violinist 96.5
wear 95
man 94.5
concert 93.8
instrument 92
woman 91.8
singer 91.7
art 90.6
side view 87
classical music 85.9
facial expression 83.9
profile 83.8

Imagga
created on 2018-03-22

man 48.4
person 43.5
male 40.5
suit 32.8
portrait 31.1
businessman 30
business 29.2
adult 28
speaker 27.3
handsome 26.8
people 23.4
phone 23.1
professional 22.4
articulator 20.7
call 19.8
tie 19
expression 18.8
face 18.5
musical instrument 18.2
black 18.2
confident 18.2
smile 17.1
executive 17.1
office 16.9
brass 16.8
wind instrument 16.1
hair 15.9
communicator 15.7
telephone 15.7
attractive 15.4
performer 14.9
success 14.5
hand 14.4
fashion 14.3
mobile 14.1
bowed stringed instrument 13.8
smiling 13.8
looking 13.6
one 13.4
communication 13.4
guy 13.3
happy 13.2
shirt 13.1
serious 12.4
thinking 12.4
corporate 12
human 12
violin 11.7
cell 11.5
comedian 11.5
men 11.2
work 11
friendly 11
stringed instrument 10.9
dark 10.9
worker 10.7
cellphone 10.7
studio 10.6
job 10.6
entertainer 10.5
device 10.3
youth 10.2
successful 10.1
sexy 9.6
boy 9.6
talking 9.5
eyes 9.5
clothing 9.4
manager 9.3
modern 9.1
style 8.9
cellular 8.8
model 8.6
pretty 8.4
glasses 8.3
musician 8.1
lifestyle 8
happiness 7.8
talk 7.7
cheerful 7.3
alone 7.3
gray 7.2

Google
created on 2018-03-22

violinist 96.2
violist 95.5
violin 93.2
viola 88.5
modern art 85.7
violin family 85.7
violone 84.8
portrait 84.2
musical instrument 81.8
string instrument 81.8
musician 75.1
string instrument 74.6
painting 73.9
bowed string instrument 73.6
viol 71.6
music 69.4
art 68.3
virtuoso 68.3
classical music 62.1
concertmaster 58.7

Microsoft
created on 2018-03-22

person 99.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Female, 58.6%
Confused 5.8%
Angry 1.3%
Calm 81.3%
Sad 2.7%
Surprised 2.1%
Disgusted 1.6%
Happy 5.2%

Microsoft Cognitive Services

Age 31
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 98.9%
Person 91.6%

Captions

Microsoft

a person holding a gun 40.8%
a person holding a microphone 40.7%
a man and a woman taking a selfie 14%