Human Generated Data

Title

Sarah Colden Thompson (Mrs. Cotting)

Date

1850s?

People

Artist: Unidentified Artist,

Classification

Paintings

Credit Line

Harvard School of Business Administration, H724

Human Generated Data

Title

Sarah Colden Thompson (Mrs. Cotting)

People

Artist: Unidentified Artist,

Date

1850s?

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Art 97.7
Painting 97.7
Human 95.9
Person 95.9
Clothing 68.4
Apparel 68.4

Clarifai
created on 2018-03-23

people 99.8
portrait 99.3
one 99.2
adult 98.6
wear 96.7
music 94.1
woman 93.2
administration 91.5
leader 91
musician 89.8
outerwear 88.2
lid 85.3
facial expression 85.2
jacket 84.1
movie 83.6
dress 83.3
outfit 82.2
art 81.7
girl 80.9
painting 80.3

Imagga
created on 2018-03-23

portrait 35.6
person 35.5
adult 31.1
attractive 29.4
man 28.2
people 27.9
smile 26.4
bow tie 25.9
necktie 25.2
male 24.1
happy 23.8
clothing 23.7
face 23.4
pretty 22.4
expression 21.3
handsome 20.5
hat 20.3
looking 20
waiter 19.4
business 18.2
smiling 18.1
sexy 17.7
worker 17.7
bonnet 17.5
youth 17
lifestyle 16.6
model 16.3
garment 15.9
cute 15.8
dining-room attendant 15.5
lady 15.4
casual 15.3
fashion 15.1
human 15
one 14.9
glasses 14.8
black 14.3
employee 14.1
professional 13.9
corporate 13.8
covering 13.7
headdress 13.6
businesswoman 13.6
executive 13.4
costume 13.2
suit 13.2
look 13.1
studio 12.9
rustic 12.9
successful 12.8
confident 12.7
businessman 12.4
senior 12.2
success 12.1
hair 11.9
teenager 11.9
cheerful 11.4
brunette 11.3
modern 11.2
old 11.2
work 11
jacket 10.7
cloak 9.7
shirt 9.5
happiness 9.4
alone 9.1
wig 8.8
standing 8.7
elderly 8.6
eyes 8.6
outside 8.6
student 8.5
manager 8.4
mature 8.4
hand 8.4
teen 8.3
friendly 8.2
single 8.2
outdoors 8.2
office 8
natural 8
posing 8
retirement 7.7
boss 7.7
tie 7.6
holding 7.4
closeup 7.4
dress 7.2
women 7.1

Google
created on 2018-03-23

portrait 94.1
painting 84.8
art 84.8
gentleman 78.7
modern art 66.1
artwork 53.6
self portrait 52.9
paint 50.3

Microsoft
created on 2018-03-23

person 94.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-66
Gender Female, 97.4%
Calm 86.2%
Surprised 2.1%
Happy 1.4%
Sad 3.2%
Disgusted 1%
Confused 2.3%
Angry 3.6%

Microsoft Cognitive Services

Age 66
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 97.7%
Person 95.9%

Captions

Microsoft

a person wearing a hat 84.3%
a person wearing a suit and tie 84.2%
a person wearing a black hat 80.3%