Human Generated Data

Title

Portrait of a Boy

Date

19th-20th century

People

Artist: Denman Waldo Ross, American 1853 - 1935

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Denman W. Ross, Class of 1875, 1936.150.449

Human Generated Data

Title

Portrait of a Boy

People

Artist: Denman Waldo Ross, American 1853 - 1935

Date

19th-20th century

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Denman W. Ross, Class of 1875, 1936.150.449

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Apparel 97
Clothing 97
Hat 97
Art 95
Human 83.6
Person 83.6
Painting 83.1
Mural 59.5
Wall 57.8
Home Decor 57.5
Face 55.6

Clarifai
created on 2019-06-01

people 97.1
art 95.7
painting 94.5
adult 93
man 92.9
portrait 92.1
one 90.6
woman 88.4
beautiful 86.6
color 82
lid 80.6
artistic 80.5
person 80.5
painter 79
illustration 78.4
face 77.8
wear 77.5
fun 77.2
leisure 76.5
desktop 76.3

Imagga
created on 2019-06-01

person 37.5
shower cap 36.7
cap 34.5
man 34.3
clothing 32.5
portrait 31.7
headdress 31.3
male 29.1
hat 28
senior 26.2
people 25.1
adult 24
face 22
elderly 21.1
happy 20
old 18.8
attractive 18.2
covering 17.9
smile 17.8
looking 17.6
hair 17.4
expression 17.1
glasses 16.7
health 16
smiling 15.9
mature 15.8
doctor 15
model 14
consumer goods 13.6
casual 13.6
one 13.4
guy 12.9
professional 12.8
medical 12.4
shirt 11.7
handsome 11.6
medicine 11.4
boy 11.3
uniform 11.3
occupation 11
lifestyle 10.8
look 10.5
pretty 10.5
business 10.3
head 10.1
joy 10
surgeon 10
holding 9.9
care 9.9
fashion 9.8
60s 9.8
older 9.7
eyes 9.5
closeup 9.4
bonnet 9.4
work 9.4
hospital 9.4
mask 9.3
retirement 8.6
clinic 8.6
men 8.6
black 8.4
studio 8.4
hand 8.4
color 8.3
aged 8.1
worker 8.1
office 8
gray hair 7.9
couple 7.8
happiness 7.8
jacket 7.8
retired 7.8
wearing 7.6
lab coat 7.4
pose 7.2
costume 7.2
women 7.1
businessman 7.1

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

sketch 99.3
child art 99.2
painting 99.1
art 80.7
cartoon 77.1
human face 65.3
drawing 37.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 89.9%
Confused 18%
Surprised 4.9%
Calm 10.9%
Sad 42.9%
Happy 3.3%
Disgusted 11.6%
Angry 8.3%

Microsoft Cognitive Services

Age 17
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Hat 97%
Person 83.6%
Painting 83.1%

Categories

Imagga

people portraits 49.5%
paintings art 49.3%

Captions

Microsoft
created on 2019-06-01

a person wearing a hat 57.6%
a person wearing a costume 57.5%
a person wearing a mask 51.8%

Text analysis

Amazon

ou
ou fofd Rino
Rino
S WR.
fofd

Google

to tiho
to
tiho