Human Generated Data

Title

John G. Bourke (U.S. Army Sargent at Arms)

Date

1889-1890

People

Artist: Mathew B. Brady, American 1823 - 1896

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Robert Drapkin, P1998.89.39

Human Generated Data

Title

John G. Bourke (U.S. Army Sargent at Arms)

People

Artist: Mathew B. Brady, American 1823 - 1896

Date

1889-1890

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Robert Drapkin, P1998.89.39

Machine Generated Data

Tags

Amazon
created on 2019-04-10

Clothing 99.7
Apparel 99.7
Human 98.2
Person 98.2
Footwear 80.3
Coat 76.5
Overcoat 76.3
Art 75.3
Sitting 67.8
Shoe 64.1
Home Decor 63.9
Portrait 61.3
Face 61.3
Photo 61.3
Photography 61.3
Man 60.5
Boot 58.5
Accessories 57.3
Accessory 57.3
Tie 57.3
Suit 56.6
Painting 56

Clarifai
created on 2019-02-19

people 99.4
one 98.2
portrait 96.8
adult 96.6
man 96.5
leader 93.4
administration 90.5
wear 85.9
writer 79
retro 77
chair 76
music 75.2
outfit 73.5
painting 71.2
sit 70.1
art 69.6
indoors 67.9
facial hair 66.2
furniture 65.5
military 64.7

Imagga
created on 2019-02-19

bow tie 47.9
grandfather 45.1
necktie 39
man 35.6
male 29.4
people 29
adult 26.5
person 26.1
portrait 23.9
garment 20.7
home 18.3
couple 17.4
senior 16.9
old 16.7
happy 16.3
suit 15.4
clothing 15.3
lifestyle 15.2
family 14.2
love 14.2
hand 13.7
human 13.5
face 13.5
handsome 13.4
sexy 12.8
black 12.7
one 12.7
attractive 12.6
smiling 12.3
sitting 12
retired 11.6
serious 11.4
smile 11.4
mature 11.2
room 11.1
model 10.9
interior 10.6
business 10.3
hair 10.3
dress 9.9
husband 9.5
antique 9.5
old-timer 9.5
men 9.4
relationship 9.4
casual 9.3
glasses 9.3
fashion 9
romantic 8.9
chair 8.8
boy 8.7
retirement 8.6
elderly 8.6
wife 8.5
father 8.3
health 8.3
vintage 8.3
aged 8.1
cheerful 8.1
romance 8
looking 8
child 8
job 8
indoors 7.9
together 7.9
mother 7.8
married 7.7
head 7.6
retro 7.4
lady 7.3
grandma 7.2
fitness 7.2
body 7.2
religion 7.2
posing 7.1
businessman 7.1
happiness 7.1
modern 7
look 7

Google
created on 2019-02-19

Microsoft
created on 2019-02-19

person 97.9
wall 97.4
man 93.9
old 92.8
text 91
black 74.7
posing 61
vintage 29.6
older 20.7
picture frame 6.5
museum 6.5
portrait 1.8
art 1.7
photograph 1.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 97.4%
Sad 3.7%
Happy 10%
Calm 73.8%
Surprised 2.3%
Disgusted 1.7%
Angry 3.3%
Confused 5.2%

Microsoft Cognitive Services

Age 58
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.2%

Categories

Text analysis

Amazon

Boune
oaphain
oaphain Boune USArmy,
inis.
USArmy,
bengaus at inis.
at
bengaus

Google

eno
eno