Human Generated Data

Title

Sanford Robinson Gifford (1823-1880)
Date

1866-1871
People

Artist: Napoleon Sarony, American 1821 - 1896

Sitter: Sanford Robinson Gifford, American 1823 - 1880

Author: Henry Theodore Tuckerman, American 1813-1871
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.411.7

Human Generated Data

Title

Sanford Robinson Gifford (1823-1880)

People

Artist: Napoleon Sarony, American 1821 - 1896

Sitter: Sanford Robinson Gifford, American 1823 - 1880

Author: Henry Theodore Tuckerman, American 1813-1871

Date

1866-1871

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.411.7

Machine Generated Data

Tags

Amazon
created on 2019-04-10

Text 98.5
Human 98.4
Face 98.4
Person 98.1
Art 78.2
Handwriting 77.6
Photography 74.2
Photo 74.2
Beard 73.8
Portrait 71.7
Clothing 66.7
Apparel 66.7
Coat 66.7
Suit 66.7
Overcoat 66.7
Head 66.6
Drawing 65.1
Mustache 56.3

Clarifai
created on 2019-02-07

people 97.5
art 95.4
portrait 94.5
retro 93.9
painting 93.5
one 92.8
adult 90.2
man 89.6
picture frame 87.2
vintage 85.9
wear 85.9
leader 79.2
old 77
bill 75.6
illustration 70.1
antique 68.4
indoors 68.2
paper 68
nostalgia 65.6
facial hair 64.9

Imagga
created on 2019-02-07

bow tie 100
necktie 92.8
garment 46.8
clothing 41.1
portrait 34.3
man 32.3
person 31.8
male 29.8
adult 29.1
face 28.4
people 25.7
businessman 21.2
attractive 20.3
business 20
looking 19.2
uniform 19.1
suit 18.8
senior 18.7
office 17.7
professional 16.9
one 16.4
smile 16.4
expression 16.2
tie 16.1
mature 15.8
elderly 15.3
human 15
alone 14.6
hair 14.3
handsome 14.3
work 14.1
lifestyle 13.7
military uniform 13.7
hand 13.7
old 13.2
executive 13.2
look 13.1
call 12.9
happy 12.5
shirt 12.1
fashion 12.1
eyes 12.1
glasses 12
modern 11.9
confident 11.8
lady 11.4
casual 11
head 10.9
model 10.9
smiling 10.9
gray 10.8
posing 10.7
home 10.4
men 10.3
aged 10
pretty 9.8
job 9.7
black 9.6
confidence 9.6
corporate 9.5
doctor 9.4
working 8.8
medical 8.8
serious 8.6
adults 8.5
communication 8.4
manager 8.4
studio 8.4
health 8.3
phone 8.3
holding 8.3
cheerful 8.1
sexy 8
worker 8
telephone 7.8
brunette 7.8
standing 7.8
hands 7.8
expertise 7.8
sitting 7.7
retirement 7.7
boss 7.7
care 7.4
single 7.4
occupation 7.3
sensuality 7.3
jacket 7.3
covering 7.2
happiness 7.1
medicine 7

Google
created on 2019-02-07

Photograph 96.9
Gentleman 81.4
Moustache 77.7
Portrait 75.7
Vintage clothing 74.4
Picture frame 71
Room 65.7
Art 62.5
Photography 62.4
Facial hair 60.7
Stock photography 59.4
Illustration 57.7
Drawing 57.6
Black-and-white 56.4

Microsoft
created on 2019-02-07

gallery 80.9
room 50.6
old 47.4
art 47.4
portrait 19.4
man 18.7
print 14.5
black and white 13.6
person 13.1
museum 11.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 96.4%
Confused 8.9%
Angry 7.4%
Disgusted 0.5%
Calm 66.1%
Happy 2.7%
Surprised 5.3%
Sad 9%

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.1%
Suit 66.7%

Categories

Imagga

paintings art 89.8%
streetview architecture 6.6%
interior objects 1.6%

Captions

Microsoft
created on 2019-02-07

an old photo of a person 63%
old photo of a person 56.8%
an old photo of a person in a room 56.7%

Text analysis

Amazon

Sofod
Sofod folpon
folpon