Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: Exhibit I.: Baron Maurice de Hirsch. 3.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3538.1

Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: Exhibit I.: Baron Maurice de Hirsch. 3.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3538.1

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Person 96.2
Human 96.2
Text 79.9
Mustache 77
Face 68.1
Photography 64.3
Portrait 64.3
Photo 64.3

Clarifai
created on 2019-06-05

people 99.8
one 99.5
man 99
adult 98.8
portrait 98.7
mustache 97.3
leader 94.6
facial hair 94.4
print 91
art 87.8
music 87.7
wear 84.9
scientist 82.1
physics 79.8
engraving 77
famous 74.6
pensive 74.4
exploration 73.3
business 72.6
confidence 71.8

Imagga
created on 2019-06-05

portrait 47.2
man 40.3
person 39.2
male 37.8
face 36.2
people 32.3
adult 31
handsome 29.4
looking 27.2
expression 24.7
hair 23
black 22.7
head 21
attractive 21
guy 20.7
happy 20.7
eyes 19.8
smiling 18.8
casual 18.6
model 17.9
lifestyle 17.3
close 16.5
human 16.5
serious 16.2
youth 16.2
look 15.8
smile 15.7
beard 15
senior 15
confident 14.6
one 14.2
disk jockey 14.1
fashion 13.6
clothing 13.1
emotion 12.9
happiness 12.5
dark 12.5
cool 12.4
boy 12.2
sweatshirt 12.1
mature 12.1
men 12
elderly 11.5
communicator 11.4
cheerful 11.4
broadcaster 11.2
grandfather 11.2
old 11.1
alone 11
closeup 10.8
masculine 10.7
pullover 10.7
call 10.5
teenager 10
single 9.9
outdoors 9.7
shirt 9.7
stress 9.6
thinking 9.5
love 9.5
sweater 9.2
studio 9.1
business 9.1
style 8.9
depression 8.8
work 8.6
cute 8.6
nose 8.6
pretty 8.4
device 8.4
glasses 8.3
couple 7.8
sad 7.7
think 7.7
confidence 7.7
professional 7.6
hand 7.6
jacket 7.5
lips 7.4
friendly 7.3
sexy 7.2
gray 7.2
eye 7.1
support 7.1
businessman 7.1

Google
created on 2019-06-05

Chin 85
Forehead 78.2
Portrait 77.5
Moustache 77.3
Facial hair 64.8
Gentleman 59.6
Self-portrait 52.8
Circle 51.6
Art 50.2

Microsoft
created on 2019-06-05

man 98.6
person 96.9
painting 95.5
human face 95.4
drawing 88.8
portrait 78.4
sketch 64.4
clothing 54.9
necktie 24.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 99.8%
Calm 73.2%
Sad 5.9%
Surprised 1.7%
Disgusted 0.3%
Angry 3.6%
Happy 1.8%
Confused 13.6%

Microsoft Cognitive Services

Age 51
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.2%

Categories

Imagga

paintings art 57.4%
food drinks 39.2%
people portraits 2%

Captions

Microsoft
created on 2019-06-05

a man wearing a suit and tie 94.7%
a man in a suit and tie 94.6%
a close up of a man wearing a suit and tie 92.7%