Human Generated Data

Title

Untitled (full-length portrait of two boys against backdrop of outdoor setting)

Date

c. 1856 - c. 1910

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.8

Human Generated Data

Title

Untitled (full-length portrait of two boys against backdrop of outdoor setting)

People

Artist: Unidentified Artist,

Date

c. 1856 - c. 1910

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.8

Machine Generated Data

Tags

Amazon
created on 2019-03-23

Person 98.9
Human 98.9
Person 96.8
Apparel 95
Clothing 95
Painting 83.9
Art 83.9
People 70.5
Face 70.4
Coat 63.4
Photo 58.4
Photography 58.4

Clarifai
created on 2019-03-23

people 99.9
adult 96.9
wear 96.5
two 95.4
man 94.9
portrait 94.6
art 93.2
child 90.7
military 90.2
retro 88.5
print 87.1
administration 86.6
group 86.2
one 85.1
outfit 84.4
vintage 83.2
woman 82.3
memory 81.2
son 80.9
outerwear 80.1

Imagga
created on 2019-03-23

brother 31.8
man 28.2
person 27.6
kin 26.3
people 26.2
portrait 25.9
adult 23.3
male 23
couple 20
mother 19.9
child 18.5
black 17.8
attractive 17.5
fashion 16.6
love 16.6
model 16.3
dark 15.9
happy 15.7
hair 15
face 14.2
one 13.4
sibling 13.1
sexy 12.8
human 12.7
fun 12.7
parent 12.7
women 12.6
pretty 12.6
family 12.4
happiness 11.7
dress 11.7
fear 11.6
cute 11.5
smile 11.4
clothing 11.3
looking 11.2
husband 10.7
together 10.5
world 10.4
youth 10.2
smiling 10.1
lifestyle 10.1
elegance 10.1
silhouette 9.9
posing 9.8
lady 9.7
body 9.6
sitting 9.4
expression 9.4
relationship 9.4
casual 9.3
park 9.1
romance 8.9
autumn 8.8
light 8.7
wife 8.5
two 8.5
outdoor 8.4
father 8.4
old 8.4
alone 8.2
girls 8.2
sensuality 8.2
dirty 8.1
home 8
horror 7.8
loving 7.6
skin 7.6
room 7.6
joy 7.5
leisure 7.5
daughter 7.3

Google
created on 2019-03-23

Microsoft
created on 2019-03-23

person 95.6
boy 84.8
black 83.3
old 76.5
posing 74.6
white 60.7
vintage 36.2
picture frame 7.6
child 7.6
retro 1.3
photograph 0.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 14-23
Gender Female, 76.1%
Happy 2.4%
Surprised 2.9%
Calm 69.7%
Angry 4.3%
Confused 1.6%
Sad 17.4%
Disgusted 1.8%

AWS Rekognition

Age 4-9
Gender Male, 58.1%
Sad 30.4%
Surprised 3.6%
Disgusted 4.3%
Angry 5.4%
Calm 50.7%
Happy 3.7%
Confused 1.9%

Microsoft Cognitive Services

Age 20
Gender Male

Microsoft Cognitive Services

Age 7
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Painting 83.9%

Categories

Captions