Human Generated Data

Title

Untitled (Orphan Girl, Amsterdam, Orphan Boy, Amsterdam; verso: Zeeland, Zeeland)

Date

1890s

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Janet and Daniel Tassel, 2007.219.5.3

Human Generated Data

Title

Untitled (Orphan Girl, Amsterdam, Orphan Boy, Amsterdam; verso: Zeeland, Zeeland)

People

Artist: Unidentified Artist,

Date

1890s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-05

Apparel 99.2
Clothing 99.2
Person 98.2
Human 98.2
Person 97.4
Coat 82.9
Overcoat 82.6
Costume 69.8
Suit 67.1
Hat 64.3
Advertisement 56.1
Poster 56.1

Clarifai
created on 2019-11-05

wear 99.1
people 98
adult 97.3
lid 96.3
one 96.3
man 94.5
outfit 94.1
veil 93.7
retro 93.2
military 92.8
portrait 91.3
print 90.4
two 90
illustration 90
painting 89.3
woman 88.1
facial expression 87.7
vintage 86.7
container 86.3
cap 84.9

Imagga
created on 2019-11-05

mug shot 43.1
photograph 34.4
representation 26.2
paper 24
old 20.9
hat 20.3
creation 19.3
vintage 19
grunge 17
texture 16
envelope 15
design 13.2
blank 12.8
cowboy hat 12.5
antique 12.1
black 12
money 11.9
currency 11.7
art 11.6
business 11.5
stamp 10.6
ancient 10.4
headdress 10.3
container 10.2
page 10.2
card 10.2
symbol 10.1
cash 10.1
close 9.7
post 9.5
culture 9.4
holiday 9.3
note 9.2
frame 9.1
retro 9
people 8.9
brown 8.8
textured 8.8
clothing 8.6
empty 8.6
wall 8.5
greeting 8.3
economy 8.3
sign 8.3
banking 8.3
rough 8.2
paint 8.1
man 8.1
decoration 8.1
bank 8.1
light 8
financial 8
covering 7.9
portrait 7.8
bill 7.6
horizontal 7.5
savings 7.5
dollar 7.4
device 7.4
letter 7.3
artwork 7.3
person 7.3
aged 7.2
dirty 7.2
ruler 7.2
male 7.2
market 7.1
copy 7.1

Google
created on 2019-11-05

Microsoft
created on 2019-11-05

clothing 93.4
human face 86.6
person 86.2
hat 82.5
fashion accessory 67.6
man 66.4
text 60.6
fedora 56.5
different 52.8
stone 4.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Male, 54.8%
Disgusted 45%
Confused 45%
Sad 45%
Surprised 45%
Fear 45%
Calm 55%
Angry 45%
Happy 45%

AWS Rekognition

Age 11-21
Gender Male, 99.3%
Sad 0.1%
Confused 0%
Angry 0.1%
Surprised 0%
Happy 0.1%
Calm 99.6%
Fear 0%
Disgusted 0%

Microsoft Cognitive Services

Age 33
Gender Male

Microsoft Cognitive Services

Age 25
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.2%

Captions

Microsoft

a group of people in a box 51.7%
a couple of people that are in a box 29.8%
a group of people posing for a photo 29.7%

Text analysis

Amazon

eelanol
eelanol julaade
julaade

Google

1592 eland Julank
eland
Julank
1592