Human Generated Data

Title

Hindoo Mendicants

Date

c. 1880

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Janet and Daniel Tassel, 2007.219.50.2

Human Generated Data

Title

Hindoo Mendicants

People

Artist: Unidentified Artist,

Date

c. 1880

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Janet and Daniel Tassel, 2007.219.50.2

Machine Generated Data

Tags

Amazon
created on 2019-11-07

Human 99.2
Person 99.2
Person 99.1
Person 98.9
Person 98.2
Person 98.1
Person 98.1
Person 98
Person 95.1
Person 94.7
Person 93.7
Person 90.5
Art 85.7
Person 82.2
People 76.8
Person 73.9
Person 71.3
Text 66.8
Wood 65.1
Painting 63
Drawing 58.7
Flooring 56.9
Photo 56
Photography 56
Person 47.5

Clarifai
created on 2019-11-07

people 99.9
many 99.9
group 99.8
illustration 98.5
print 98.3
adult 98.1
man 97.2
lithograph 95.6
furniture 95.4
art 94.9
woman 93
leader 91.9
several 90.9
engraving 90.3
crowd 89.8
war 87
military 86.1
vehicle 85.4
child 84.8
administration 83.7

Imagga
created on 2019-11-07

sketch 40.6
drawing 35.6
representation 27.7
stamp 26.8
vintage 24.9
old 23.7
currency 23.3
money 23
retro 20.5
cash 20.1
bill 20
paper 18.9
grunge 18.7
bank 17.9
finance 16.9
art 16.7
business 16.4
comic book 15.2
letter 14.7
envelope 14.5
dollar 13.9
design 13.9
banking 13.8
symbol 13.5
financial 13.4
book jacket 12.5
antique 12.2
postmark 11.8
postage 11.8
wealth 11.7
bills 11.6
banknote 11.6
insulating material 11.5
mail 11.5
man 11.5
savings 11.2
decoration 11
note 11
die 10.8
dollars 10.6
office 10.5
exchange 10.5
ancient 10.4
economy 10.2
postal 9.8
jacket 9.7
hundred 9.7
pay 9.6
post 9.5
graphic 9.5
frame 9.4
decorative 9.2
aged 9
texture 9
history 8.9
states 8.7
us 8.7
building material 8.6
blank 8.6
black 8.4
sign 8.3
pattern 8.2
global 8.2
shaping tool 8.2
card 7.8
payment 7.7
united 7.6
container 7.5
one 7.5
silhouette 7.4
wrapping 7.4
object 7.3
people 7.2
dirty 7.2
collection 7.2
travel 7

Google
created on 2019-11-07

Photograph 96
Text 88.1
Snapshot 82.9
Photography 62.4
Art 58.1
Picture frame 54.4
Paper 51
Collection 50

Microsoft
created on 2019-11-07

person 97.3
text 91.3
clothing 90.4
gallery 88.1
old 74.2
man 70.8
room 61
posing 54
vintage 46
different 43
several 17.9

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 32-48
Gender Male, 54.2%
Surprised 45.1%
Fear 46.1%
Happy 45%
Sad 45.1%
Calm 45.1%
Confused 45.4%
Disgusted 45.3%
Angry 52.8%

AWS Rekognition

Age 20-32
Gender Female, 54.8%
Angry 51.6%
Calm 45.2%
Sad 47.7%
Disgusted 45%
Happy 45%
Confused 45%
Surprised 45%
Fear 45.4%

AWS Rekognition

Age 22-34
Gender Female, 51.7%
Happy 45.1%
Angry 45.3%
Sad 45.1%
Calm 54.4%
Surprised 45.1%
Confused 45%
Disgusted 45%
Fear 45%

AWS Rekognition

Age 22-34
Gender Female, 54.9%
Happy 45.1%
Surprised 45%
Fear 45.1%
Calm 51.8%
Disgusted 45%
Sad 47.8%
Confused 45.1%
Angry 45.1%

AWS Rekognition

Age 42-60
Gender Male, 52%
Happy 45.7%
Surprised 45.1%
Confused 45.1%
Angry 45.3%
Disgusted 45.1%
Fear 46.3%
Sad 52.1%
Calm 45.3%

AWS Rekognition

Age 19-31
Gender Female, 54.9%
Angry 45.1%
Confused 45.1%
Sad 53.3%
Happy 45%
Calm 46.3%
Fear 45.2%
Surprised 45%
Disgusted 45%

AWS Rekognition

Age 43-61
Gender Male, 54.9%
Angry 46.1%
Happy 45%
Calm 46.9%
Confused 45.1%
Fear 45.2%
Sad 46.9%
Surprised 45.1%
Disgusted 49.6%

AWS Rekognition

Age 27-43
Gender Male, 54.2%
Happy 45%
Disgusted 48.3%
Surprised 45.1%
Calm 45.4%
Angry 50.8%
Fear 45.1%
Confused 45.1%
Sad 45.2%

AWS Rekognition

Age 24-38
Gender Female, 54.7%
Confused 45.2%
Calm 53.1%
Sad 45.6%
Happy 45.1%
Angry 45.8%
Disgusted 45%
Fear 45.2%
Surprised 45.1%

AWS Rekognition

Age 30-46
Gender Male, 54.6%
Confused 45.2%
Disgusted 47%
Sad 47.6%
Calm 45.1%
Surprised 45.1%
Happy 45%
Angry 45.6%
Fear 49.4%

AWS Rekognition

Age 30-46
Gender Female, 50%
Angry 54%
Fear 45.6%
Calm 45%
Confused 45%
Disgusted 45.1%
Surprised 45.2%
Happy 45%
Sad 45.1%

AWS Rekognition

Age 20-32
Gender Male, 50.5%
Confused 49.5%
Happy 50.4%
Calm 49.5%
Angry 49.5%
Fear 49.5%
Disgusted 49.5%
Surprised 49.5%
Sad 49.5%

AWS Rekognition

Age 26-40
Gender Male, 53.4%
Confused 45%
Angry 45%
Sad 54.9%
Happy 45%
Calm 45%
Disgusted 45%
Fear 45%
Surprised 45%

AWS Rekognition

Age 21-33
Gender Female, 50.1%
Disgusted 49.5%
Fear 49.6%
Happy 49.5%
Confused 49.5%
Sad 50.1%
Surprised 49.5%
Angry 49.6%
Calm 49.7%

AWS Rekognition

Age 29-45
Gender Male, 54.4%
Surprised 45.1%
Calm 45.9%
Confused 47.5%
Angry 49.6%
Happy 45%
Fear 45.3%
Disgusted 45.1%
Sad 46.5%

Feature analysis

Amazon

Person 99.2%

Categories

Imagga

paintings art 73.5%
interior objects 14.3%
food drinks 11.7%

Text analysis

Amazon

Saneing
Saneing irls:
DrGenaicants.
irls:
8Blackesmiterd.
liimdoo DrGenaicants.
liimdoo
1702

Google

Dancing eirtss ndoo YGenaicants 88lackamitlrs
Dancing
eirtss
ndoo
YGenaicants
88lackamitlrs