Human Generated Data

Title

It's in the Bag

Date

1968

People

Artist: Arnold Trachtman, American 1930 -

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Purchase with the aid of funds from the National Endowment for the Arts and matching gifts, 1978.122

Human Generated Data

Title

It's in the Bag

People

Artist: Arnold Trachtman, American 1930 -

Date

1968

Classification

Drawings

Machine Generated Data

Tags

Amazon
created on 2020-05-01

Human 96.9
Person 96.9
Art 96.5
Drawing 96.5
Person 95.6
Sketch 85
Face 75.3
Text 56.5

Clarifai
created on 2020-05-01

people 100
portrait 99.8
adult 99.6
man 99.4
one 98.9
leader 98.7
group 97
administration 95.5
scientist 94.9
art 94.6
illustration 93.7
two 91.9
politician 91.9
print 91.9
writer 89.6
face 88.1
facial expression 88.1
comedy 84.1
mustache 83.6
facial hair 83.1

Imagga
created on 2020-05-01

book jacket 51.8
jacket 41.3
portrait 32.4
wrapping 30.6
covering 30.5
comic book 29.3
face 28.4
mask 26.2
tattoo 26
person 24.6
decoration 21
black 19.8
crazy 18.7
male 18.4
people 18.4
man 18.1
eyes 17.2
attractive 16.1
pretty 16.1
hair 15.9
fashion 15.8
adult 15.5
sexy 15.3
makeup 14.6
human 14.2
model 14
disguise 13.8
close 13.7
smile 13.5
design 13.4
expression 12.8
make 12.7
studio 12.2
print media 11.7
lady 11.4
billboard 11.3
skin 11.1
business 10.9
dark 10.9
evil 10.7
carnival 10.7
hand 10.6
painter 10.6
art 10.6
look 10.5
fun 10.5
head 10.1
cute 10
graffito 9.8
one 9.7
women 9.5
happy 9.4
money 9.4
signboard 9.1
fantasy 9
currency 9
attire 8.8
mysterious 8.7
professional 8.4
lips 8.3
gorgeous 8.2
costume 8.1
religion 8.1
job 8
demon 7.9
masquerade 7.9
theater 7.8
horror 7.8
old 7.7
hairstyle 7.6
character 7.5
style 7.4
closeup 7.4
banking 7.4
cash 7.3
alone 7.3
office 7.2
body 7.2
eye 7.1
financial 7.1

Google
created on 2020-05-01

Microsoft
created on 2020-05-01

drawing 99.7
sketch 99.7
text 99.2
painting 97
art 96.2
human face 96.1
man 92.4
person 89.4
illustration 86.9
face 77.6
old 74
cartoon 68.2
black 66.3
portrait 63.9
child art 54.1
posing 53.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 46-64
Gender Male, 96.2%
Confused 0%
Happy 0%
Sad 0%
Disgusted 0%
Surprised 0%
Angry 99.9%
Fear 0%
Calm 0%

AWS Rekognition

Age 43-61
Gender Male, 95.3%
Angry 53.2%
Confused 0.4%
Fear 0.5%
Calm 42.5%
Disgusted 0.4%
Sad 2%
Surprised 1%
Happy 0.1%

Microsoft Cognitive Services

Age 57
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.9%

Captions

Microsoft

an old photo of a man 85%
a black and white photo of a man 77.8%
old photo of a man 77.7%

Text analysis

Amazon

1en

Google

20"
20"