Human Generated Data

Title

Portrait of El Lissitzky

Date

1928

People

Artist: Josef Albers, American 1888 - 1976

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Josef Albers, BR49.18

Copyright

© Artists Rights Society (ARS), New York

Human Generated Data

Title

Portrait of El Lissitzky

People

Artist: Josef Albers, American 1888 - 1976

Date

1928

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Head 100
Human 100
Face 100
Person 97.2
Skin 90.2
Photography 83.1
Photo 83.1
Portrait 83.1
Man 61.8
Jaw 59.4
Beard 57.3

Clarifai
created on 2018-05-08

people 99.8
portrait 99.2
man 98.8
one 98.7
adult 98.6
leader 97.3
facial expression 91.4
wear 91.3
administration 87.7
bald 80.9
monochrome 78.1
profile 74.1
side view 73.4
outfit 72.6
chair 72.2
facial hair 67.9
face 66
music 65.9
veil 65
politician 61.6

Imagga
created on 2018-05-08

beard 68.1
face 44.1
man 43.1
person 41.4
male 40.5
portrait 37.6
child 34.1
attractive 29.4
handsome 26.8
adult 25.9
juvenile 25.4
people 24.6
eyes 23.3
serious 22.9
expression 22.2
close 21.1
head 20.2
casual 18.7
looking 18.4
guy 18.2
model 17.9
black 17.5
boy 16.5
adolescent 16.4
hair 15.9
happy 15.7
sexy 15.3
emotion 13.8
smiling 13.8
stare 13.6
smile 13.6
look 13.2
confident 12.8
one 12.7
closeup 12.1
men 12
youth 11.9
skin 10.6
professional 10.1
lifestyle 10.1
friendly 10.1
eye 9.8
ethnic 9.5
thinking 9.5
mature 9.3
fashion 9.1
cheerful 9
thoughtful 8.8
work 8.6
stress 8.6
bow tie 8.5
pretty 8.4
dark 8.4
human 8.3
style 8.2
pose 8.2
lady 8.1
natural 8
clothing 7.8
masculine 7.8
necktie 7.7
diversity 7.7
support 7.6
horizontal 7.5
shirt 7.5
lips 7.4
alone 7.3
business 7.3
cute 7.2
happiness 7.1

Google
created on 2018-05-08

person 95.2
photograph 95
man 94.2
chin 88.8
forehead 88.4
nose 86.8
head 86
portrait 78.4
gentleman 77.4
elder 72.5
moustache 71.6
black and white 71.5
monochrome 61.5
facial hair 57.4
senior citizen 55.9

Microsoft
created on 2018-05-08

person 99.9
necktie 99.8
man 98.6
wall 97.4
indoor 97.1
wearing 93.6
black 86.2
suit 83.2
posing 78.3
bow 67.4
eyes 33.5
staring 24.7
close 23.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-68
Gender Male, 99.2%
Confused 6.8%
Sad 12.3%
Angry 4.5%
Disgusted 7.4%
Calm 6.6%
Surprised 9.8%
Happy 52.4%

Microsoft Cognitive Services

Age 35
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.2%

Captions

Microsoft

a man wearing a suit and tie smiling and looking at the camera 95.9%
a man wearing a suit and tie smiling at the camera 95.8%
a man wearing a suit and tie looking at the camera 95.7%