Human Generated Data

Title

Self Portrait

Date

1935

People

Artist: Ilse Bing, German 1899 - 1998

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Anonymous Gift, 2014.454

Copyright

© The Ilse Bing Estate / Courtesy Edwynn Houk Gallery

Human Generated Data

Title

Self Portrait

People

Artist: Ilse Bing, German 1899 - 1998

Date

1935

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Apparel 98.9
Clothing 98.9
Shirt 98.9
Person 97.5
Human 97.5
Face 84.1
Wristwatch 81.9
Female 72
Finger 69.8
Photography 68.5
Portrait 68.5
Photo 68.5
Sleeve 66.7
Man 62.2
Woman 57.3

Clarifai
created on 2018-02-10

people 100
portrait 99.8
one 99.7
man 97.1
adult 97
actor 95.3
wear 94.3
music 91.9
monochrome 88.3
writer 86.6
administration 86
leader 85.7
facial expression 83.6
sit 82.9
outfit 81.3
retro 81.2
musician 79.4
menswear 77.3
pensive 76
actress 74.8

Imagga
created on 2018-02-10

person 41.2
portrait 38.8
man 37.6
male 29.1
face 26.3
adult 25.3
people 24
hat 20.9
looking 20
clothing 19.5
ruler 18.9
senior 18.8
smile 18.5
headdress 17.3
guy 17.1
handsome 16.9
attractive 16.8
black 16.2
cap 15.3
smiling 15.2
fashion 15.1
happy 15
hair 14.3
nurse 14.2
glasses 13.9
uniform 13.6
one 12.7
adolescent 12.2
crown 12.2
studio 12.2
expression 12
casual 11.9
worker 11.7
posing 11.6
business 11.5
sexy 11.2
mature 11.2
old 11.2
hand 10.6
men 10.3
juvenile 9.9
lady 9.7
mask 9.7
success 9.7
standing 9.6
professional 9.4
model 9.3
successful 9.2
confident 9.1
cheerful 8.9
businessman 8.8
costume 8.7
happiness 8.6
elderly 8.6
eyes 8.6
white 8.6
smart 8.5
shirt 8.4
head 8.4
health 8.3
occupation 8.3
style 8.2
closeup 8.1
job 8
love 7.9
broadcaster 7.8
suit 7.8
camera 7.4
friendly 7.3
indoor 7.3
make 7.3
lifestyle 7.2

Google
created on 2018-02-10

Microsoft
created on 2018-02-10

person 99.9
wall 99
indoor 96.6
posing 72.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-44
Gender Female, 99.3%
Calm 65.5%
Sad 2.7%
Happy 1.3%
Surprised 16.1%
Angry 6%
Disgusted 1.9%
Confused 6.5%

Microsoft Cognitive Services

Age 48
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Shirt 98.9%
Person 97.5%
Wristwatch 81.9%

Captions

Microsoft

a person posing for the camera 98.6%
a person sitting posing for the camera 95%
a person posing for a photo 94.5%