Human Generated Data

Title

Untitled [Paul Klee]

Date

20th century

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Julia Feininger, BR63.5440

Human Generated Data

Title

Untitled [Paul Klee]

People

Artist: Unidentified Artist,

Date

20th century

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 98.5
Human 98.5
Face 84.5
Finger 72.2
Man 65.2
Portrait 60.6
Photography 60.6
Photo 60.6
Sports 56
Sport 56

Imagga
created on 2022-03-05

person 41.8
male 37.9
man 37
home 36.7
people 32.4
senior 31
adult 27.5
grandma 27
indoors 26.4
adolescent 24.4
portrait 24
happy 21.3
juvenile 20.6
mature 20.5
smiling 19.6
lifestyle 18.8
sitting 18.1
clothing 17
elderly 16.3
grandfather 15.5
casual 15.3
old 14.6
retired 14.6
patient 14.4
mother 13.9
camera 13.9
looking 13.6
dad 13.5
face 13.5
professional 13.3
health 13.2
nurse 13.2
couple 13.1
garment 12.9
smile 12.8
retirement 12.5
father 12.2
computer 12
70s 11.8
half length 11.7
color 11.7
mid adult 11.6
family 11.6
parent 11.5
medical 11.5
office 11.3
inside 11.1
hospital 11
happiness 11
bathrobe 10.9
two people 10.7
older 10.7
businessman 10.6
one 10.5
room 10.2
occupation 10.1
horizontal 10.1
relaxing 10
aged 10
child 9.9
business 9.7
bow tie 9.7
necktie 9.7
together 9.6
vertical 9.6
men 9.5
day 9.4
relaxed 9.4
house 9.2
20s 9.2
alone 9.1
indoor 9.1
laptop 9.1
human 9
handsome 8.9
seniors 8.8
medicine 8.8
women 8.7
illness 8.6
talking 8.6
doctor 8.5
shirt 8.4
lab coat 8.2
job 8
coat 8
robe 7.9
seventies 7.9
work 7.9
boy 7.8
standing 7.8
seated 7.8
student 7.8
bed 7.6
monk 7.5
care 7.4
single 7.4
cheerful 7.3
black 7.2
hair 7.1
daughter 7.1
chair 7
modern 7
attractive 7

Google
created on 2022-03-05

Sleeve 87.2
Gesture 85.3
Collar 84.1
Dress shirt 82.4
Blazer 76.7
Vintage clothing 70.2
Formal wear 69.5
Monochrome photography 65.2
Monochrome 64.4
Chest 63.4
Sitting 62.9
Suit 61.1
Tie 60.3
Room 60.1
Portrait 58.3
White-collar worker 57.3
Elbow 56.1
Portrait photography 55.8
Wrist 55.6
Art 51.8

Microsoft
created on 2022-03-05

person 99.9
wall 99.6
indoor 97.5
human face 96.1
man 93.8
clothing 93.4
text 90.2
portrait 74.8
watch 61.4
black and white 61
old 56.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 56-64
Gender Male, 100%
Calm 65.1%
Angry 12.7%
Sad 7.1%
Confused 5.7%
Disgusted 5%
Surprised 2.6%
Fear 1%
Happy 0.7%

Microsoft Cognitive Services

Age 61
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%

Captions

Microsoft

a vintage photo of Paul Klee 94%
an old photo of Paul Klee 92.9%
a vintage photo of Paul Klee looking at the camera 85.5%