Human Generated Data

Title

Untitled [Paul Klee]

Date

20th century

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Julia Feininger, BR63.5440

Human Generated Data

Title

Untitled [Paul Klee]

People

Artist: Unidentified Artist,

Date

20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Julia Feininger, BR63.5440

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 98.5
Human 98.5
Face 84.5
Finger 72.2
Man 65.2
Portrait 60.6
Photography 60.6
Photo 60.6
Sport 56
Sports 56

Clarifai
created on 2023-10-29

people 99.9
portrait 99.8
monochrome 99.7
man 99
adult 98.6
two 97.4
facial expression 95.6
one 95.6
actor 94.4
black and white 93.1
music 91.3
sepia 91
wear 88.4
furniture 87.7
sit 86.7
wedding 81.8
musician 81.4
writer 80.4
retro 80.1
leader 79.4

Imagga
created on 2022-03-05

person 41.8
male 37.9
man 37
home 36.7
people 32.4
senior 31
adult 27.5
grandma 27
indoors 26.4
adolescent 24.4
portrait 24
happy 21.3
juvenile 20.6
mature 20.5
smiling 19.6
lifestyle 18.8
sitting 18.1
clothing 17
elderly 16.3
grandfather 15.5
casual 15.3
old 14.6
retired 14.6
patient 14.4
mother 13.9
camera 13.9
looking 13.6
dad 13.5
face 13.5
professional 13.3
health 13.2
nurse 13.2
couple 13.1
garment 12.9
smile 12.8
retirement 12.5
father 12.2
computer 12
70s 11.8
half length 11.7
color 11.7
mid adult 11.6
family 11.6
parent 11.5
medical 11.5
office 11.3
inside 11.1
hospital 11
happiness 11
bathrobe 10.9
two people 10.7
older 10.7
businessman 10.6
one 10.5
room 10.2
occupation 10.1
horizontal 10.1
relaxing 10
aged 10
child 9.9
business 9.7
bow tie 9.7
necktie 9.7
together 9.6
vertical 9.6
men 9.5
day 9.4
relaxed 9.4
house 9.2
20s 9.2
alone 9.1
indoor 9.1
laptop 9.1
human 9
handsome 8.9
seniors 8.8
medicine 8.8
women 8.7
illness 8.6
talking 8.6
doctor 8.5
shirt 8.4
lab coat 8.2
job 8
coat 8
robe 7.9
seventies 7.9
work 7.9
boy 7.8
standing 7.8
seated 7.8
student 7.8
bed 7.6
monk 7.5
care 7.4
single 7.4
cheerful 7.3
black 7.2
hair 7.1
daughter 7.1
chair 7
modern 7
attractive 7

Google
created on 2022-03-05

Sleeve 87.2
Gesture 85.3
Collar 84.1
Dress shirt 82.4
Blazer 76.7
Vintage clothing 70.2
Formal wear 69.5
Monochrome photography 65.2
Monochrome 64.4
Chest 63.4
Sitting 62.9
Suit 61.1
Tie 60.3
Room 60.1
Portrait 58.3
White-collar worker 57.3
Elbow 56.1
Portrait photography 55.8
Wrist 55.6
Art 51.8

Microsoft
created on 2022-03-05

person 99.9
wall 99.6
indoor 97.5
human face 96.1
man 93.8
clothing 93.4
text 90.2
portrait 74.8
watch 61.4
black and white 61
old 56.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 56-64
Gender Male, 100%
Calm 65.1%
Angry 12.7%
Sad 7.1%
Confused 5.7%
Disgusted 5%
Surprised 2.6%
Fear 1%
Happy 0.7%

Microsoft Cognitive Services

Age 61
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 98.5%

Categories

Imagga

paintings art 95.8%
people portraits 4.1%