Human Generated Data

Title

Joost Schmidt at a Costume Party
Date

c. 1929
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Howard Dearstyne, BR50.20

Human Generated Data

Title

Joost Schmidt at a Costume Party

People

Artist: Unidentified Artist,

Date

c. 1929

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Howard Dearstyne, BR50.20

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 100
Face 100
Person 98.7
Beard 94.1
Photography 73.8
Photo 73.8
Portrait 73.8
Head 73.8
Text 68.5
Art 65.5
Man 60.8
Drawing 58.8
Sleeve 56
Clothing 56
Apparel 56

Clarifai
created on 2023-10-25

portrait 99.9
people 99.9
one 99.8
adult 98.9
man 98.4
art 97.3
facial hair 97.2
wear 97.2
mustache 94.6
facial expression 94.5
outerwear 91.6
leader 91.4
music 90
painting 89.9
administration 89.6
side view 89.2
profile 89.2
print 88.3
eyewear 82.8
street 82.6

Imagga
created on 2022-01-09

man 50.4
male 44.5
mug shot 44.4
person 37
photograph 35.4
portrait 34.3
adult 29.2
face 29.1
people 28.5
expression 28.2
representation 27
handsome 24.1
suit 24
businessman 21.2
serious 21
guy 20.8
bow tie 20.6
head 20.2
black 20.1
looking 19.2
business 18.8
human 18.8
creation 18.1
look 17.5
model 17.1
necktie 16.9
attractive 16.8
one 16.4
call 16.4
hair 15.9
beard 15.8
smile 15
tie 14.2
boy 14.1
corporate 13.8
mature 13
eyes 12.9
professional 12.8
work 12.6
lifestyle 12.3
senior 12.2
hand 12.2
old 11.9
dark 11.7
skin 11.5
office 11.3
casual 11
confident 10.9
happy 10.7
sad 10.6
fashion 10.6
modern 10.5
nose 10.5
success 10.5
executive 10.4
men 10.3
youth 10.2
gray 9.9
masculine 9.7
job 9.7
health 9.7
close 9.7
sexy 9.6
body 9.6
emotion 9.2
garment 9.1
pensive 8.8
angry 8.8
depression 8.8
hands 8.7
smiling 8.7
stress 8.6
shirt 8.5
glasses 8.3
eye 8
mustache 7.9
child 7.9
juvenile 7.8
pretty 7.7
facial 7.7
clothing 7.6
career 7.6
adolescent 7.5
computer 7.3
cute 7.2
world 7.1

Google
created on 2022-01-09

Jaw 88.1
Art 84.9
Beard 81.3
Facial hair 80.2
Moustache 77.1
Suit 75.2
Self-portrait 71.3
Collar 70.5
Visual arts 68.2
Font 66.9
Vintage clothing 66.5
Blazer 64
Monochrome photography 63.3
Room 62.6
History 61
Illustration 60.8
Monochrome 60.4
Rectangle 59.8
Portrait 54.5
Portrait photography 53.6

Microsoft
created on 2022-01-09

wall 99.9
human face 99.2
person 98.6
text 98
man 96.1
indoor 95.5
portrait 92.5
mirror 90.3
clothing 90
black and white 79.9
old 60.7
reflection 56.5
sketch 53.5
staring 21.3
picture frame 10.1

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 43-51
Gender Male, 99.8%
Fear 61.4%
Surprised 10.7%
Sad 10.2%
Disgusted 5.9%
Calm 5.7%
Angry 2.5%
Happy 2.1%
Confused 1.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%

Categories

Imagga

people portraits 52.7%
paintings art 40.9%
pets animals 5%