Human Generated Data

Title

Joost Schmidt at a Costume Party

Date

c. 1929

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Howard Dearstyne, BR50.20

Human Generated Data

Title

Joost Schmidt at a Costume Party

People

Artist: Unidentified Artist,

Date

c. 1929

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Face 100
Human 100
Person 98.7
Beard 94.1
Photography 73.8
Photo 73.8
Portrait 73.8
Head 73.8
Text 68.5
Art 65.5
Man 60.8
Drawing 58.8
Apparel 56
Clothing 56
Sleeve 56

Imagga
created on 2022-01-09

man 50.4
male 44.5
mug shot 44.4
person 37
photograph 35.4
portrait 34.3
adult 29.2
face 29.1
people 28.5
expression 28.2
representation 27
handsome 24.1
suit 24
businessman 21.2
serious 21
guy 20.8
bow tie 20.6
head 20.2
black 20.1
looking 19.2
business 18.8
human 18.8
creation 18.1
look 17.5
model 17.1
necktie 16.9
attractive 16.8
one 16.4
call 16.4
hair 15.9
beard 15.8
smile 15
tie 14.2
boy 14.1
corporate 13.8
mature 13
eyes 12.9
professional 12.8
work 12.6
lifestyle 12.3
senior 12.2
hand 12.2
old 11.9
dark 11.7
skin 11.5
office 11.3
casual 11
confident 10.9
happy 10.7
sad 10.6
fashion 10.6
modern 10.5
nose 10.5
success 10.5
executive 10.4
men 10.3
youth 10.2
gray 9.9
masculine 9.7
job 9.7
health 9.7
close 9.7
sexy 9.6
body 9.6
emotion 9.2
garment 9.1
pensive 8.8
angry 8.8
depression 8.8
hands 8.7
smiling 8.7
stress 8.6
shirt 8.5
glasses 8.3
eye 8
mustache 7.9
child 7.9
juvenile 7.8
pretty 7.7
facial 7.7
clothing 7.6
career 7.6
adolescent 7.5
computer 7.3
cute 7.2
world 7.1

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

wall 99.9
human face 99.2
person 98.6
text 98
man 96.1
indoor 95.5
portrait 92.5
mirror 90.3
clothing 90
black and white 79.9
old 60.7
reflection 56.5
sketch 53.5
staring 21.3
picture frame 10.1

Face analysis

Amazon

Google

AWS Rekognition

Age 43-51
Gender Male, 99.8%
Fear 61.4%
Surprised 10.7%
Sad 10.2%
Disgusted 5.9%
Calm 5.7%
Angry 2.5%
Happy 2.1%
Confused 1.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%

Captions

Microsoft

a man standing in front of a mirror 71.5%
a man standing in front of a mirror posing for the camera 58%
a man in front of a mirror 57.9%