Human Generated Data

Title

Untitled (studio portrait of male drummer and accordion player)

Date

1968

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10048

Human Generated Data

Title

Untitled (studio portrait of male drummer and accordion player)

People

Artist: Martin Schweig, American 20th century

Date

1968

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Person 96
Human 96
Person 94.2
Musical Instrument 88.5
Accordion 87.7
Accessories 70.7
Accessory 70.7
Tie 70.7
Portrait 59.3
Photography 59.3
Face 59.3
Photo 59.3

Imagga
created on 2022-01-28

man 45.7
person 45.1
accordion 42.9
musical instrument 42
male 40.4
people 34
doctor 32.9
professional 32.8
keyboard instrument 31.9
medical 29.1
looking 28.8
adult 28.6
wind instrument 25.4
job 24.8
business 24.3
portrait 23.3
glasses 23.1
businessman 22.9
occupation 22.9
face 22.7
office 21.7
happy 21.3
health 20.1
clinic 20.1
mug shot 19.9
hospital 19.9
senior 19.7
work 19.6
mature 19.5
computer 19.5
working 19.4
elderly 19.1
handsome 18.7
medicine 18.5
men 18
old 17.4
smiling 17.4
laptop 17.3
patient 16.6
successful 16.5
businesspeople 16.1
worker 16
indoors 15.8
care 15.6
stethoscope 15.6
photograph 15.5
color 14.5
uniform 14.2
coat 13.7
confident 13.6
casual 13.6
one 13.4
profession 13.4
holding 13.2
student 13
smile 12.8
indoor 12.8
laboratory 12.5
desk 12.3
bright 12.1
representation 12.1
human 12
notebook 12
day 11.8
science 11.6
lab coat 11.4
success 11.3
corporate 11.2
sitting 11.2
practitioner 11
alone 11
executive 10.8
hand 10.8
concentration 10.6
mid adult 10.6
1 10.6
camera 10.2
lifestyle 10.1
clipboard 9.9
expertise 9.7
technology 9.6
busy 9.6
look 9.6
exam 9.6
serious 9.5
education 9.5
career 9.5
expression 9.4
grandfather 9.2
horizontal 9.2
modern 9.1
attractive 9.1
nurse 9
creation 9
physician 8.8
40s 8.8
colleagues 8.7
older 8.7
hair 8.7
instrument 8.6
staff 8.6
formal 8.6
only 8.6
workplace 8.6
smart 8.5
one person 8.5
shirt 8.4
focus 8.3
positive 8.3
treatment 8.3
20s 8.2
light 8
clothing 8
general practitioner 7.9
specialist 7.8
clinical 7.8
examination 7.8
lab 7.8
guy 7.7
research 7.6
studio 7.6
manager 7.4
cheerful 7.3
lady 7.3
room 7.3
group 7.3
team 7.2

Microsoft
created on 2022-01-28

Face analysis

Amazon

Google

AWS Rekognition

Age 47-53
Gender Male, 99.9%
Happy 97.4%
Surprised 1%
Fear 0.5%
Disgusted 0.4%
Confused 0.3%
Angry 0.2%
Calm 0.2%
Sad 0.1%

AWS Rekognition

Age 51-59
Gender Male, 100%
Happy 99.5%
Confused 0.1%
Surprised 0.1%
Sad 0.1%
Calm 0.1%
Angry 0.1%
Disgusted 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96%
Tie 70.7%

Captions

Microsoft

a man posing for a photo 82%
a man posing for a photo in front of a box 71.8%
a man posing in front of a box 71%

Text analysis

Amazon

3
a
>
cordovex
KOD
1

Google

3 a KOD
KOD
3
a