Human Generated Data

Title

Untitled (man with saxophone and singer at prom dance)

Date

c. 1950

People

Artist: John Deusing, American active 1940s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1527

Human Generated Data

Title

Untitled (man with saxophone and singer at prom dance)

People

Artist: John Deusing, American active 1940s

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99
Human 99
Person 96.3
Leisure Activities 93.4
Saxophone 85.8
Musical Instrument 85.8
Clothing 84.6
Apparel 84.6
Guitar 82.8
Suit 78.7
Coat 78.7
Overcoat 78.7
Tie 78.2
Accessory 78.2
Accessories 78.2
Person 76.9
Person 74.4
Clinic 74.1
People 60.1
Interior Design 59.9
Indoors 59.9
Long Sleeve 56.2
Sleeve 56.2

Imagga
created on 2021-12-14

professional 41.9
person 36.7
adult 35.6
male 35.5
man 33.6
businessman 32.7
doctor 32
people 31.8
hospital 30.3
business 29.8
coat 29.6
medical 29.1
office 28.9
job 28.3
happy 25.1
lab coat 24.6
indoors 24.6
corporate 24.1
health 23.6
looking 21.6
work 21.2
medicine 21.1
occupation 21.1
clinic 21.1
businesspeople 20.9
portrait 20.7
care 20.6
smiling 19.5
indoor 19.2
casual 18.7
mature 18.6
nurse 18.6
smile 18.5
colleagues 18.5
attractive 18.2
desk 18
worker 17.8
handsome 17.8
computer 17.6
stethoscope 17.6
clothing 17.6
uniform 17.4
businesswoman 17.3
men 17.2
secretary 16.4
associates 15.7
confident 15.5
group 15.3
team 15.2
meeting 15.1
bright 15
face 14.9
teamwork 14.8
20s 14.7
suit 14.5
patient 14.2
color 13.9
table 13.9
clinical 13.7
room 13
successful 12.8
laptop 12.8
day 12.6
profession 12.4
brass 12.4
cheerful 12.2
manager 12.1
ruler 12
modern 11.9
building 11.9
wind instrument 11.7
consultant 11.7
lifestyle 11.6
practitioner 11.4
success 11.3
one 11.2
horizontal 10.9
coworkers 10.8
executive 10.8
businessmen 10.7
examination 10.7
cooperation 10.6
corporation 10.6
working 10.6
happiness 10.2
employee 10.1
clipboard 10.1
treatment 10.1
doctors 9.8
healing 9.8
good mood 9.8
surgeon 9.8
laboratory 9.6
30s 9.6
specialist 9.6
exam 9.6
entrepreneur 9.5
light 9.4
senior 9.4
hand 9.1
human 9
healthy 8.8
diagnosis 8.8
25 30 years 8.8
together 8.8
expertise 8.7
mid adult 8.7
1 8.7
sitting 8.6
only 8.6
career 8.5
two 8.5
clothes 8.4
shirt 8.4
writing 8.3
focus 8.3
camera 8.3
holding 8.3
life 8.1
jacket 8
home 8
general practitioner 7.9
discussing 7.9
heal 7.9
musical instrument 7.8
standing 7.8
physician 7.8
40s 7.8
lab 7.8
busy 7.7
pretty 7.7
elderly 7.7
chart 7.7
formal 7.6
serious 7.6
illness 7.6
ethnic 7.6
adults 7.6
metropolitan 7.3
friendly 7.3
teacher 7.3
alone 7.3
black 7.2
garment 7.2
cornet 7.1

Microsoft
created on 2021-12-14

text 97.1
man 94.5
musical instrument 82.8
wedding 81.9
old 75.3
black and white 71.6
concert 69.7
clothing 67.9
person 67.1
posing 58.9

Face analysis

Amazon

Google

AWS Rekognition

Age 47-65
Gender Male, 83.4%
Surprised 87.3%
Calm 4.5%
Confused 4%
Fear 1.7%
Happy 1.1%
Sad 0.7%
Angry 0.5%
Disgusted 0.1%

AWS Rekognition

Age 39-57
Gender Male, 98.2%
Happy 35.4%
Surprised 29.2%
Calm 24.9%
Fear 4.2%
Sad 2.8%
Confused 1.6%
Disgusted 1.5%
Angry 0.4%

AWS Rekognition

Age 10-20
Gender Female, 51.6%
Calm 54.2%
Happy 26.2%
Sad 17.6%
Confused 0.8%
Angry 0.6%
Disgusted 0.2%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 29-45
Gender Female, 64%
Sad 69.2%
Fear 14.5%
Calm 8.8%
Surprised 3%
Happy 2.9%
Confused 1%
Angry 0.4%
Disgusted 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Guitar 82.8%
Tie 78.2%

Captions

Microsoft

a vintage photo of a man 90.5%
a vintage photo of a group of people posing for the camera 83.9%
a vintage photo of a group of people posing for a picture 83.8%

Text analysis

Amazon

12
Y

Google

12
12