Human Generated Data

Title

Untitled (two men shaking hands with 3M company award)
Date

c. 1950
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3204

Human Generated Data

Title

Untitled (two men shaking hands with 3M company award)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Clothing 99.3
Apparel 99.3
Human 97.6
Person 97.6
Person 97.2
Clinic 96.7
Coat 95.8
Lab Coat 95.8
Tie 92.5
Accessories 92.5
Accessory 92.5
Hospital 87.9
Suit 80.3
Overcoat 80.3
Operating Theatre 63.7
Shirt 62.6
Scientist 62.3
Tie 60
Lab 59.7

Imagga
created on 2022-01-22

lab coat 100
coat 100
garment 51.6
man 51.2
male 39.1
person 37.5
adult 35.1
professional 35
people 34.1
doctor 33
clothing 31.6
office 31.4
businessman 30.1
work 29.1
medical 28.3
specialist 28.1
business 27.4
men 24.9
hospital 24.5
colleagues 24.3
team 24.2
patient 23.7
happy 23.2
job 23
businesspeople 22.8
clinic 22.4
desk 21.8
indoors 21.1
smiling 21
medicine 20.3
portrait 20.1
meeting 19.8
corporate 19.8
sitting 19.8
mature 19.6
working 19.5
occupation 19.3
looking 19.2
laptop 19.2
health 18.8
senior 18.8
casual 18.7
indoor 18.3
worker 17.9
face 17.8
computer 17.7
teamwork 17.6
women 17.4
table 17.3
care 17.3
businesswoman 17.3
confident 16.4
group 16.2
handsome 16.1
together 15.8
associates 15.8
uniform 15.2
executive 14.7
color 14.5
practitioner 14.3
talking 14.3
modern 14
lifestyle 13.8
laboratory 13.5
elderly 13.4
bright 12.9
coworkers 12.8
suit 12.6
attractive 12.6
mid adult 12.6
30s 12.5
surgeon 12.3
smile 12.1
20s 11.9
two 11.9
room 11.9
doctors 11.8
40s 11.7
lab 11.7
serious 11.5
ethnic 11.4
couple 11.3
expression 11.1
student 10.9
discussion 10.7
employee 10.6
exam 10.6
illness 10.5
success 10.5
technology 10.4
pharmacist 10.4
education 10.4
home 10.4
manager 10.3
treatment 10.1
horizontal 10.1
diagnosis 9.8
scientist 9.8
clinical 9.8
expertise 9.7
cooperation 9.7
busy 9.7
hand 9.1
old 9.1
human 9
science 8.9
general practitioner 8.9
explaining 8.9
to 8.9
stethoscope 8.8
businessmen 8.8
consultant 8.8
look 8.8
2 8.7
nurse 8.7
test 8.7
day 8.6
happiness 8.6
profession 8.6
formal 8.6
glasses 8.3
successful 8.3
light 8
30 35 years 7.9
discussing 7.9
healing 7.9
25 30 years 7.8
standing 7.8
conference 7.8
colleague 7.8
visit 7.8
middle aged 7.8
two people 7.8
assistant 7.8
chemistry 7.7
using 7.7
staff 7.7
research 7.6
communication 7.6
health professional 7.6
study 7.5
company 7.5
camera 7.4
inside 7.4

Google
created on 2022-01-22

White coat 91.3
Health care provider 89.8
Health care 87.8
Sleeve 87.2
Gesture 85.3
Black-and-white 84.5
Style 83.8
Collar 83.6
Medical 83.4
Dress shirt 79.5
Research 78.6
Eyewear 76.7
Medical assistant 76.4
Science 75.9
Service 75.8
Nurse uniform 75.1
Monochrome photography 71.6
Uniform 71.6
Workwear 71.5
Event 71.3

Microsoft
created on 2022-01-22

person 98.9
man 98.7
text 97.6
standing 90.5
clothing 88
computer 72.2
medical equipment 55.2
suit 55.1
dressed 27.8

Face analysis

Amazon

Google

AWS Rekognition

Age 48-56
Gender Male, 99.5%
Calm 83.5%
Surprised 6.1%
Happy 3.4%
Confused 2.7%
Fear 1.7%
Sad 1.5%
Disgusted 0.7%
Angry 0.3%

AWS Rekognition

Age 48-54
Gender Male, 96.4%
Calm 91.1%
Happy 3.1%
Sad 2%
Confused 1.2%
Surprised 1.1%
Angry 0.5%
Disgusted 0.5%
Fear 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.6%
Tie 92.5%
Suit 80.3%

Captions

Microsoft

a man and a woman standing in front of a box 83.1%
a person standing in front of a box 83%
a person standing in front of a mirror posing for the camera 74.3%

Text analysis

Amazon

AGE
com
AG
30
3m AG
3m
KODAK--EOVEELAIW

Google

AGE 3M AG 30 Com KODVK-
3M
KODVK-
AGE
30
Com
AG