Human Generated Data

Title

Untitled (four men in suits chatting at shoe company get-together)

Date

1951

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9431

Human Generated Data

Title

Untitled (four men in suits chatting at shoe company get-together)

People

Artist: Martin Schweig, American 20th century

Date

1951

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Clothing 99.5
Apparel 99.5
Person 98.6
Human 98.6
Person 98
Person 97.4
Person 96.5
Person 94.8
Person 94.5
Lab Coat 94
Coat 94
Person 93.9
Tie 93
Accessory 93
Accessories 93
Clinic 91.2
Suit 65.9
Overcoat 65.9
Shirt 65.2
Hospital 58.4
Scientist 56.7

Imagga
created on 2022-01-23

nurse 100
doctor 64.9
medical 53.9
hospital 50.1
professional 46.3
man 45
stethoscope 42.8
person 41.7
medicine 41.4
job 38.1
care 37.9
male 37.6
clinic 37.5
health 36.1
people 35.7
uniform 35.6
occupation 33.9
happy 32.6
coat 30.5
team 30.5
smiling 29.7
specialist 28.9
adult 28.6
portrait 28.5
mature 27.9
practitioner 27.5
patient 27.1
business 26.7
doctors 26.5
working 26.5
confident 26.4
work 25.9
smile 24.9
clinical 24.4
worker 21.7
office 20.9
surgeon 20.4
golfer 19.9
men 18.9
handsome 18.7
teamwork 18.6
looking 18.4
lab coat 18.3
profession 18.2
group 17.7
laboratory 17.4
colleagues 16.5
practice 16.5
elderly 16.3
businessman 15.9
staff 15.5
30s 15.4
player 15.3
illness 15.3
senior 15
suit 14.8
successful 14.6
expertise 14.6
standing 13.9
healthy 13.9
success 13.7
consultant 13.6
women 13.4
exam 13.4
confidence 13.4
indoors 13.2
treatment 12.9
human 12.8
physician 12.7
lifestyle 12.3
contestant 12
clothing 11.8
intern 11.8
health care 11.7
sick 11.6
corporate 11.2
happiness 11
businesswoman 10.9
general practitioner 10.9
surgery 10.7
ill 10.7
lab 10.7
face 10.7
military uniform 10.4
meeting 10.4
20s 10.1
friendly 10.1
healing 9.8
attractive 9.8
cheerful 9.8
lady 9.7
businesspeople 9.5
bright 9.3
camera 9.2
color 8.9
general 8.8
heal 8.8
40s 8.8
examination 8.8
partnership 8.6
casual 8.5
old 8.4
positive 8.3
indoor 8.2
student 8.2
aged 8.1
clinician 7.9
look 7.9
expert 7.9
brunette 7.8
good mood 7.8
diagnosis 7.8
medication 7.8
discussion 7.8
assistant 7.8
older 7.8
workers 7.8
pharmacist 7.6
career 7.6
glasses 7.4
hair 7.1
together 7

Microsoft
created on 2022-01-23

person 98.6
text 97.6
man 92.5
clothing 92.2
standing 81.5
posing 70.2
clothes 20.6

Face analysis

Amazon

Google

AWS Rekognition

Age 51-59
Gender Male, 99.9%
Happy 49.6%
Surprised 39.5%
Calm 6%
Confused 2.1%
Disgusted 1.1%
Fear 0.7%
Sad 0.6%
Angry 0.3%

AWS Rekognition

Age 49-57
Gender Male, 99.9%
Happy 97.1%
Calm 0.8%
Surprised 0.7%
Confused 0.6%
Fear 0.3%
Disgusted 0.2%
Angry 0.2%
Sad 0.1%

AWS Rekognition

Age 33-41
Gender Male, 77.2%
Calm 79.4%
Surprised 9.3%
Happy 4.9%
Angry 4%
Disgusted 0.8%
Confused 0.7%
Fear 0.6%
Sad 0.3%

AWS Rekognition

Age 48-56
Gender Male, 99.6%
Sad 74.7%
Happy 19.9%
Confused 2.3%
Calm 1.4%
Angry 0.5%
Fear 0.5%
Surprised 0.4%
Disgusted 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%
Tie 93%
Suit 65.9%

Captions

Microsoft

a group of people posing for a photo 95.8%
a group of people posing for the camera 95.7%
a group of people posing for a picture 95.6%

Text analysis

Amazon

8
3
L
de L 8 3
de
13
KODAKEVLELA