Human Generated Data

Title

Untitled (three men in front of portrait)
Date

c. 1950
People

Artist: Lester Cole, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19633

Human Generated Data

Title

Untitled (three men in front of portrait)

People

Artist: Lester Cole, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Human 98.6
Person 98.6
Accessory 96.9
Tie 96.9
Accessories 96.9
Person 96.4
Person 95.9
Clinic 95.1
Clothing 94.3
Apparel 94.3
Hospital 86.8
Person 86.7
Tie 84.8
Coat 72.8
Lab Coat 59.7
Operating Theatre 59.1
Door 55.8

Imagga
created on 2022-03-05

lab coat 60
coat 50.6
man 45.7
male 41.2
professional 37.8
doctor 36.7
person 34.1
adult 33.5
people 33.5
businessman 32.7
business 31.6
medical 30.9
hospital 29.3
team 26
job 25.7
garment 25.5
worker 25.3
men 24.9
patient 23.9
office 23.4
colleagues 23.3
corporate 23.2
mature 22.3
portrait 22
happy 22
nurse 21.8
clothing 21.3
work 21.2
medicine 21.2
health 20.9
stethoscope 19.7
smiling 18.8
clinic 18.6
looking 18.4
occupation 18.4
specialist 17.9
care 17.3
profession 17.2
businesspeople 17.1
group 16.9
indoors 16.7
suit 16.4
30s 16.4
handsome 16.1
meeting 16
senior 15.9
waiter 15.9
executive 15.6
businesswoman 15.5
practitioner 15
teamwork 14.9
20s 14.7
40s 14.6
uniform 14.5
smile 14.3
working 14.2
employee 14
standing 13.9
associates 13.8
lifestyle 13.7
casual 13.6
women 13.5
attractive 13.3
bright 12.9
dining-room attendant 12.8
day 12.6
illness 12.4
indoor 11.9
laptop 11.9
confident 11.8
mid adult 11.6
elderly 11.5
staff 11.5
success 11.3
computer 11.2
modern 11.2
surgeon 11.1
color 11.1
camera 11.1
coworkers 10.8
lab 10.7
expertise 10.7
laboratory 10.6
ethnic 10.5
couple 10.5
desk 10.4
company 10.2
successful 10.1
businessmen 9.8
corporation 9.7
look 9.6
partnership 9.6
building 9.5
happiness 9.4
two 9.3
focus 9.3
student 9.2
horizontal 9.2
treatment 9.2
black 9
teacher 9
doctors 8.9
discussing 8.9
middle aged 8.8
thirties 8.8
diversity 8.7
confidence 8.6
serious 8.6
talking 8.6
adults 8.5
face 8.5
room 8.5
manager 8.4
human 8.3
baron 7.9
business people 7.9
together 7.9
forties 7.9
hands 7.8
clinical 7.8
physician 7.8
discussion 7.8
consultant 7.8
examination 7.8
assistant 7.8
sitting 7.7
four 7.7
exam 7.7
boss 7.7
formal 7.6
career 7.6
light 7.4
necktie 7.3
friendly 7.3
cheerful 7.3

Google
created on 2022-03-05

Coat 86.7
Standing 86.4
Gesture 85.3
Black-and-white 84.9
Style 83.9
Blazer 78.1
Formal wear 78.1
Suit 77.5
Sleeve 76.7
Font 76.1
Monochrome photography 75.8
Monochrome 75.7
Vintage clothing 73.4
White-collar worker 72.7
Fashion design 72.3
Event 70.3
Room 67
Uniform 66.3
Stock photography 65.1
Visual arts 54.3

Microsoft
created on 2022-03-05

wall 98.9
person 98.3
man 96
text 95.8
posing 94
standing 93.6
clothing 90
indoor 87.6
clothes 15.2

Face analysis

Amazon

Google

AWS Rekognition

Age 25-35
Gender Male, 98.8%
Calm 78.7%
Sad 8.7%
Surprised 5.3%
Angry 2.6%
Happy 1.8%
Disgusted 1%
Confused 1%
Fear 1%

AWS Rekognition

Age 53-61
Gender Female, 73.2%
Calm 99.9%
Disgusted 0%
Happy 0%
Confused 0%
Surprised 0%
Sad 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 38-46
Gender Male, 100%
Calm 53.9%
Happy 16.9%
Surprised 15%
Disgusted 5.9%
Confused 4.2%
Sad 1.9%
Angry 1.1%
Fear 1.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%
Tie 96.9%

Captions

Microsoft

a group of people posing for a photo 95.3%
a person standing in front of a group of people posing for a photo 89%
a group of people posing for the camera 88.9%

Text analysis

Amazon

7