Human Generated Data

Title

Untitled (man in suit flanked by two men in western wear with pistols)
Date

c. 1955
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2301

Human Generated Data

Title

Untitled (man in suit flanked by two men in western wear with pistols)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-30

Clothing 99.9
Apparel 99.9
Human 99.9
Person 99.9
Person 99.8
Accessories 99.4
Accessory 99.4
Tie 99.4
Coat 99
Lab Coat 99
Person 92.9
Clinic 92.3
Hat 83.1
Overcoat 75.3
Suit 75.3
Hospital 69.6
Operating Theatre 55

Imagga
created on 2022-01-30

person 43.3
male 42.6
man 41.7
professional 36.5
waiter 34.2
people 31.8
worker 30.3
medical 30
adult 28.8
doctor 28.2
business 27.9
office 27.3
businessman 26.5
dining-room attendant 25.9
men 25.8
patient 25.1
happy 24.4
employee 23.5
hospital 22.7
corporate 22.3
health 22.2
job 22.1
coat 21
smile 20.7
nurse 20.5
smiling 20.3
work 18.8
team 18.8
clothing 18.7
lab coat 18.6
portrait 18.1
mature 16.7
clinic 16.4
lifestyle 15.9
executive 15.8
teamwork 15.8
suit 15.5
women 15
medicine 15
standing 14.8
modern 14.7
stethoscope 14.6
profession 14.4
handsome 14.3
uniform 14.1
indoors 14.1
care 14
occupation 13.7
colleagues 13.6
looking 13.6
day 13.3
working 13.3
meeting 13.2
group 12.9
bright 12.9
case 12.8
casual 12.7
black 12.6
attractive 12.6
mid adult 12.5
ethnic 12.4
adults 12.3
practitioner 12.3
senior 12.2
success 12.1
human 12
two 11.9
surgeon 11.7
40s 11.7
sick person 11.1
20s 11
successful 11
happiness 11
businesswoman 10.9
teacher 10.7
room 10.6
30s 10.6
diversity 10.6
color 10.6
couple 10.5
businesspeople 10.4
life 10.2
confident 10
doctors 9.8
staff 9.7
building 9.7
corporation 9.7
manager 9.3
friendly 9.1
indoor 9.1
cheerful 8.9
together 8.8
full length 8.7
table 8.7
sitting 8.6
tie 8.5
career 8.5
desk 8.5
clothes 8.4
garment 8.4
one 8.2
laptop 8.2
associates 7.9
healing 7.8
diverse 7.8
hands 7.8
clinical 7.8
physician 7.8
education 7.8
lab 7.8
workers 7.8
laboratory 7.7
angle 7.7
partnership 7.7
company 7.4
guy 7.4
light 7.4
treatment 7.3
window 7.3
face 7.1
student 7

Google
created on 2022-01-30

Trousers 96.7
Hat 90.8
Sleeve 87.2
Gesture 85.3
Black-and-white 83
Blazer 78
Sun hat 75.2
Formal wear 73.9
Vintage clothing 71.9
Monochrome photography 71.9
Fedora 69.9
Uniform 69.1
Monochrome 68
Fashion design 64.6
Cap 62.6
White-collar worker 62.1
Stock photography 61.6
Suit 61.3
Room 59.6
Military person 57

Microsoft
created on 2022-01-30

clothing 97.4
man 94.9
text 94.7
person 94.5
standing 85
black and white 71.7
hat 59.5

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Male, 99.9%
Calm 97.4%
Sad 1.4%
Confused 0.4%
Surprised 0.2%
Angry 0.2%
Disgusted 0.2%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 49-57
Gender Male, 90.2%
Calm 53%
Sad 26.6%
Confused 13.2%
Angry 3.5%
Surprised 1.3%
Disgusted 1.1%
Happy 0.8%
Fear 0.7%

AWS Rekognition

Age 48-54
Gender Male, 90.7%
Calm 55.5%
Surprised 40.2%
Sad 3.2%
Confused 0.4%
Disgusted 0.3%
Fear 0.2%
Angry 0.2%
Happy 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%
Tie 99.4%
Hat 83.1%
Suit 75.3%

Captions

Microsoft

a group of people standing in front of a mirror posing for the camera 73.9%
a group of people standing in front of a window 73.8%
a group of men standing in front of a window 73.7%

Text analysis

Amazon

I
I I
NAGOY