Human Generated Data

Title

Untitled (man and woman in formal attire, coats)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16366

Human Generated Data

Title

Untitled (man and woman in formal attire, coats)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Apparel 99.8
Clothing 99.8
Overcoat 96.8
Coat 96.4
Human 95.9
Person 95.9
Person 88.5
Door 86.9
Suit 86.6
Sleeve 85.8
Long Sleeve 72
Floor 68.3
Tuxedo 68.1
Shirt 66
Furniture 60
Chair 60

Imagga
created on 2022-02-11

coat 57.2
lab coat 54.6
nurse 46.7
doctor 43.3
man 43
male 41.9
professional 39.1
medical 36.2
hospital 33.3
person 32
people 31.8
happy 30.1
adult 29.7
job 28.3
garment 27.1
medicine 26.4
stethoscope 25.9
smile 24.9
portrait 24.6
health 24.3
clinic 23.3
business 22.5
office 21.7
businessman 21.2
smiling 21
looking 20
clothing 19.9
corporate 19.8
suit 19.8
care 19.8
occupation 19.3
confident 18.2
work 18.1
men 18
handsome 17.8
worker 17.2
uniform 17.2
team 17
practitioner 17
patient 16.9
mature 16.7
doctors 16.7
profession 16.3
working 15.9
standing 15.7
attractive 15.4
happiness 14.9
teamwork 14.8
friendly 14.6
success 14.5
executive 14.2
career 14.2
lifestyle 13.7
physician 13.7
staff 13.6
bright 13.6
women 13.4
senior 13.1
successful 12.8
two 12.7
clinical 12.7
elderly 12.4
camera 12
home 12
specialist 11.8
consultant 11.7
businesspeople 11.4
couple 11.3
group 11.3
human 11.3
building 11.1
30s 10.6
cheerful 10.6
partnership 10.6
look 10.5
day 10.2
indoor 10
businesswoman 10
examination 9.7
lab 9.7
one 9.7
indoors 9.7
partner 9.7
employee 9.7
laboratory 9.6
room 9.6
illness 9.5
casual 9.3
face 9.2
old 9.1
black 9
surgeon 8.9
color 8.9
diagnosis 8.8
student 8.8
together 8.8
mid adult 8.7
exam 8.6
confidence 8.6
tie 8.5
modern 8.4
pretty 8.4
manager 8.4
positive 8.3
holding 8.3
girls 8.2
science 8
hair 7.9
medic 7.8
expertise 7.8
sick 7.7
formal 7.6
ethnic 7.6
guy 7.6
healthy 7.6
meeting 7.5
company 7.4
glasses 7.4
natural 7.4
lady 7.3
family 7.1
bathrobe 7.1

Google
created on 2022-02-11

Coat 91.7
Overcoat 91
Sleeve 87.2
Gesture 85.3
Collar 84
Suit trousers 83.8
Frock coat 83.6
Black-and-white 82.6
Trench coat 81.1
Duster 79.9
Blazer 78.3
Suit 78.1
Formal wear 76.5
Vintage clothing 74.8
Fashion design 74.1
Smile 73.4
Tie 70.4
Monochrome photography 69.5
Art 68.6
Monochrome 67.5

Microsoft
created on 2022-02-11

man 97.8
clothing 95.1
person 92.9
standing 89.8
suit 87.8
posing 83
text 74.1
black and white 73.5

Face analysis

Amazon

Google

AWS Rekognition

Age 23-33
Gender Male, 100%
Happy 80.7%
Angry 7.9%
Sad 3.8%
Disgusted 2.9%
Surprised 1.6%
Calm 1.3%
Confused 1%
Fear 0.7%

AWS Rekognition

Age 38-46
Gender Male, 97.6%
Happy 88.5%
Surprised 6.4%
Sad 1.6%
Calm 1.2%
Confused 0.8%
Disgusted 0.6%
Angry 0.5%
Fear 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Coat 96.4%
Person 95.9%
Suit 86.6%

Captions

Microsoft

a man standing in front of a mirror posing for the camera 86.9%
a man that is standing in front of a mirror posing for the camera 79.8%
a man is standing in front of a mirror posing for the camera 79.7%

Text analysis

Amazon

38
معد

Google

38
38