Human Generated Data

Title

Untitled (portrait of an older man and woman)

Date

1944

People

Artist: John Deusing, American active 1940s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1673

Human Generated Data

Title

Untitled (portrait of an older man and woman)

People

Artist: John Deusing, American active 1940s

Date

1944

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 98.8
Human 98.8
Person 98.5
Tie 97.4
Accessories 97.4
Accessory 97.4
Apparel 97.1
Clothing 97.1
Face 90.8
Glasses 88.9
Sleeve 79.3
Finger 70.4
Portrait 70.3
Photo 70.3
Photography 70.3
Senior Citizen 69.4
Shirt 68.2
Coat 68.1
People 66.6
Female 66.1
Head 65.6
Overcoat 63.5
Necklace 59.6
Jewelry 59.6
Suit 51.6

Imagga
created on 2021-12-14

man 50.4
coat 49.7
lab coat 49.2
person 44.6
doctor 42.3
male 41.2
professional 40.7
groom 40
medical 37.1
people 34.6
medicine 30.8
hospital 30.1
adult 29
portrait 27.8
happy 27.6
looking 27.2
stethoscope 26.9
businessman 26.5
care 25.5
senior 24.4
elderly 23.9
health 23.6
smiling 23.2
job 23
occupation 22.9
smile 22.8
office 21.7
clinic 21.1
uniform 20.9
business 20.7
mature 20.5
confident 20
garment 19.5
work 18.8
face 18.5
specialist 18.2
laboratory 17.4
suit 16.3
patient 16.3
team 16.1
nurse 15.9
glasses 15.7
executive 15.7
tie 15.2
working 15
lab 14.6
worker 14.4
handsome 14.3
couple 13.9
men 13.7
success 13.7
exam 13.4
practitioner 13.3
holding 13.2
teamwork 13
successful 12.8
expression 12.8
necktie 12.6
old 12.5
look 12.3
clothing 12.1
attractive 11.9
women 11.9
expertise 11.6
profession 11.5
cheerful 11.4
human 11.3
student 10.9
lifestyle 10.8
examination 10.7
illness 10.5
corporate 10.3
two 10.2
chemical 10.1
friendly 10.1
health care 9.7
hair 9.5
wife 9.5
bow tie 9
science 8.9
examining 8.8
clinical 8.8
husband 8.7
test 8.7
surgeon 8.6
talking 8.6
grandma 8.4
shirt 8.4
hand 8.4
indoor 8.2
aged 8.1
lady 8.1
computer 8
family 8
to 8
indoors 7.9
together 7.9
chemist 7.9
doctors 7.9
medic 7.8
scientist 7.8
diagnosis 7.8
standing 7.8
consultant 7.8
older 7.8
pretty 7.7
casual 7.6
research 7.6
businesspeople 7.6
guy 7.5
one 7.5
manager 7.5
phone 7.4
laptop 7.3
cute 7.2
grandfather 7

Google
created on 2021-12-14

Microsoft
created on 2021-12-14

man 98.9
person 98.7
posing 98.4
text 96.3
human face 95.1
smile 92.8
wedding dress 91.2
bride 90.4
standing 86.2
wedding 75.6
clothing 74.5
black 69.4
ceremony 62.3
old 44.2

Face analysis

Amazon

Google

AWS Rekognition

Age 49-67
Gender Male, 97.7%
Calm 75.8%
Surprised 6.7%
Fear 5.8%
Sad 4.6%
Angry 3%
Happy 2%
Confused 1.4%
Disgusted 0.6%

AWS Rekognition

Age 47-65
Gender Male, 80.4%
Calm 76.5%
Surprised 10.3%
Happy 5.9%
Confused 2.9%
Fear 1.5%
Angry 1.2%
Sad 1.1%
Disgusted 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Tie 97.4%
Glasses 88.9%
Suit 51.6%

Captions

Microsoft

a man standing in front of a mirror posing for the camera 89.9%
a group of people standing in front of a mirror posing for the camera 86.4%
a couple of men standing in front of a mirror posing for the camera 81%

Text analysis

Amazon

6033
YT37A2
MJI3
MJI3 YT37A2 ALSAL
EE
EE of
ALSAL
of

Google

6033
YT33A2
MJI7 YT33A2 032MA 6033
032MA
MJI7