Human Generated Data

Title

Untitled (two boys in suits; one in grey coat, one in white coat)

Date

c. 1940

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.483

Human Generated Data

Title

Untitled (two boys in suits; one in grey coat, one in white coat)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Apparel 99.7
Clothing 99.7
Overcoat 98.8
Coat 98.8
Person 97.6
Human 97.6
Pants 95.4
Person 93.2
Footwear 85.5
Shoe 85.5
Man 83.2
Blazer 82.8
Jacket 82.8
Tuxedo 79.9
Suit 77.1
Accessories 71.5
Tie 71.5
Accessory 71.5
Sleeve 68.2
Door 67.2
Face 65.4
Shirt 63.9
People 63.6
Portrait 62.4
Photography 62.4
Photo 62.4
Shoe 52.2

Imagga
created on 2022-01-23

coat 48.1
trench coat 47.5
nurse 43.8
raincoat 37.9
man 36.3
male 34.1
garment 33.5
stethoscope 32
bow tie 31.4
adult 31.2
doctor 31
medical 30.9
people 30.7
person 30.4
happy 28.8
professional 27.2
necktie 26.8
smile 26.4
hospital 25.4
clothing 24.6
portrait 24.6
medicine 23.8
health 23.6
job 22.1
business 21.9
smiling 21.7
uniform 21.2
standing 20.9
care 19.8
suit 18.7
office 18.5
looking 18.4
senior 17.8
attractive 17.5
work 17.3
businessman 16.8
confident 16.4
lab coat 16.1
businesswoman 15.5
worker 14.8
friendly 14.6
lifestyle 14.5
clinic 14.4
elderly 14.4
mature 14
casual 13.6
jacket 13.6
face 13.5
happiness 13.3
practitioner 13.2
men 12.9
occupation 12.8
military uniform 12.7
team 12.5
handsome 12.5
confidence 12.5
profession 12.4
home 12
one 11.9
women 11.9
working 11.5
staff 11.5
illness 11.4
indoors 11.4
lady 11.4
career 11.4
camera 11.1
successful 11
physician 10.7
specialist 10.7
cheerful 10.6
group 10.5
old 10.5
hair 10.3
help 10.2
teamwork 10.2
20s 10.1
fashion 9.8
success 9.7
couple 9.6
businesspeople 9.5
healthy 9.4
human 9
instrument 8.9
family 8.9
doctors 8.8
medic 8.8
health care 8.7
mid adult 8.7
corporate 8.6
tie 8.5
executive 8.5
pretty 8.4
building 8
patient 8
guy 7.9
love 7.9
expertise 7.8
sick 7.7
grandma 7.6
females 7.6
company 7.4
medical instrument 7.3
alone 7.3
black 7.3
laptop 7.3
aged 7.2
color 7.2
posing 7.1
day 7.1
modern 7
together 7
look 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

person 99.8
wall 99.7
standing 99
posing 98.6
clothing 97.1
text 94
man 92.2
indoor 85.5
smile 73.5
suit 72.8
sketch 58.8
human face 58.3
old 56.9
boy 56.3
coat 55.8
dressed 53
photograph 51.7
gallery 50.3
clothes 48.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-12
Gender Male, 100%
Calm 99.9%
Happy 0.1%
Confused 0%
Disgusted 0%
Angry 0%
Surprised 0%
Sad 0%
Fear 0%

AWS Rekognition

Age 4-12
Gender Male, 73.5%
Calm 95.3%
Happy 4.2%
Confused 0.1%
Sad 0.1%
Surprised 0.1%
Angry 0.1%
Disgusted 0.1%
Fear 0%

Microsoft Cognitive Services

Age 5
Gender Male

Microsoft Cognitive Services

Age 6
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.6%
Shoe 85.5%
Suit 77.1%
Tie 71.5%

Captions

Microsoft

a man and woman posing for a photo 92.1%
a man and a woman posing for a photo 92%
a man and woman posing for a picture 91.9%