Human Generated Data

Title

Untitled (couple in formal dress, standing, full-length)

Date

c. 1940

People

Artist: Michael Disfarmer, American 1884 - 1959

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Neal and Susan Yanofsky, 2006.281

Human Generated Data

Title

Untitled (couple in formal dress, standing, full-length)

People

Artist: Michael Disfarmer, American 1884 - 1959

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Clothing 99.7
Apparel 99.7
Human 99.4
Person 99.4
Person 99.1
Tie 92.8
Accessory 92.8
Accessories 92.8
Female 92.6
Shirt 83.7
Pants 81.5
Woman 81.2
Home Decor 79.2
Linen 79.2
Sleeve 78.8
Long Sleeve 78.8
People 74.5
Hat 74.3
Face 72
Dress 67.3
Photography 64.3
Portrait 64.3
Photo 64.3
Girl 64.2
Text 57.8

Imagga
created on 2022-03-05

nurse 60.1
man 35.6
male 34.9
happy 30.7
portrait 29.1
person 28.4
adult 26.3
people 26.2
standing 26.1
smiling 26.1
coat 24.8
couple 23.5
smile 21.4
lab coat 20.8
suit 19.2
clothing 18.6
camera 18.5
looking 18.4
business 18.2
garment 18.1
cheerful 17.9
doctor 17.9
businessman 17.7
indoors 17.6
attractive 17.5
confident 17.3
happiness 17.2
hospital 17.2
handsome 16.9
lifestyle 16.6
casual 16.1
men 15.5
home 15.2
women 15
medical 15
together 14.9
face 14.2
professional 13.5
30s 13.5
team 13.5
tie 13.3
family 12.5
senior 12.2
fashion 12.1
two 11.9
old 11.8
love 11.8
mid adult 11.6
care 11.5
confidence 11.5
group 11.3
health 11.1
hair 11.1
20s 11
job 10.6
color 10.6
office 10.5
mature 10.2
teamwork 10.2
friendly 10.1
businesswoman 10
doctors 9.8
clinic 9.8
guy 9.8
uniform 9.7
mother 9.6
brunette 9.6
elderly 9.6
patient 9.4
model 9.3
modern 9.1
stethoscope 8.9
medicine 8.8
worker 8.6
shirt 8.6
formal 8.6
black 8.4
pretty 8.4
holding 8.3
one 8.2
style 8.2
dress 8.1
life 8
look 7.9
colleagues 7.8
jacket 7.8
corporate 7.7
partnership 7.7
child 7.7
studio 7.6
executive 7.6
occupation 7.3
successful 7.3
indoor 7.3
room 7.3
day 7.1
outfit 7

Google
created on 2022-03-05

Trousers 96.1
Sleeve 87.2
Gesture 85.3
Collar 82.8
Vintage clothing 74.8
Blazer 73.3
Waist 72.6
Classic 71.3
Formal wear 65.8
Uniform 65.8
Chair 64.7
Fashion design 64.6
Event 63.7
Stock photography 61.6
History 61.4
Belt 60.3
Room 56.1
Hat 53.6
Retro style 52.7
Family 51.5

Microsoft
created on 2022-03-05

text 99.6
person 99.5
wall 99.2
standing 98.6
posing 98.4
clothing 97.9
woman 90.6
smile 90.5
human face 83.8
black 81.8
old 80.5
man 71.2
suit 62.5
vintage clothing 61.5
photograph 61
retro style 57.2
clothes 29

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-53
Gender Female, 99.5%
Calm 96.4%
Angry 1.7%
Surprised 0.4%
Confused 0.4%
Happy 0.3%
Disgusted 0.3%
Fear 0.3%
Sad 0.2%

AWS Rekognition

Age 45-51
Gender Male, 100%
Calm 100%
Happy 0%
Surprised 0%
Fear 0%
Confused 0%
Sad 0%
Angry 0%
Disgusted 0%

Microsoft Cognitive Services

Age 53
Gender Female

Microsoft Cognitive Services

Age 39
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Tie 92.8%
Hat 74.3%

Captions

Microsoft

a man and woman posing for a photo 90.5%
a man and a woman posing for a photo 90.4%
a person standing in front of a group of people posing for a photo 90.3%