Human Generated Data

Title

Untitled (man and woman in formal dress, standing, full-length, striped background)

Date

c. 1940

People

Artist: Michael Disfarmer, American 1884 - 1959

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Neal and Susan Yanofsky, 2006.274

Human Generated Data

Title

Untitled (man and woman in formal dress, standing, full-length, striped background)

People

Artist: Michael Disfarmer, American 1884 - 1959

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Clothing 99.8
Apparel 99.8
Standing 98
Human 98
Accessories 97.6
Tie 97.6
Accessory 97.6
Person 97.2
Suit 94.9
Shoe 92.7
Footwear 92.7
Person 90.6
Coat 90.2
Shoe 89.4
People 74.6
Door 70.7
Tuxedo 62.3
Sleeve 62
Portrait 60.4
Photography 60.4
Face 60.4
Photo 60.4
Floor 55.5
Overcoat 50.1

Imagga
created on 2022-03-05

suit 71.2
garment 46.6
clothing 45
man 43.7
male 40.5
businessman 35.3
person 33.8
business 31
adult 30
portrait 27.2
professional 26.7
coat 25.6
people 25.1
executive 24.5
trench coat 24.1
smiling 23.9
office 23.3
happy 23.2
job 23
smile 22.1
consumer goods 21.6
doctor 21.6
covering 21.4
uniform 21.2
handsome 20.5
corporate 19.8
raincoat 19.2
tie 19
medical 18.5
stethoscope 18.5
standing 18.3
confident 18.2
hospital 17.9
military uniform 17.8
senior 16.9
businesswoman 16.4
work 15.7
care 15.6
friendly 15.6
looking 15.2
medicine 15
face 14.9
jacket 14.9
occupation 14.7
team 14.3
happiness 14.1
health 13.9
attractive 13.3
mature 13
cheerful 13
men 12.9
success 12.9
worker 12.8
successful 12.8
casual 12.7
confidence 12.5
businesspeople 12.3
group 12.1
teamwork 12.1
mid adult 11.6
30s 11.5
couple 11.3
camera 11.1
20s 11
lifestyle 10.8
family 10.7
corporation 10.6
clinic 10.5
modern 10.5
career 10.4
building 10.3
manager 10.2
expression 10.2
company 10.2
nurse 9.9
indoors 9.7
profession 9.6
boss 9.6
color 9.5
alone 9.1
holding 9.1
old 9.1
human 9
working 8.8
home 8.8
40s 8.8
patient 8.7
partnership 8.7
necktie 8.6
staff 8.6
model 8.6
black 8.5
bow tie 8.5
meeting 8.5
practitioner 8.3
indoor 8.2
one 8.2
style 8.2
physician 7.8
middle aged 7.8
colleagues 7.8
expertise 7.8
check 7.7
leader 7.7
leadership 7.7
elderly 7.7
formal 7.6
only 7.6
hand 7.6
shirt 7.5
hair 7.1

Google
created on 2022-03-05

Clothing 98.7
Outerwear 95.3
Overcoat 91.4
Sleeve 87.2
Standing 86.4
Collar 84.1
Blazer 78.2
Suit 75.1
Vintage clothing 73.7
Frock coat 72.9
Formal wear 72.8
Classic 71.2
Uniform 66.6
Event 63.4
Duster 63.1
Stock photography 63.1
History 62.8
Chair 62
Pattern 57.1
Button 55.5

Microsoft
created on 2022-03-05

person 99.7
wall 99.2
standing 99.2
posing 98.3
suit 98
clothing 97.4
old 97
man 91.5
white 87
black 83.3
smile 82.1
coat 80.7
photograph 71.3
text 70.3
gentleman 52.9
vintage clothing 50.8
clothes 29
dressed 26.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 50-58
Gender Male, 100%
Calm 93.2%
Confused 6.5%
Angry 0.1%
Sad 0.1%
Happy 0.1%
Disgusted 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 54-64
Gender Female, 99.8%
Calm 52.9%
Happy 38.7%
Confused 5.2%
Angry 1%
Disgusted 0.7%
Surprised 0.6%
Sad 0.5%
Fear 0.3%

Microsoft Cognitive Services

Age 54
Gender Male

Microsoft Cognitive Services

Age 68
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 97.6%
Person 97.2%
Shoe 92.7%
Coat 90.2%
Overcoat 50.1%

Captions

Microsoft

a vintage photo of a man and woman posing for a picture 93%
a vintage photo of a man and a woman posing for a picture 92.9%
an old photo of a man and woman posing for a picture 92.8%