Human Generated Data

Title

Untitled (man and woman in formal dress, standing, full-length, striped background)
Date

c. 1940
People

Artist: Michael Disfarmer, American 1884 - 1959
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Neal and Susan Yanofsky, 2006.274

Human Generated Data

Title

Untitled (man and woman in formal dress, standing, full-length, striped background)

People

Artist: Michael Disfarmer, American 1884 - 1959

Date

c. 1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Neal and Susan Yanofsky, 2006.274

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Clothing 99.8
Apparel 99.8
Standing 98
Human 98
Tie 97.6
Accessories 97.6
Accessory 97.6
Person 97.2
Suit 94.9
Shoe 92.7
Footwear 92.7
Person 90.6
Coat 90.2
Shoe 89.4
People 74.6
Door 70.7
Tuxedo 62.3
Sleeve 62
Portrait 60.4
Photography 60.4
Face 60.4
Photo 60.4
Floor 55.5
Overcoat 50.1

Clarifai
created on 2023-10-29

people 99.9
portrait 98.9
two 98.5
adult 96.7
group 96.3
man 95.9
three 95.1
administration 94.3
leader 92.8
wear 92.7
woman 87
retro 84.7
offspring 82.7
family 80.7
group together 78.8
chair 77.5
four 77
outfit 75.6
facial expression 75.2
actor 74.5

Imagga
created on 2022-03-05

suit 71.2
garment 46.6
clothing 45
man 43.7
male 40.5
businessman 35.3
person 33.8
business 31
adult 30
portrait 27.2
professional 26.7
coat 25.6
people 25.1
executive 24.5
trench coat 24.1
smiling 23.9
office 23.3
happy 23.2
job 23
smile 22.1
consumer goods 21.6
doctor 21.6
covering 21.4
uniform 21.2
handsome 20.5
corporate 19.8
raincoat 19.2
tie 19
medical 18.5
stethoscope 18.5
standing 18.3
confident 18.2
hospital 17.9
military uniform 17.8
senior 16.9
businesswoman 16.4
work 15.7
care 15.6
friendly 15.6
looking 15.2
medicine 15
face 14.9
jacket 14.9
occupation 14.7
team 14.3
happiness 14.1
health 13.9
attractive 13.3
mature 13
cheerful 13
men 12.9
success 12.9
worker 12.8
successful 12.8
casual 12.7
confidence 12.5
businesspeople 12.3
group 12.1
teamwork 12.1
mid adult 11.6
30s 11.5
couple 11.3
camera 11.1
20s 11
lifestyle 10.8
family 10.7
corporation 10.6
clinic 10.5
modern 10.5
career 10.4
building 10.3
manager 10.2
expression 10.2
company 10.2
nurse 9.9
indoors 9.7
profession 9.6
boss 9.6
color 9.5
alone 9.1
holding 9.1
old 9.1
human 9
working 8.8
home 8.8
40s 8.8
patient 8.7
partnership 8.7
necktie 8.6
staff 8.6
model 8.6
black 8.5
bow tie 8.5
meeting 8.5
practitioner 8.3
indoor 8.2
one 8.2
style 8.2
physician 7.8
middle aged 7.8
colleagues 7.8
expertise 7.8
check 7.7
leader 7.7
leadership 7.7
elderly 7.7
formal 7.6
only 7.6
hand 7.6
shirt 7.5
hair 7.1

Google
created on 2022-03-05

Clothing 98.7
Outerwear 95.3
Overcoat 91.4
Sleeve 87.2
Standing 86.4
Collar 84.1
Blazer 78.2
Suit 75.1
Vintage clothing 73.7
Frock coat 72.9
Formal wear 72.8
Classic 71.2
Uniform 66.6
Event 63.4
Duster 63.1
Stock photography 63.1
History 62.8
Chair 62
Pattern 57.1
Button 55.5

Microsoft
created on 2022-03-05

person 99.7
wall 99.2
standing 99.2
posing 98.3
suit 98
clothing 97.4
old 97
man 91.5
white 87
black 83.3
smile 82.1
coat 80.7
photograph 71.3
text 70.3
gentleman 52.9
vintage clothing 50.8
clothes 29
dressed 26.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 50-58
Gender Male, 100%
Calm 93.2%
Confused 6.5%
Angry 0.1%
Sad 0.1%
Happy 0.1%
Disgusted 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 54-64
Gender Female, 99.8%
Calm 52.9%
Happy 38.7%
Confused 5.2%
Angry 1%
Disgusted 0.7%
Surprised 0.6%
Sad 0.5%
Fear 0.3%

Microsoft Cognitive Services

Age 54
Gender Male

Microsoft Cognitive Services

Age 68
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie
Person
Shoe
Coat
Overcoat
Tie 97.6%
Person 97.2%
Person 90.6%
Shoe 92.7%
Shoe 89.4%
Coat 90.2%
Overcoat 50.1%

Categories

Imagga

paintings art 71.1%
streetview architecture 22.5%
people portraits 5.9%