Human Generated Data

Title

Untitled (portrait of a couple, the Antones)
Date

c. 1940
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.445

Human Generated Data

Title

Untitled (portrait of a couple, the Antones)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Clothing 99.9
Apparel 99.9
Overcoat 99.6
Accessory 98.9
Tie 98.9
Accessories 98.9
Coat 98.9
Human 97
Person 96.7
Person 92
Female 90.4
Suit 88.3
Tuxedo 83.7
Woman 81.3
Man 70.4
Floor 61
Dress 58.5

Imagga
created on 2022-01-23

suit 100
garment 91.5
clothing 65.1
businessman 60.1
man 49.1
business 46.8
male 41.9
consumer goods 40.4
covering 40.2
executive 39.1
corporate 37.8
professional 35.2
office 34.6
standing 33.9
adult 33.2
success 32.2
person 31.9
people 30.7
bow tie 29.8
happy 28.2
successful 27.5
confident 27.3
businesswoman 27.3
portrait 25.3
attractive 25.2
businesspeople 24.7
work 24.4
smile 24.3
handsome 24.1
necktie 24
job 23.9
smiling 23.9
tie 21.8
teamwork 21.3
men 20.6
team 20.6
building 19.9
worker 19.6
black 19.6
boss 17.2
looking 16.8
company 16.8
colleagues 16.5
meeting 16
manager 15.8
human 15.8
holding 15.7
businessmen 15.6
20s 15.6
partnership 15.4
group 14.5
happiness 14.1
modern 14
guy 13.7
commodity 13.6
fashion 13.6
confidence 13.4
formal 13.4
pretty 13.3
career 13.3
jacket 13.2
cheerful 13
friendly 12.8
expression 12.8
elegant 12
style 11.9
casual 11.9
model 11.7
talking 11.4
face 10.7
partner 10.6
leadership 10.6
staff 10.5
together 10.5
workplace 10.5
women 10.3
lifestyle 10.1
employee 10.1
communication 10.1
alone 10.1
colleague 9.8
partners 9.7
corporation 9.7
30s 9.6
smart 9.4
commerce 9.3
bright 9.3
hand 9.1
businesswomen 8.8
businessperson 8.8
leader 8.7
shirt 8.4
full 8.2
one 8.2
lady 8.1
briefcase 8
salesman 7.9
look 7.9
associates 7.9
coworkers 7.9
day 7.9
diverse 7.8
40s 7.8
workers 7.8
two 7.6
student 7.6
secretary 7.5
phone 7.4
occupation 7.3
posing 7.1
working 7.1
indoors 7

Google
created on 2022-01-23

Suit trousers 97.8
Outerwear 95.1
Shoe 94.6
Sleeve 87.2
Standing 86.4
Collar 84
Curtain 79
Suit 78.5
Blazer 78.3
Formal wear 77.7
White-collar worker 75.6
Vintage clothing 72.7
Overcoat 71.7
Monochrome photography 71.2
Fashion design 70.3
Event 68.5
Monochrome 67.4
Classic 66.8
Uniform 64.5
Pattern 60.8

Microsoft
created on 2022-01-23

person 99.7
clothing 95.6
standing 94.8
smile 94.5
posing 86.5
suit 79
black and white 78.9
coat 77.6
tie 76.5
human face 76.4
dress 64.4
man 58.8
formal wear 50.6
gentleman 50.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 25-35
Gender Female, 99.9%
Happy 69.4%
Calm 23%
Disgusted 2.3%
Surprised 1.7%
Confused 1.4%
Angry 1%
Sad 0.6%
Fear 0.6%

AWS Rekognition

Age 41-49
Gender Male, 100%
Happy 99.6%
Calm 0.2%
Confused 0.1%
Surprised 0.1%
Angry 0%
Disgusted 0%
Sad 0%
Fear 0%

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 43
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 98.9%
Coat 98.9%
Person 96.7%
Suit 88.3%

Captions

Microsoft

a person standing in front of a group of people posing for a photo 93.3%
a man and woman posing for a photo 92%
a man and a woman posing for a photo 91.9%