Human Generated Data

Title

Untitled (portrait of a couple, the Antones)

Date

c. 1940

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.444

Human Generated Data

Title

Untitled (portrait of a couple, the Antones)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Apparel 99.9
Clothing 99.9
Coat 99.7
Overcoat 99.1
Human 98.3
Person 98.3
Person 95.2
Accessory 93.6
Tie 93.6
Accessories 93.6
Sleeve 92.9
Female 86.4
Tuxedo 83.8
Long Sleeve 81
Suit 80.1
Woman 74.9
Face 72.2
Door 70.8
Man 70.5
Standing 68.6
Shoe 64.2
Footwear 64.2
Photo 62.5
Photography 62.5
Portrait 62.5
Blazer 59.4
Jacket 59.4
Dress 58
Floor 57.8

Imagga
created on 2022-01-23

suit 100
garment 91.3
clothing 64.6
businessman 49.5
business 45.6
man 43.7
consumer goods 40.5
covering 40.3
professional 39.1
corporate 37
standing 36.5
male 36.2
office 34.6
businesswoman 34.6
people 33.5
executive 33.2
happy 32
adult 30.2
success 29
person 28.1
confident 27.3
team 26.9
handsome 25.9
black 25.3
attractive 25.2
bow tie 24.8
smiling 24.6
work 24.4
smile 24.3
teamwork 24.1
men 23.2
job 23
businesspeople 22.8
successful 22
necktie 21.6
building 21.4
group 20.2
portrait 20.1
worker 17
pretty 16.8
women 16.6
boss 16.3
meeting 16
company 15.8
businessmen 15.6
20s 15.6
colleagues 15.6
tie 15.2
holding 14.9
commodity 14.6
partnership 14.4
fashion 14.3
jacket 14.3
happiness 14.1
confidence 13.4
talking 13.3
career 13.3
couple 13.1
manager 13
looking 12.8
expression 12.8
partner 12.6
together 12.3
human 12
formal 11.5
cheerful 11.4
lady 11.4
smart 11.3
friendly 11
workers 10.7
working 10.6
leadership 10.6
ethnic 10.5
employee 10.2
lifestyle 10.1
occupation 10.1
guy 9.9
modern 9.8
corporation 9.7
diversity 9.6
staff 9.6
shirt 9.3
casual 9.3
two 9.3
communication 9.2
phone 9.2
style 8.9
businesswomen 8.8
secretary 8.8
indoors 8.8
30s 8.7
student 8.4
studio 8.4
briefcase 8
diverse 7.8
handshake 7.8
colleague 7.8
face 7.8
education 7.8
model 7.8
outside 7.7
collar 7.7
workplace 7.6
finance 7.6
one 7.5
love 7.1

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

person 98.7
clothing 97.8
standing 97.1
wall 96
coat 91.4
posing 91.2
man 91.1
smile 88.6
black 87.2
human face 82.9
tie 82.2
suit 81.8
black and white 70.8
gentleman 64.6
blazer 55.6
clothes 17.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 31-41
Gender Female, 100%
Calm 48.2%
Happy 47.9%
Confused 0.9%
Surprised 0.9%
Angry 0.7%
Sad 0.7%
Disgusted 0.4%
Fear 0.3%

AWS Rekognition

Age 41-49
Gender Male, 99.9%
Happy 99.8%
Confused 0.1%
Calm 0%
Surprised 0%
Disgusted 0%
Angry 0%
Sad 0%
Fear 0%

Microsoft Cognitive Services

Age 49
Gender Male

Microsoft Cognitive Services

Age 43
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Coat 99.7%
Person 98.3%
Tie 93.6%
Suit 80.1%

Captions

Microsoft

a man and woman posing for a photo 92.4%
a man and a woman posing for a photo 92.3%
a person standing in front of a group of people posing for a photo 92.2%