Human Generated Data

Title

Untitled (portrait of six men)

Date

c. 1940

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.474

Human Generated Data

Title

Untitled (portrait of six men)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.3
Person 99.3
Overcoat 98.9
Clothing 98.9
Suit 98.9
Coat 98.9
Apparel 98.9
Suit 98.8
Tie 98.2
Accessories 98.2
Accessory 98.2
Suit 97.3
Suit 97.1
Person 96.4
Suit 95.5
Person 95.3
Tie 95
Suit 94.2
Head 91.4
Tie 90.8
People 89.8
Jury 89.5
Person 87.7
Person 83
Jaw 82.6
Tie 81.1
Face 79.2
Person 78.4
Family 77.8
Tie 60.6
Sitting 59.2
Attorney 58
Photography 57.2
Photo 57.2
Portrait 56.2

Imagga
created on 2022-01-23

businessman 55.6
man 49.1
business 46.2
office 45
team 43
male 42.6
bow tie 39.9
businesswoman 36.4
corporate 35.2
necktie 35
suit 33.9
groom 33.8
businesspeople 33.2
people 32.9
men 32.6
executive 31.3
meeting 31.1
teamwork 30.6
person 30.5
group 29.8
professional 28.2
businessmen 26.3
colleagues 26.2
smiling 26.1
happy 25.1
partnership 24
adult 24
success 23.3
kin 23.1
work 21.2
manager 20.5
job 20.4
portrait 20.1
confident 20
garment 19
staff 18.2
tie 18
smile 17.8
coworkers 17.7
standing 17.4
worker 17.3
30s 17.3
secretary 17.2
partners 16.5
successful 16.5
corporation 16.4
leadership 16.3
expression 16.2
clothing 15.8
baron 15.6
boss 15.3
looking 15.2
handsome 15.2
occupation 14.7
career 14.2
mature 13.9
associates 13.8
40s 13.6
face 13.5
company 13
20s 12.8
cooperation 12.6
mid adult 12.5
working 12.4
desk 12.3
cheerful 12.2
senior 12.2
indoor 11.9
partner 11.6
jacket 11.6
confidence 11.5
formal 11.5
doctor 11.3
employee 11.2
communication 10.9
colleague 10.8
discussion 10.7
diversity 10.6
indoors 10.5
together 10.5
talking 10.5
sitting 10.3
horizontal 10.1
attractive 9.8
diverse 9.8
conference 9.8
busy 9.6
black 9.6
couple 9.6
workplace 9.5
hospital 9.4
two 9.3
businesswomen 8.8
computer 8.8
25 30 years 8.8
deal 8.7
agreement 8.7
building 8.7
elderly 8.6
profession 8.6
care 8.2
medical 7.9
stethoscope 7.9
collaboration 7.9
crew 7.9
discussing 7.9
30 35 years 7.9
happiness 7.8
middle aged 7.8
expertise 7.8
guy 7.8
smart 7.5
presentation 7.5
entrepreneur 7.4
nurse 7.4
positive 7.4
uniform 7.3
laptop 7.3
color 7.2
women 7.1
medicine 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

person 99.9
wall 99.3
posing 99.1
suit 96.7
human face 93.7
man 93.1
clothing 91.2
standing 84.7
text 79.5
tie 73.6
smile 72.1
group 69.3
old 61.2
black and white 50.9
necktie 17.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 52-60
Gender Male, 100%
Calm 99.9%
Happy 0%
Confused 0%
Surprised 0%
Sad 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 54-62
Gender Male, 100%
Calm 92.5%
Happy 5.4%
Confused 1%
Sad 0.4%
Surprised 0.2%
Disgusted 0.2%
Fear 0.2%
Angry 0.2%

AWS Rekognition

Age 54-64
Gender Male, 100%
Calm 99.7%
Confused 0.2%
Sad 0.1%
Surprised 0%
Angry 0%
Happy 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 54-64
Gender Male, 100%
Calm 99.9%
Happy 0%
Surprised 0%
Confused 0%
Disgusted 0%
Sad 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 53-61
Gender Male, 100%
Calm 93.2%
Confused 4.8%
Sad 0.8%
Surprised 0.6%
Angry 0.2%
Fear 0.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 66-76
Gender Male, 100%
Calm 99.9%
Angry 0%
Surprised 0%
Confused 0%
Sad 0%
Fear 0%
Disgusted 0%
Happy 0%

Microsoft Cognitive Services

Age 57
Gender Male

Microsoft Cognitive Services

Age 58
Gender Male

Microsoft Cognitive Services

Age 61
Gender Male

Microsoft Cognitive Services

Age 61
Gender Male

Microsoft Cognitive Services

Age 55
Gender Male

Microsoft Cognitive Services

Age 56
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Suit 98.9%
Tie 98.2%

Captions

Microsoft

a group of people posing for a photo 99%
a group of people posing for the camera 98.9%
a group of people posing for a picture 98.8%