Human Generated Data

Title

Untitled (studio portrait of six brothers in suits)
Date

c. 1945
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3229

Human Generated Data

Title

Untitled (studio portrait of six brothers in suits)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Clothing 99.5
Apparel 99.5
Person 98.8
Human 98.8
Person 97.6
Person 96.9
Person 91.9
Person 90.5
Suit 89.9
Coat 89.9
Overcoat 89.9
Shirt 87.7
Accessories 86.3
Accessory 86.3
Person 86
Suit 84.1
Suit 82.3
Face 80.3
Tie 78.3
Suit 72.5
Head 72.5
People 68.7
Necktie 66.3
Suit 65.7
Sunglasses 65.4

Imagga
created on 2022-01-22

lab coat 72.1
coat 65.3
man 53.2
specialist 51.2
doctor 43.3
nurse 42.5
male 41.9
businessman 38.9
professional 38.1
business 37.1
medical 36.2
person 36.2
team 35.9
hospital 34.8
adult 34.5
people 32.4
practitioner 30.8
job 30.1
office 28.9
smiling 28.2
medicine 28.2
garment 28.1
colleagues 27.2
clinic 26.9
happy 26.4
work 25.9
health 25
businesspeople 24.7
portrait 24.6
stethoscope 24.3
looking 24
group 23.4
care 23.1
teamwork 22.3
occupation 22
confident 21.9
meeting 20.7
corporate 20.6
30s 20.2
businesswoman 20
doctors 19.7
handsome 19.6
mature 19.6
worker 19.2
clothing 18.5
indoor 18.3
uniform 18.2
men 18.1
patient 18
smile 17.1
working 16.8
face 16.4
desk 16.1
indoors 15.8
associates 15.8
clinical 15.6
profession 15.3
staff 15.3
20s 14.7
success 14.5
suit 14.4
elderly 14.4
attractive 14
camera 13.9
successful 13.7
40s 13.6
computer 13.6
expertise 13.6
casual 13.6
executive 13.1
standing 13.1
cheerful 13
coworkers 12.8
horizontal 12.6
corporation 12.6
surgeon 12.3
color 12.3
senior 12.2
crew 11.8
happiness 11.8
consultant 11.7
cooperation 11.6
laboratory 11.6
illness 11.5
tie 11.4
laptop 10.9
lifestyle 10.9
bright 10.7
businessmen 10.7
discussion 10.7
mid adult 10.6
busy 10.6
necktie 10.5
two 10.2
general practitioner 9.9
discussing 9.8
good mood 9.8
diagnosis 9.8
workers 9.7
exam 9.6
confidence 9.6
women 9.5
student 9.5
employee 9.4
presentation 9.3
communication 9.2
friendly 9.2
clinician 8.9
heal 8.8
healing 8.8
physician 8.8
partners 8.8
couple 8.7
practice 8.7
partner 8.7
table 8.7
partnership 8.7
sitting 8.6
research 8.6
treatment 8.3
human 8.3
together 7.9
expert 7.9
colleague 7.8
conference 7.8
middle aged 7.8
examination 7.8
health care 7.8
groom 7.7
diversity 7.7
leadership 7.7
expression 7.7
serious 7.6
ethnic 7.6
talking 7.6
manager 7.5
coffee 7.4
day 7.1
look 7

Google
created on 2022-01-22

Outerwear 95.2
Smile 95
Black 89.6
Coat 89
Standing 86.4
Gesture 85.3
Black-and-white 85.1
Style 84
Collar 83.4
Font 80.8
Sleeve 79.5
People 78.7
Formal wear 76.8
Blazer 76.6
Monochrome photography 76
Monochrome 75.9
Art 75.7
Snapshot 74.3
Suit 73.5
Event 72.5

Microsoft
created on 2022-01-22

person 97.7
wall 96.8
human face 92.5
posing 91.7
smile 91.2
man 90
clothing 88.6
glasses 83.5
text 71.5
suit 62.7

Face analysis

Amazon

Google

AWS Rekognition

Age 45-53
Gender Male, 100%
Calm 44.8%
Surprised 16.3%
Sad 14.9%
Fear 6.9%
Confused 6.2%
Disgusted 4.7%
Angry 4.4%
Happy 2%

AWS Rekognition

Age 50-58
Gender Male, 99.9%
Calm 30.4%
Happy 27.8%
Sad 23.3%
Surprised 7.7%
Fear 4.3%
Confused 2.6%
Angry 2.3%
Disgusted 1.7%

AWS Rekognition

Age 45-51
Gender Male, 100%
Calm 89.8%
Happy 4.2%
Surprised 3.9%
Disgusted 1%
Confused 0.5%
Angry 0.3%
Sad 0.2%
Fear 0.1%

AWS Rekognition

Age 50-58
Gender Male, 99.9%
Calm 96.5%
Sad 1%
Surprised 0.9%
Fear 0.5%
Happy 0.4%
Confused 0.4%
Angry 0.2%
Disgusted 0.1%

AWS Rekognition

Age 43-51
Gender Male, 100%
Calm 99.9%
Surprised 0%
Sad 0%
Angry 0%
Confused 0%
Disgusted 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 50-58
Gender Male, 100%
Surprised 58.5%
Sad 21.7%
Calm 14.2%
Confused 1.7%
Disgusted 1.6%
Happy 1%
Fear 0.7%
Angry 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Suit 89.9%
Tie 78.3%
Sunglasses 65.4%

Captions

Microsoft

a group of people posing for a photo 98.5%
a group of people posing for the camera 98.4%
a group of people posing for a picture 98.3%

Text analysis

Google

HAOON-YT3RA2-NAMTZA3
HAOON-YT3RA2-NAMTZA3