Human Generated Data

Title

Untitled (two men posing together in banquet room at party)

Date

1950

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9332

Human Generated Data

Title

Untitled (two men posing together in banquet room at party)

People

Artist: Martin Schweig, American 20th century

Date

1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Apparel 99.9
Clothing 99.9
Accessories 99.8
Accessory 99.8
Tie 99.8
Chair 99.6
Furniture 99.6
Chair 97.6
Tie 95
Shirt 93.4
Person 91.8
Human 91.8
Person 90.3
Dining Table 88.5
Table 88.5
Overcoat 84.3
Coat 84.3
Home Decor 78
Ceiling Fan 77.2
Appliance 77.2
Suit 73.2
Suit 67.9
Lab Coat 66.9
Dress Shirt 66.2
Clinic 57.6
Indoors 56.6
Room 56.5
Dining Room 56.5
Electronics 56.3
Screen 56.3
Floor 55.3
Sleeve 55.1

Imagga
created on 2022-01-23

lab coat 72.8
coat 66.4
man 49.1
male 48.3
professional 43.4
businessman 41.6
office 41
person 39.7
adult 39.5
business 38.3
people 34.6
doctor 33.9
job 31.9
team 30.5
corporate 30.1
men 29.2
happy 28.9
work 28.3
medical 28.3
garment 28.3
clinic 27.3
hospital 27.3
clothing 26.9
portrait 25.9
businesspeople 25.7
colleagues 25.3
meeting 24.5
mature 24.2
looking 24
desk 23.7
group 23.4
executive 22.9
indoor 22.9
occupation 22
worker 22
smiling 21.7
health 21.6
suit 21.4
teamwork 20.4
working 20.4
medicine 20.3
computer 20.1
care 19.8
casual 19.5
practitioner 19.5
indoors 19.4
businesswoman 19.1
handsome 18.8
laptop 18.2
associates 17.7
20s 17.4
table 17.3
bright 17.2
smile 17.1
patient 17.1
color 16.7
modern 16.1
lifestyle 15.9
day 15.7
40s 15.6
uniform 15.4
manager 14.9
stethoscope 14.9
doctors 14.8
clinical 14.7
face 14.2
attractive 14
pharmacist 14
success 13.7
businessmen 13.7
women 13.5
coworkers 12.8
confident 12.8
corporation 12.6
mid adult 12.6
elderly 12.5
ethnic 12.4
nurse 12.2
standing 12.2
company 12.1
horizontal 11.7
specialist 11.5
sitting 11.2
camera 11.1
room 11.1
successful 11
consultant 10.7
discussion 10.7
30s 10.6
diversity 10.6
cheerful 10.6
partnership 10.6
profession 10.5
career 10.4
glasses 10.2
treatment 10.1
light 10
entrepreneur 10
general practitioner 9.9
heal 9.8
healing 9.8
good mood 9.8
human 9.8
teacher 9.7
expertise 9.7
cooperation 9.7
together 9.7
look 9.6
building 9.5
happiness 9.4
senior 9.4
life 9.4
two 9.3
surgeon 9
clinician 8.9
health professional 8.9
discussing 8.9
25 30 years 8.8
examination 8.8
2 8.7
student 8.7
busy 8.7
tie 8.6
adults 8.5
focus 8.3
technology 8.2
home 8
boardroom 7.9
expert 7.9
crew 7.9
medication 7.8
conference 7.8
physician 7.8
assistant 7.8
partners 7.8
staff 7.8
partner 7.7
1 7.7
laboratory 7.7
old 7.7
exam 7.7
boss 7.7
serious 7.6
illness 7.6
talking 7.6
hand 7.6
communication 7.6
black 7.2
director 7.1

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

text 93.9
wedding dress 87.5
clothing 86.4
wedding 84.6
standing 83.1
smile 71.7
person 71.6
bride 71.3
man 68.2
suit 62.2
posing 51.2

Face analysis

Amazon

Google

AWS Rekognition

Age 48-56
Gender Male, 99.7%
Sad 77.2%
Happy 6.5%
Confused 5.6%
Calm 4.9%
Surprised 3.1%
Disgusted 1.3%
Fear 1%
Angry 0.5%

AWS Rekognition

Age 49-57
Gender Male, 99.9%
Happy 60.8%
Calm 31.4%
Surprised 2.7%
Fear 1.7%
Confused 1.4%
Sad 1.1%
Disgusted 0.7%
Angry 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.8%
Chair 99.6%
Person 91.8%
Ceiling Fan 77.2%
Suit 73.2%

Captions

Microsoft

a person standing in front of a mirror posing for the camera 79.7%
a man and woman standing in front of a mirror posing for the camera 64.3%
a group of people standing in front of a mirror posing for the camera 64.2%