Human Generated Data

Title

Untitled (four men in suits posed standing together by punch bowl in dining room)
Date

1951
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9352

Human Generated Data

Title

Untitled (four men in suits posed standing together by punch bowl in dining room)

People

Artist: Martin Schweig, American 20th century

Date

1951

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.4
Human 99.4
Person 98.5
Person 98.3
Person 94.8
Clothing 89.6
Apparel 89.6
Scientist 85.3
Coat 73.2
Priest 69.2

Imagga
created on 2022-01-23

lab coat 100
coat 100
garment 56.9
man 53.1
doctor 48.9
male 41.2
medical 39.8
professional 35.4
person 35.2
adult 34
clothing 33.1
hospital 32.9
people 32.4
clinic 32.1
medicine 27.3
health 27.1
happy 27
smiling 26.1
mature 26.1
job 25.7
occupation 24.8
nurse 23.6
office 23.3
patient 22.7
care 21.4
business 21.3
working 21.2
portrait 20.7
team 20.6
smile 20
senior 19.7
work 19.6
stethoscope 19.6
businessman 19.4
lifestyle 18.8
uniform 18.1
practitioner 18
doctors 17.7
looking 17.6
specialist 17.3
desk 17
colleagues 16.5
elderly 16.3
casual 16.1
indoors 15.8
clinical 15.6
indoor 15.5
teamwork 14.9
table 14.7
worker 14.7
men 14.6
exam 14.4
attractive 14
sitting 13.8
examination 13.6
face 13.5
30s 13.5
meeting 13.2
standing 13.1
confident 12.8
physician 12.7
happiness 12.6
handsome 12.5
profession 12.5
businesspeople 12.4
surgeon 12.3
bright 12.2
glasses 12
treatment 12
successful 11.9
friendly 11.9
general practitioner 11.9
heal 11.8
healing 11.8
consultant 11.7
40s 11.7
color 11.7
together 11.4
cheerful 11.4
camera 11.1
two 11
20s 11
day 11
businesswoman 10.9
diagnosis 10.8
staff 10.5
group 10.5
computer 10.4
women 10.3
holding 9.9
suit 9.9
associates 9.8
coworkers 9.8
old 9.8
human 9.8
home 9.6
student 9.2
room 9.1
modern 9.1
technology 8.9
business people 8.9
discussing 8.9
look 8.8
older 8.8
mid adult 8.7
corporate 8.6
illness 8.6
workplace 8.6
black 8.4
laptop 8.2
success 8.1
science 8
teacher 7.9
hair 7.9
clinician 7.9
clipboard 7.9
forties 7.9
good mood 7.9
couple 7.8
medication 7.8
education 7.8
cure 7.8
middle aged 7.8
assistant 7.8
lab 7.8
expertise 7.8
practice 7.8
laboratory 7.7
partnership 7.7
expression 7.7
four 7.7
twenties 7.7
talking 7.6
hand 7.6
light 7.4

Google
created on 2022-01-23

Photograph 94.2
Coat 89.1
Sleeve 86.4
Plant 85
Chef 78.9
Cooking 77
Snapshot 74.3
Service 73.3
Vintage clothing 71.1
Event 69.6
Uniform 69.5
White coat 68.8
Health care provider 65.6
Hat 65.5
Monochrome photography 65.2
Stock photography 65.1
Science 64.9
Cook 64.7
History 62.5
Chemistry 62.2

Microsoft
created on 2022-01-23

wall 99.3
man 98.9
text 98.5
person 97.9
clothing 94.1
indoor 92.6
standing 75.8
black and white 65.8
posing 51

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Female, 86.6%
Happy 99.8%
Surprised 0.1%
Calm 0%
Confused 0%
Sad 0%
Disgusted 0%
Fear 0%
Angry 0%

AWS Rekognition

Age 48-54
Gender Male, 85.4%
Happy 60.2%
Sad 12%
Surprised 8.8%
Confused 6.8%
Fear 6.4%
Calm 3%
Disgusted 1.7%
Angry 1.1%

AWS Rekognition

Age 41-49
Gender Female, 99.8%
Calm 93%
Happy 3.4%
Sad 1.7%
Disgusted 0.5%
Confused 0.5%
Angry 0.4%
Surprised 0.4%
Fear 0.2%

AWS Rekognition

Age 43-51
Gender Male, 99.4%
Surprised 56.2%
Calm 28.5%
Happy 13.1%
Fear 0.6%
Confused 0.5%
Disgusted 0.4%
Sad 0.4%
Angry 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

a man standing in front of a mirror posing for the camera 84.2%
a group of men standing in front of a mirror posing for the camera 76.9%
a man that is standing in front of a mirror posing for the camera 76.8%

Text analysis

Amazon

MJI7
A
r
MJI7 YESTAD ОСЛИ
r 2
ОСЛИ
2
YESTAD

Google

MJ17 YT3RA2 02NA
02NA
MJ17
YT3RA2