Human Generated Data

Title

Untitled (man posed seated with young boy and two old men holding dogs)

Date

1943

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9046

Human Generated Data

Title

Untitled (man posed seated with young boy and two old men holding dogs)

People

Artist: Martin Schweig, American 20th century

Date

1943

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 97.7
Person 97.5
Person 97.1
Person 96.2
Person 94.8
Clothing 93.4
Apparel 93.4
Tie 90.7
Accessories 90.7
Accessory 90.7
Doctor 69
Face 67.7
Clinic 64.1
Photo 64.1
Portrait 64.1
Photography 64.1
Finger 60.7
Door 57.5
Coat 57.3
Sleeve 56.8
Sailor Suit 56.3

Imagga
created on 2022-01-23

coat 100
lab coat 100
doctor 60.2
nurse 53.5
man 51.1
garment 49.9
medical 49.5
hospital 47.4
male 44
professional 41.7
medicine 39.7
clinic 37.8
team 35.9
person 33.8
specialist 33.5
health 33.4
stethoscope 33.1
occupation 32.1
adult 31.7
care 31.3
people 31.3
job 31
doctors 30.5
clothing 29.9
uniform 29.5
happy 29.5
business 27.4
smiling 26.8
practitioner 26.6
work 25.9
portrait 25.3
mature 25.1
businessman 23.9
looking 23.2
worker 22.5
office 22.5
colleagues 22.4
30s 22.1
working 22.1
clinical 21.5
smile 20.7
men 20.6
teamwork 20.4
confident 20
patient 19.8
group 19.4
profession 18.2
handsome 17
standing 16.5
laboratory 16.4
staff 16.3
elderly 15.3
businesspeople 15.2
indoors 15
indoor 14.6
consultant 14.6
40s 14.6
expertise 14.6
illness 14.3
senior 14.1
lifestyle 13.8
women 13.5
corporate 12.9
color 12.8
two 12.7
practice 12.6
surgeon 12.4
cheerful 12.2
bright 12.2
success 12.1
casual 11.9
general practitioner 11.9
businesswoman 11.8
associates 11.8
coworkers 11.8
happiness 11.8
mid adult 11.6
face 11.4
meeting 11.3
camera 11.1
20s 11
friendly 11
student 10.9
look 10.5
attractive 10.5
human 10.5
healthy 10.1
successful 10.1
clinician 9.9
heal 9.8
healing 9.8
diagnosis 9.8
physician 9.8
health care 9.7
2 9.7
partnership 9.6
couple 9.6
exam 9.6
confidence 9.6
desk 9.5
day 9.4
treatment 9.2
suit 9
lady 8.9
expert 8.9
crew 8.9
discussing 8.9
good mood 8.8
50s 8.8
medication 8.8
together 8.8
ill 8.8
thirties 8.8
assistant 8.8
examination 8.8
workers 8.7
cooperation 8.7
sick 8.7
four 8.6
tie 8.5
horizontal 8.4
fifties 7.9
black 7.8
discussion 7.8
table 7.8
lab 7.8
partner 7.7
busy 7.7
modern 7.7
diversity 7.7
holding 7.4
light 7.4
computer 7.2

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

wall 99.3
text 98.6
man 96.6
person 92.4
posing 85.3
clothing 84.4
wedding 81.7
smile 76.5
human face 67.3
ceremony 63.4
old 46.5

Face analysis

Amazon

Google

AWS Rekognition

Age 14-22
Gender Male, 99.4%
Surprised 82%
Calm 8.8%
Happy 3%
Fear 2.9%
Sad 1.8%
Disgusted 0.9%
Angry 0.4%
Confused 0.2%

AWS Rekognition

Age 53-61
Gender Male, 99.6%
Calm 48.5%
Happy 43.3%
Surprised 5.4%
Angry 0.7%
Confused 0.7%
Sad 0.6%
Disgusted 0.6%
Fear 0.2%

AWS Rekognition

Age 51-59
Gender Male, 99.8%
Calm 37.1%
Surprised 22.6%
Happy 18.3%
Confused 10.9%
Sad 6.8%
Fear 1.9%
Disgusted 1.3%
Angry 0.9%

AWS Rekognition

Age 45-53
Gender Male, 99.7%
Surprised 66.2%
Calm 24.2%
Happy 3.3%
Sad 3.3%
Confused 1.2%
Disgusted 0.8%
Angry 0.6%
Fear 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.5%
Tie 90.7%

Captions

Microsoft

a group of people posing for a photo 95.4%
a group of men posing for a photo 95.3%
a group of people posing for the camera 95.2%

Text analysis

Amazon

32AB
32AB YT3RAS R30H3330
YT3RAS
R30H3330

Google

R30M3330
YT3RA2
22A0 YT3RA2 R30M3330
22A0