Human Generated Data

Title

Untitled (portrait of five men outside)

Date

c. 1950

People

Artist: John Howell, American active 1930s-1960s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21578

Human Generated Data

Title

Untitled (portrait of five men outside)

People

Artist: John Howell, American active 1930s-1960s

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Clothing 99.6
Apparel 99.6
Person 98.6
Human 98.6
Person 98.3
Person 97.2
Person 96.8
Person 94.4
Coat 91.2
People 85.9
Overcoat 84.9
Suit 84.9
Lab Coat 81.6
Shirt 81.2
Pants 59.9
Shorts 58.1
Tuxedo 56

Imagga
created on 2022-03-05

nurse 69.1
doctor 59.2
medical 53.9
person 47.8
hospital 47.2
professional 45.3
cricket equipment 42.6
man 42.3
stethoscope 41.6
wicket 41.4
medicine 39.6
health 36.8
player 36.1
care 33.7
clinic 33.7
male 33.4
sports equipment 32.5
happy 32
golfer 31.9
people 31.8
team 31.4
uniform 31.2
doctors 30.5
coat 29
contestant 28.4
job 28.3
occupation 27.5
mature 26
smile 25.7
adult 25.5
patient 24.1
practitioner 23.7
smiling 23.2
confident 22.8
portrait 22.7
equipment 22
surgeon 21.6
working 21.2
work 21.2
profession 21.1
worker 20.7
clinical 20.5
business 19.4
group 19.3
staff 19.1
lab coat 18.2
specialist 17.7
teamwork 17.6
looking 16.8
men 16.3
ballplayer 16.1
physician 15.6
friendly 15.6
laboratory 15.4
senior 15
happiness 14.9
standing 14.8
practice 14.5
30s 14.4
elderly 14.4
healthy 13.9
handsome 13.4
illness 13.3
colleagues 12.6
health care 12.6
athlete 12.3
office 12
camera 12
cricket bat 11.8
consultant 11.7
businessman 11.5
couple 11.3
lifestyle 10.8
surgical 10.8
ill 10.7
mid adult 10.6
cheerful 10.6
attractive 10.5
women 10.3
day 10.2
casual 10.2
surgery 9.8
lab 9.7
expertise 9.7
sick 9.7
confidence 9.6
two 9.3
face 9.2
treatment 9.2
successful 9.2
case 9.1
old 9.1
black 9
success 8.9
indoors 8.8
middle aged 8.8
examination 8.7
workers 8.7
partnership 8.6
exam 8.6
indoor 8.2
businesswoman 8.2
suit 8.1
new 8.1
family 8
clinician 7.9
general practitioner 7.9
intern 7.9
heal 7.9
healing 7.8
diagnosis 7.8
40s 7.8
assistant 7.8
older 7.8
diversity 7.7
businesspeople 7.6
human 7.5
student 7.5
holding 7.4
aged 7.2
color 7.2

Google
created on 2022-03-05

Trousers 96.7
Photograph 94.1
Shirt 94.1
White 92.2
Plant 91
Black-and-white 81.9
Adaptation 79.3
Suit 79
Blazer 78
People 77.9
Collar 76.8
Tree 75.4
Formal wear 75.3
Monochrome photography 74.6
Snapshot 74.3
Classic 74.2
Vintage clothing 71.4
Event 71.2
Monochrome 69.3
Uniform 64.9

Microsoft
created on 2022-03-05

outdoor 99.9
person 99.6
text 96.6
smile 95.7
clothing 95.5
human face 91.1
posing 90.6
man 88.5
standing 86.4
black and white 64.3
player 60.6
cricket 60
old 56.6
group 55.5

Face analysis

Amazon

Google

AWS Rekognition

Age 51-59
Gender Male, 99.8%
Calm 90.2%
Sad 3.3%
Angry 1.6%
Confused 1.6%
Disgusted 1%
Surprised 0.9%
Fear 0.7%
Happy 0.6%

AWS Rekognition

Age 29-39
Gender Male, 84.4%
Calm 92.5%
Confused 2.4%
Surprised 1.8%
Disgusted 1%
Happy 0.8%
Sad 0.7%
Angry 0.6%
Fear 0.3%

AWS Rekognition

Age 43-51
Gender Male, 58.1%
Happy 43.9%
Calm 35.6%
Surprised 17.2%
Disgusted 1%
Angry 0.9%
Fear 0.7%
Confused 0.4%
Sad 0.4%

AWS Rekognition

Age 51-59
Gender Male, 70.4%
Happy 62.2%
Surprised 19.3%
Calm 12.8%
Sad 2.4%
Angry 1.4%
Disgusted 0.9%
Fear 0.8%
Confused 0.2%

AWS Rekognition

Age 27-37
Gender Male, 64%
Confused 39.6%
Calm 39%
Happy 13.7%
Sad 2.3%
Fear 2%
Surprised 1.7%
Angry 1%
Disgusted 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%

Captions

Microsoft

a group of people posing for a photo 98%
a group of people posing for the camera 97.9%
a group of people posing for a picture 97.8%

Text analysis

Amazon

IS