Human Generated Data

Title

Untitled (guests at anniversary party)

Date

c. 1960

People

Artist: John Howell, American active 1930s-1960s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21614

Human Generated Data

Title

Untitled (guests at anniversary party)

People

Artist: John Howell, American active 1930s-1960s

Date

c. 1960

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Human 99.5
Person 99.5
Person 99.2
Person 98.8
Person 98.7
Person 97.8
Clothing 93.5
Hat 93.5
Apparel 93.5
Accessories 92
Sunglasses 92
Accessory 92
Face 86.2
People 73.7
Sunglasses 72.4
Photography 64.7
Photo 64.7
Portrait 64.7
Icing 57.2
Creme 57.2
Cake 57.2
Food 57.2
Dessert 57.2
Cream 57.2
Nurse 56.6

Imagga
created on 2022-03-05

lab coat 97.1
coat 85.9
man 42.4
male 41.2
person 38.9
garment 36.2
professional 34
doctor 33.9
adult 32
people 31.8
medical 30
businessman 28.3
business 26.7
hospital 26.6
office 24.9
happy 24.5
men 24.1
clothing 24
work 22.8
clinic 22.5
job 22.1
nurse 20.5
mature 20.5
colleagues 20.4
health 20.2
team 19.7
patient 19.7
worker 19.6
smiling 19.5
specialist 19.5
medicine 19.4
desk 18.9
casual 18.7
working 18.6
indoors 18.5
looking 18.4
indoor 18.3
corporate 18.1
businesspeople 18
meeting 17.9
portrait 17.5
occupation 17.4
care 17.3
smile 17.1
senior 16.9
table 16.5
sitting 16.3
group 16.1
teamwork 15.8
practitioner 15.6
businesswoman 15.5
suit 15.3
computer 15.2
handsome 15.2
color 14.5
lifestyle 14.5
stethoscope 14.1
together 14
attractive 14
coworkers 13.8
bright 13.6
face 13.5
success 12.9
associates 12.8
doctors 12.8
two 12.7
women 12.7
mid adult 12.6
laboratory 12.5
elderly 12.5
ethnic 12.4
couple 12.2
modern 11.9
20s 11.9
successful 11.9
technology 11.9
laptop 11.9
confident 11.8
day 11.8
happiness 11.8
lab 11.7
30s 11.6
uniform 11.5
profession 11.5
cheerful 11.4
room 11
businessmen 10.7
40s 10.7
assistant 10.7
life 10.1
30 35 years 9.8
clinical 9.8
executive 9.7
cooperation 9.7
busy 9.6
look 9.6
home 9.6
staff 9.6
standing 9.6
serious 9.5
building 9.5
talking 9.5
manager 9.3
treatment 9.2
human 9
healing 8.8
scientist 8.8
discussion 8.8
middle aged 8.8
expertise 8.7
light 8.7
diversity 8.7
illness 8.6
research 8.6
student 8.5
surgeon 8.5
old 8.4
friendly 8.2
employee 8.2
science 8
general practitioner 7.9
heal 7.9
50s 7.8
25 30 years 7.8
black 7.8
consultant 7.8
2 7.8
corporation 7.7
using 7.7
partnership 7.7
workplace 7.6
teacher 7.6
tie 7.6
adults 7.6
sit 7.6
horizontal 7.5
company 7.4
camera 7.4
writing 7.2
case 7.1

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

text 99.1
tree 98.9
clothing 93.2
outdoor 92.6
person 91.8
human face 79
black and white 71.1
man 64
wedding dress 54.8
woman 53.9
smile 53.3
old 50.5

Face analysis

Amazon

Google

AWS Rekognition

Age 53-61
Gender Male, 99.6%
Calm 63%
Happy 18.2%
Confused 14%
Sad 1.7%
Surprised 1%
Disgusted 0.9%
Angry 0.7%
Fear 0.5%

AWS Rekognition

Age 49-57
Gender Male, 99.5%
Happy 88.7%
Calm 2.9%
Angry 1.8%
Surprised 1.8%
Confused 1.5%
Disgusted 1.3%
Sad 1.3%
Fear 0.6%

AWS Rekognition

Age 47-53
Gender Male, 93.8%
Calm 59.4%
Happy 38.6%
Confused 0.5%
Sad 0.4%
Angry 0.4%
Surprised 0.4%
Disgusted 0.3%
Fear 0.1%

AWS Rekognition

Age 52-60
Gender Female, 65.9%
Happy 62.1%
Calm 22.6%
Sad 7.8%
Surprised 3.2%
Disgusted 1.4%
Confused 1.3%
Angry 1.1%
Fear 0.7%

AWS Rekognition

Age 50-58
Gender Male, 99.3%
Surprised 42.1%
Happy 24.5%
Calm 11.5%
Sad 10.6%
Fear 5.4%
Confused 2.3%
Angry 2%
Disgusted 1.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Hat 93.5%

Captions

Microsoft

a group of people posing for a photo 94.4%
a group of people posing for the camera 94.3%
a group of people posing for a picture 94.2%

Text analysis

Amazon

YТ37А-OX

Google

YT33A2-XAGON
YT33A2-XAGON