Human Generated Data

Title

Untitled (two men holding large key)

Date

1950

People

Artist: Peter James Studio, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20164

Human Generated Data

Title

Untitled (two men holding large key)

People

Artist: Peter James Studio, American

Date

1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20164

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Clothing 99.9
Apparel 99.9
Coat 99.8
Overcoat 99.8
Tuxedo 98.1
Human 93.8
Person 93.6
Shirt 92.8
Person 91.9
Suit 83.5
Person 76.9
Suit 71.6
Electronics 65.8
Blazer 64.8
Jacket 64.8
Photography 60.8
Photo 60.8
Camera 58.9
Portrait 58.5
Face 58.5
Sleeve 57.6
Man 55.9
Robe 55.6
Fashion 55.6

Clarifai
created on 2023-10-22

people 99.8
man 98.8
group 98.4
adult 97.4
three 94.4
medical practitioner 93.8
monochrome 93.6
two 93.4
science 93.2
scientist 91.3
portrait 88
outerwear 87.1
outfit 84.7
indoors 84.1
wedding 83.3
interaction 82.6
group together 81.7
facial expression 81.4
wear 79.5
leader 79.4

Imagga
created on 2022-03-05

lab coat 69.4
coat 64
man 52.5
person 49.3
male 41.9
professional 39.5
doctor 35.7
people 33.5
adult 32.4
medical 31.8
happy 29.5
businessman 27.4
executive 26.6
office 26.5
business 25.5
job 24.8
garment 24.1
smiling 23.9
work 23.6
team 23.3
mature 23.3
health 22.9
white 21.8
hospital 21.6
portrait 21.4
clinic 21.3
clothing 21.2
worker 20.9
smile 20.7
corporate 20.6
men 20.6
looking 20
occupation 19.3
senior 18.8
handsome 18.7
working 18.6
medicine 18.5
uniform 17.3
teamwork 16.7
patient 16.5
suit 16.5
businesspeople 16.1
desk 16.1
meeting 16
bright 15.7
attractive 15.4
elderly 15.3
stethoscope 15
indoors 14.9
face 14.9
care 14.8
laptop 14.6
colleagues 14.6
specialist 14.6
lifestyle 14.5
computer 14.5
human 14.3
women 14.2
happiness 14.1
modern 14
color 13.4
successful 12.8
indoor 12.8
casual 12.7
40s 12.7
nurse 12.6
mid adult 12.5
look 12.3
sitting 12
home 12
technology 11.9
two 11.9
confident 11.8
science 11.6
practitioner 11.5
profession 11.5
together 11.4
couple 11.3
standing 11.3
day 11
associates 10.8
scientist 10.8
holding 10.7
lab 10.7
corporation 10.6
laboratory 10.6
30s 10.6
staff 10.5
ethnic 10.5
success 10.5
old 10.5
education 10.4
table 10.4
manager 10.3
glasses 10.2
student 10.1
businesswoman 10
hand 9.9
life 9.8
businessmen 9.8
cheerful 9.8
older 9.7
group 9.7
busy 9.6
test 9.6
diversity 9.6
camera 9.2
20s 9.2
doctors 8.9
coworkers 8.8
assistant 8.8
light 8.7
exam 8.6
workplace 8.6
research 8.6
expression 8.5
career 8.5
company 8.4
teacher 8.3
treatment 8.3
friendly 8.2
equipment 8.2
hands 7.8
physician 7.8
middle aged 7.8
chemistry 7.7
partnership 7.7
focus 7.4
service 7.4
black 7.2
building 7.1

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

wall 99.4
man 99.4
person 99.3
clothing 97.4
standing 88.4
indoor 87
human face 86.2
text 85.3
smile 80.9
old 67.5
black 65.8
posing 63.7
black and white 60.9
dressed 28.8
male 16.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 51-59
Gender Male, 100%
Surprised 37.9%
Happy 32.4%
Calm 15.6%
Confused 6.7%
Disgusted 4.1%
Angry 1.5%
Fear 1.1%
Sad 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Suit
Person 93.6%
Person 91.9%
Person 76.9%
Suit 83.5%
Suit 71.6%

Text analysis

Amazon

YALE
SID

Google

SIA
SIA