Human Generated Data

Title

Untitled (two men in office)

Date

1952

People

Artist: Peter James Studio, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20286

Human Generated Data

Title

Untitled (two men in office)

People

Artist: Peter James Studio, American

Date

1952

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Apparel 99.8
Clothing 99.8
Person 98.8
Human 98.8
Coat 94.9
Lab Coat 94.9
Person 91.9
Shirt 79.6
Furniture 70.9
Chair 70.9
Clinic 70.5
Overcoat 68.6
Suit 68
Tie 66.1
Accessories 66.1
Accessory 66.1
Lab 61
Scientist 58.3
Long Sleeve 56.2
Sleeve 56.2
Display 56
Monitor 56
Electronics 56
Screen 56
LCD Screen 55

Imagga
created on 2022-03-05

lab coat 51.7
coat 49.5
man 45.1
person 42.7
male 39
clinic 38
medical 37.1
people 35.2
professional 35
nurse 34.9
patient 33.6
doctor 32.9
hospital 29.4
work 29.1
adult 26
health 25
job 24.8
working 23.9
worker 22.2
medicine 22
team 21.5
office 20.9
business 20.7
businessman 20.3
smiling 20.3
laboratory 20.3
happy 20.1
specialist 19.6
indoors 19.3
men 18
garment 17.9
teamwork 17.6
looking 17.6
lab 17.5
occupation 17.4
surgeon 17
scientist 16.7
student 16.5
research 16.2
desk 16.1
practitioner 16
room 15.9
education 15.6
sitting 15.5
case 15
care 14.8
table 14.7
assistant 14.6
uniform 14.6
chemistry 14.5
sick person 14.1
colleagues 13.6
portrait 13.6
science 13.3
meeting 13.2
mature 13
clothing 12.9
group 12.9
indoor 12.8
test 12.5
biology 12.3
chemical 11.7
30s 11.6
profession 11.5
smile 11.4
businesspeople 11.4
corporate 11.2
women 11.1
50s 10.8
bright 10.7
mid adult 10.6
computer 10.4
technology 10.4
day 10.2
lifestyle 10.1
successful 10.1
color 10
businesswoman 10
associates 9.8
coworkers 9.8
exam 9.6
classroom 9.6
illness 9.5
workplace 9.5
senior 9.4
instrument 9.4
study 9.3
casual 9.3
suit 9.3
pharmacist 9.2
treatment 9.2
20s 9.2
modern 9.1
confident 9.1
holding 9.1
shop 8.9
success 8.9
surgery 8.8
clinical 8.8
home 8.8
middle aged 8.8
together 8.8
look 8.8
standing 8.7
employee 8.6
talking 8.6
college 8.5
black 8.4
manager 8.4
teacher 8.3
microscope 7.9
sterile 7.9
doctors 7.9
face 7.8
40s 7.8
scientific 7.8
check 7.7
concentration 7.7
using 7.7
attractive 7.7
two 7.6
ethnic 7.6
inside 7.4
health professional 7.3
laptop 7.3
school 7.2
to 7.1

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

text 98.3
person 95.8
indoor 91.5
man 82.7
clothing 81.2
black and white 69.1

Face analysis

Amazon

Google

AWS Rekognition

Age 42-50
Gender Male, 67%
Calm 40%
Sad 20.6%
Surprised 16.2%
Confused 7.7%
Happy 5.5%
Angry 3.8%
Disgusted 3.3%
Fear 3%

AWS Rekognition

Age 50-58
Gender Male, 99.9%
Happy 92.9%
Surprised 6.3%
Sad 0.2%
Disgusted 0.2%
Calm 0.1%
Confused 0.1%
Fear 0.1%
Angry 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Tie 66.1%

Captions

Microsoft

a man and a woman sitting on a kitchen counter 45.4%
a man and a woman sitting on a counter 45.3%
a group of people in a kitchen 45.2%

Text analysis

Amazon

28

Google

YT37A8-XAAOX
YT37A8-XAAOX