Human Generated Data

Title

Untitled (man in front of shelves of products)

Date

1952

People

Artist: Peter James Studio, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20242

Human Generated Data

Title

Untitled (man in front of shelves of products)

People

Artist: Peter James Studio, American

Date

1952

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Clothing 99.6
Apparel 99.6
Human 98.3
Person 98.3
Coat 94.1
Lab Coat 94.1
Shelf 86.1
Furniture 83.5
Scientist 81.6
Shop 67.2
Clinic 67.1
Lab 64.5

Imagga
created on 2022-03-05

pharmacist 85.3
professional 71.8
health professional 65.4
clinic 62.5
adult 45.5
man 40.3
lab coat 39.2
person 38.6
male 35.5
people 35.2
coat 35
work 34.6
office 31.6
working 28.3
medical 28.3
doctor 27.3
happy 25.7
smiling 25.3
business 24.9
job 24.8
occupation 24.8
businessman 22.1
patient 21.3
desk 21.1
men 20.6
indoors 20.2
health 20.2
computer 20
hospital 19.8
worker 19.7
team 19.7
smile 19.2
medicine 17.6
portrait 17.5
women 15.8
lab 15.6
sitting 15.5
businesswoman 15.5
laboratory 15.4
technology 14.9
teamwork 14.8
colleagues 14.6
group 14.5
businesspeople 14.2
room 13.9
laptop 13.7
looking 13.6
30s 13.5
modern 13.3
table 13.2
care 13.2
corporate 12.9
20s 12.8
garment 12.5
talking 12.4
standing 12.2
manager 12.1
clothing 11.9
scientist 11.8
research 11.4
indoor 11
student 10.9
associates 10.8
assistant 10.7
science 10.7
shop 10.7
chemical 10.6
attractive 10.5
meeting 10.4
horizontal 10.1
bright 10
specialist 9.9
chemist 9.8
cheerful 9.8
test 9.6
profession 9.6
illness 9.5
nurse 9.5
casual 9.3
two 9.3
suit 9
success 8.9
physician 8.8
together 8.8
expertise 8.7
check 8.7
chemistry 8.7
education 8.7
day 8.6
exam 8.6
uniform 8.6
biology 8.5
face 8.5
service 8.5
communication 8.4
mature 8.4
color 8.3
treatment 8.3
successful 8.2
to 8
interior 8
look 7.9
coworkers 7.9
cure 7.8
two people 7.8
scientific 7.8
mid adult 7.7
staff 7.7
workplace 7.6
store 7.6
one person 7.5
executive 7.4
home 7.2

Google
created on 2022-03-05

Photograph 94.1
Black 89.5
Shelf 89.2
Coat 88.6
Sleeve 87.2
Black-and-white 84.5
Medical 81.2
Eyewear 79.6
White coat 78.5
Service 77.5
Retail 75.9
Scientist 75.3
Snapshot 74.3
Monochrome photography 74.3
Monochrome 73.5
Chemistry 73.3
Health care 72.2
Font 71.8
Chef 69.8
Science 68.5

Microsoft
created on 2022-03-05

text 99.9
indoor 91.6
bottle 80.6
shelf 71.3
person 70.1
clothing 68.4
man 59.8
black and white 57.8

Face analysis

Amazon

Google

AWS Rekognition

Age 40-48
Gender Male, 100%
Sad 48.5%
Happy 24.9%
Surprised 8.1%
Confused 5.9%
Calm 5.4%
Disgusted 4.3%
Angry 2%
Fear 1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.3%

Captions

Microsoft

a person standing in front of a counter 61.4%
a person sitting on a counter 49.3%
a person standing in front of a table 49.2%

Text analysis

Amazon

LUSHUS
LUSHUS LUSHUS LUSHUS LUSHUS
REDBOW
BEANS
RICE
SALT
SALT WATER
TAFFY
WATER
LENTILS
UMA
PREPARED
ROW REDBOW REDBOW REDBOW REDBOW REDBOW REDBOW
Childs
Sta
E-Z
LUSHUS LUSHUS - LUSHUS LUSHUS
GREEN
KING
3
CLEANER
4
EAD
=
ROW
-
St 4 3
MARCH
St.
St
Wip
Times
MAYDAY
S
hon
SPITIPEAS
El
DE MAYDAY
i
أنا S
The
SEACH
WAR
ASIA
and
أنا
MeL
MJI7-YT3A-X
USCA
Wild
Coca-Cola
mes
DE

Google

LUSHUS LUSHUS USHUS İ LUSHUS LUSHUS LUSHU LUSHUS LUSHUS LUSHUS (rip De LUSHUS LUSHUS LUSHUS OW REDBOW PENROW REDBOW REOROW REANS REEN LENTILS RICE I PEAS LENTIUS BEANS Childs SALT WATEE TAFFY EPARED Childe EZ Childs SALT WATE
USHUS
(rip
OW
RICE
LENTIUS
Childs
WATEE
REEN
SALT
LUSHUS
İ
De
REOROW
EPARED
Childe
WATE
LUSHU
PENROW
REDBOW
LENTILS
I
TAFFY
EZ
REANS
PEAS
BEANS