Human Generated Data

Title

Untitled (man pointing at products on shelves)
Date

1952
People

Artist: Peter James Studio, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20243

Human Generated Data

Title

Untitled (man pointing at products on shelves)

People

Artist: Peter James Studio, American

Date

1952

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Clothing 97.7
Apparel 97.7
Human 96.8
Person 96.8
Shelf 96.4
Lab Coat 85.8
Coat 85.8
Shop 72.9
Furniture 69.6
Accessories 60.1
Accessory 60.1
Tie 60.1
Sleeve 56.9
Clinic 55.8

Imagga
created on 2022-03-05

professional 48.6
lab coat 47.9
man 41
coat 40.7
male 39.8
person 38
adult 37.1
office 35.8
businessman 35.3
people 35.2
business 32.8
work 30.6
happy 28.9
pharmacist 28.7
job 28.3
corporate 27.5
working 26.5
smiling 26.1
businesspeople 25.6
team 25.1
clinic 24.9
medical 24.7
worker 24.4
doctor 23.5
businesswoman 22.7
health professional 21.5
desk 21.2
nurse 21.1
occupation 21.1
colleagues 20.4
patient 19.8
clothing 19.8
teamwork 19.5
hospital 19.2
computer 18.4
portrait 18.1
meeting 17.9
smile 17.8
garment 17.4
20s 17.4
employee 17.3
men 17.2
group 16.9
medicine 16.7
indoors 16.7
health 16.7
waiter 16.2
manager 15.8
women 15.8
room 15.6
casual 15.3
associates 14.8
laptop 14.6
looking 14.4
executive 14.4
attractive 14
indoor 13.7
lab 13.6
laboratory 13.5
technology 13.4
modern 13.3
suit 12.2
bright 12.2
success 12.1
sitting 12
specialist 11.8
lifestyle 11.6
uniform 11.5
care 11.5
talking 11.4
face 11.4
color 11.1
coworkers 10.8
table 10.7
dining-room attendant 10.6
standing 10.4
building 10.3
mature 10.2
two 10.2
alone 10.1
student 10
handsome 9.8
40s 9.7
corporation 9.7
ethnic 9.5
research 9.5
career 9.5
day 9.4
horizontal 9.2
practitioner 9
science 8.9
scientist 8.8
25 30 years 8.8
conference 8.8
together 8.8
chemical 8.8
test 8.7
30s 8.7
formal 8.6
one person 8.5
teacher 8.5
pretty 8.4
focus 8.3
camera 8.3
holding 8.3
one 8.2
confident 8.2
cheerful 8.1
case 8
home 8
chemist 7.9
happiness 7.8
physician 7.8
education 7.8
expertise 7.8
scientific 7.8
check 7.7
cooperation 7.7
mid adult 7.7
1 7.7
jacket 7.7
boss 7.7
communication 7.6
writing 7.5
treatment 7.4
successful 7.3
board 7.2

Google
created on 2022-03-05

Sleeve 87.2
Coat 86.8
Black-and-white 84.8
Style 83.9
Tie 83.6
Eyewear 82.2
Suit 80.6
White coat 79.3
Blazer 78.2
Dress shirt 74.9
Fashion design 74.1
Formal wear 73.3
Monochrome 73.1
Monochrome photography 72.1
Uniform 69.8
Font 69
White-collar worker 65.9
Shelf 62.5
Room 62.4
Vintage clothing 58.3

Microsoft
created on 2022-03-05

text 99.8
man 95.6
clothing 93.2
indoor 93.2
person 88.4
standing 76.2
preparing 46.4
male 19.1

Face analysis

Amazon

Google

AWS Rekognition

Age 41-49
Gender Male, 99.9%
Calm 90%
Happy 3.3%
Sad 2.9%
Confused 1.7%
Disgusted 0.7%
Fear 0.4%
Surprised 0.4%
Angry 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.8%
Tie 60.1%

Captions

Microsoft

a man standing in front of a refrigerator 58.1%
a man standing in front of a counter 58%
a man standing in a room 57.9%

Text analysis

Amazon

LUSHUS
REDBOW
LUSHUS LUSHUS LUSHUS LUSHUS
LUSHUS LUSHUS
BEANS
SALT
RICE
SALT WATER
WATER
LENTILS
Childs
UMA
E-Z
BEDBOW REDBOW REDBOW REDBOW REDBOW
SALT WATER T
GREEN
T
Sta
PREPARED
LUSHU
EACH
BEDBOW
LUSHUS = LUSHUS LUSHUS LUSHUS
SPUT PEAS
KING
ANS
LUSHUS POHERT LUSHUS LUSHUS LUSHU
CLEANER
Stá
ANS . BEANS
TAFFY
Wip
USCA
MARCH
Ma
CHOCOLATE
St
il
KINE
=
IRO
KINE KOSCAR
KOSCAR
.
TO
RDAY
n
-
LARDINES
MJI7-YT3-
- -
Super
KIT
MA
lifto
Secured
LA
I
Family
WIT
the
una
POHERT

Google

cacLan
REPARTS
Childs
LUSHUS
MJ17-YT3RA°2-XAGO LUSHUS LUSHUS (ri LUSHUS LUSHUS LUSHUS REBBOW REOBOW NS BEANS LENTILS UMA HAS LENTIUS BEANS Childs SALT WATEE TAPFY cacLan cov REPARTS Childs -SALT WATER
NS
UMA
SALT
WATEE
cov
-SALT
MJ17-YT3RA°2-XAGO
REOBOW
HAS
LENTIUS
TAPFY
(ri
REBBOW
BEANS
LENTILS
WATER