Human Generated Data

Title

Untitled (man buying cigarettes from woman behind counter)

Date

c. 1950

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14308

Human Generated Data

Title

Untitled (man buying cigarettes from woman behind counter)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Apparel 99.6
Clothing 99.6
Human 99.2
Person 99.2
Person 99.2
Coat 92.9
Shelf 88.6
Lab Coat 87.7
Shop 74.6
Sleeve 73.8
Shirt 71.3
Overcoat 67.6
Suit 64.5
Display 60.1
Electronics 60.1
LCD Screen 60.1
Screen 60.1
Monitor 60.1
Scientist 59
Long Sleeve 57.8
Face 57.3

Imagga
created on 2022-01-29

shop 72.5
tobacco shop 59.9
mercantile establishment 49.4
pharmacist 45.6
professional 40.9
man 36.3
health professional 33.5
place of business 32.8
person 29.4
male 26.9
people 26.8
adult 25.2
clinic 24.7
work 24.3
medical 23.8
indoors 22.8
doctor 22.6
occupation 20.2
business 19.4
working 18.6
smiling 18.1
men 18
computer 17.6
happy 17.5
sitting 17.2
office 17
hospital 16.9
health 16.7
lab coat 16.6
patient 16.4
coat 16.2
establishment 16.2
job 15.9
room 15.6
medicine 15
technology 14.8
senior 14.1
restaurant 14
barbershop 13.9
service 13.9
smile 13.5
profession 13.4
lifestyle 13
home 12.8
worker 12.5
to 12.4
counter 12.3
portrait 11.6
businessman 11.5
looking 11.2
holding 10.7
store 10.4
study 10.3
confident 10
student 10
30s 9.6
equipment 9.6
illness 9.5
table 9.5
talking 9.5
retail 9.5
women 9.5
mature 9.3
laptop 9.1
care 9.1
color 8.9
two people 8.7
standing 8.7
education 8.7
customer 8.6
modern 8.4
20s 8.2
science 8
building 8
together 7.9
face 7.8
middle aged 7.8
lab 7.8
expertise 7.8
laboratory 7.7
monitor 7.7
industry 7.7
old 7.7
casual 7.6
college 7.6
desk 7.6
one 7.5
teamwork 7.4
inside 7.4
treatment 7.3
suit 7.2
school 7.2
team 7.2
interior 7.1
day 7.1

Google
created on 2022-01-29

Black 89.5
Black-and-white 86.3
Coat 85.8
Style 83.9
Eyewear 77.8
Monochrome photography 75.7
Monochrome 74.2
Science 70.2
Retail 70
Service 66.7
Room 66.6
Customer 65.4
Stock photography 64.7
Font 64.7
Glass 64.2
Hat 61.3
Medical 60.9
Building 59.6
Display case 58.4
Shelf 56.8

Microsoft
created on 2022-01-29

text 99.8
indoor 96.9
person 95.3
man 91
clothing 89.9
standing 85.1
open 73.7
office 58.8
black and white 55.2
table 26.8
shop 22.8

Face analysis

Amazon

Google

AWS Rekognition

Age 24-34
Gender Female, 99.2%
Surprised 50.6%
Calm 36.7%
Sad 3.9%
Happy 3.5%
Angry 1.5%
Confused 1.4%
Fear 1.3%
Disgusted 1.1%

AWS Rekognition

Age 23-31
Gender Male, 98.7%
Sad 96.9%
Calm 1.1%
Angry 0.5%
Confused 0.5%
Fear 0.4%
Disgusted 0.4%
Surprised 0.2%
Happy 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a man standing in front of a refrigerator 83.7%
a man standing in front of an open refrigerator 74%
a man that is standing in front of a refrigerator 73.9%

Text analysis

Amazon

LA
LA VENGA
VENGA
CALATRAVA
BERING
ROYALIST
HAVANA
FACTORY
MJI7
E
JUAN TEFUCA
MJI7 YESTAL АЗДА
THE
BARKALOV
АЗДА
BARKALOV BIRDS
JUAN FUCA
BIRDS
YESTAL
EST
KOREAN

Google

LA VENGA MJ17 YI37A2 A33A
LA
MJ17
YI37A2
VENGA
A33A