How can i get rid of roaches and waterbugs, Without an exterminator?

Ive NEVER had any kind of pest in my house, My home is very clean... Since its gotten warmer im seeing roaches and waterbugs in my home but only in my kitchen & sometimes in my hallway. How can i get rid of them without having to call an exterminator (I cant afford to) Please help. Thanks