Just start it, hopefully you can make it a success before they find you. eventually the local government will find you and most likely demand you have a business license, a food handler's license, a commissary that is not your home kitchen, and inspections. Making food is the wrong sector if you want low/no regulations. Canada is more strict, you might want to look into it before you launch your business.
I am interested in finding out if I am legally able to sell baked products from my home, and if I need to register or have any licenses.