A good source of information and advice would be your county extension agent.
www.csrees.usda.gov/Extension/ They will, of course, be primarily interested in agriculture, but they will have information for the gardener and probably be able to point you to any local resources that may be available like gardening clubs, etc.
Deciding what to grow depends as much on where you are as it does on what you want. You need to choose the plants (breeds, not species) based on your local weather patterns, and a local gardener can assist you with that. While it is possible to raise a plant in a hostile environment, a beginner shouldn't try learning with something that will take special care.