How far down should the foundation on a block wall go?

Hi, if I want to build a cinder block wall for a fence (not a bearing wall on a house), what is the rule of thumb on how far down the foundation should be dug? The finished will will be 10 to 12 feet high.