Ken, I have found that this condition is usually caused by the presence of a small amount of oil or grease residue left on the rim and brake block after building a wheel. The first thing I would try, before cutting or grinding material off your brake block, is to wipe the rims and brake blocks down thoroughly with lacquer thinner or acetone on a clean rag.
Bill Crowell
Diamond Springs, CA