No. It's not blood. The brown color comes from the pigment, BILIRUBIN, which is a breakdown product of hemoglobin. Red blood cells have a normal lifespan of about 3 months. Old ones are broken down and their iron is recycled for use in producing new red blood cells, but the old hemoglobin is a potentially dangerous oxidant, and you can't have it just floating around, it would cause lots of problems, so it is broken down into less toxic components. One of the products of that breakdown is bilirubin, which is delivered into the intestine in bile and is ultimately excreted in feces--that's where the brown comes from.
If there is really blood in your feces, that's bad, but the presence of blood causes your feces to be a different color, depending on where the blood is coming from. If the blood is entering from the stomach or upper intestine, the feces is BLACK and has small particles in it that resemble coffee grounds. If the bleeding is from lower in your intestinal tract, then the feces is RED.