I have been told that I shouldn't worry about breast cancer, since it was on my dad's side of the family. How true is this all of the women have had breast cancer.

No the cause was not from HPV. I also have a history in my family of cervical cancer along with severe endometriosis. Due to my family history, the OBGYN thought it would be the safetest route for me to take. Which I do not regret. I have an aunt on my maternal grandmother's side that died from cervical cancer. She said that when they sent the ovaries, cervix and urteus in to the pathologist, that anyway they sliced it (pardon the pun) everything was full of precancerous cells. I was told to have a paps and pelvic every couple of years to keep a watch on things, but that I should not any further problems.

Hi Anonymous,
While I do see the point of not wanting to worry needlessly about a condition you don't currently have, I do believe in preparing yourself and preventing where possible. Here is some information I located on a reputable website regarding breast cancer and inheritance:
http://ghr.nlm.nih.gov/condition/breast-cancer
I'm not sure if your doctor would perform a breast cancer antigen (BRCA-1, and BRCA-2) test to see if you carry markers for increased risk for developing the disease knowing your family medical history. As stated in the webpage, "It is important to note that people inherit an increased risk of cancer, not the disease itself. Not all people who inherit mutations in these genes will develop cancer."
Have you asked your doctor if you can have the test? Let us know what they say, and what results you receive. Regardless, here are some general suggestions for living a healthy life to decrease risk for developing cancer, or other conditions for that matter:
http://www.cancer.gov/cancertopics/pdq/prevention/breast/patient/