Personal history of colorectal polyps or colorectal cancer If you have a history of adenomatous polyps (adenomas), you are at increased risk of developing colorectal cancer. This is especially true if the polyps are large or if there are many of them.