This paper proposes an algorithm to detect the stop line and crosswalk on the road surface using edge information and blob coloring. The detection has been considered as an important area of autonomous vehicle technologies. The proposed algorithm is composed of three phases: 1) hypothesis generation of stop lines, 2) hypothesis generation of crosswalks, and 3) hypothesis verification of stop lines. The last two phases are not performed if the first phase does not provide a hypothesis of a stop line. The last one is carried out by the combination of both hypotheses of stop lines and crosswalks, and determines the stop lines among stop line hypotheses. The proposed algorithm is proven to be effective through experiments with various images captured on the roads.