In this study, a novel hierarchical approach is investigated to extract coronary vessel from X-ray angiogram. First, we propose to combine Decimation-free Directional Filter Bank (DDFB) and Homographic Filtering (HF)in order to enhance X-ray coronary angiographic image for segmentation purposes. Because the blood vesselensures that blood flows in only one direction on vessel branch, the DDFB filter is suitable to be used toenhance the vessels at different orientations and radius. In the combination with HF filter, our method cansimultaneously normalize the brightness across the image and increases contrast. Next, a coarse-to-finestrategy for iterative segmentation based on Otsu algorithm is applied to extract the main coronary vessels indifferent sizes. Furthermore, we also propose a new approach to segment very small vessels. Specifically,based on information of the main extracted vessels, we introduce a new method to extract junctions on thevascular tree and level of nodes on the tree. Then, the window based segmentation is applied to locate andextract the small vessels. Experimental results on our coronary X-ray angiography dataset demonstrate thatthe proposed approach can outperform standard method and attain the accuracy of 71.34%.