Norin-PL8 is a cold-tolerant variety of rice (Oryza sativa L.) that was developed by introgressing chromosomal segments from a cold-tolerant javanica variety, Silewah. We previously detected quantitative trait loci (QTLs) for cold tolerance of Norin-PL8 in the introgressions on chromosomes 3 and 4. We provide fine mapping of the QTLs on chromosome 4 and the association between the QTLs and anther length, which has been reported to be a major component of cold tolerance. Interval mapping using a segregating population derived from an advanced backcross progeny indicated that a QTL for cold tolerance is probably located from the center to the proximal end of the introgression. For fine mapping, we developed a set of near-isogenic lines (NILs) from recombinants in the segregating population. Comparison of cold tolerance between the NILs indicated that either the proximal end or the center of the introgression is necessary for cold tolerance. From these results, we concluded that there are at least two QTLs for cold tolerance, tentatively designated as Ctb-1 and Ctb-2, in the introgression on chromosome 4. The map distance between Ctb-1 and Ctb-2 is estimated to be 4.7–17.2 cM. In order to investigate the mechanism underlying cold tolerance by the QTLs, we compared anther lengths of the NILs. The results indicate that both Ctb-1 and Ctb-2 are associated with anther length.