Objective To compare the clinical efficacies among the combined therapy of warm needling and rehabilitation, simple warm needling and rehabilitation therapy for knee osteoarthritis (OA). Methods Ninty cases of OA were divided randomly into three groups, 30 cases in each one. In an acupuncture and rehabilitation group, warm needling was applied at the acupoints such as Xuehai (血海SP 10), Neixiyan (内膝眼 EX-LE 4), Dubi (犊鼻 ST 35) and Zusanli(足三里ST 36) etc.. Additionally, rehabilitation therapy was combined such as joint gymnastics, isometric exercise, stretching exercise and endurance training. In the warm needling group, warm needling was given simply. In the rehabilitation group, rehabilitation therapy was only adopted. The joint pain scale and severity index scale of knee OA were taken as the efficacy assessment indices among the groups. Results The clinical cured rate was 36.7% (11/30) in acupuncture and rehabilitation group, which was superior to 13.3% (4/30) in warm needling group and 13.3% (4/30) in rehabilitation group (both P〈0.01) separately. The results of the joint pain scale and severity index scale of knee joint OA in three groups after 1 session and 2 sessions of treatment were reduced obviously as compared with those before treatment (P〈0.01, P〈0.05). After 2 sessions of treatment, every index in acupuncture and rehabilitation group was reduced much more obviously as compared with that in the other two groups (all P〈0,01). Conclusion Warm needling in combination with rehabilitation therapy has good efficacy on knee OA and relieves remarkably the symptoms of it, which is superior to those in either simple warm needling or rehabilitation training therapy.