DNA barcoding is a tool to provide rapid and accurate taxonomic identification using a standard DNA region. A two-marker combination of matK+rbcL was formally proposed as the core barcode for land plants by the Consortium for the Barcode of Life Plant Working Group. However, there are currently no barcoding primers for matK showing high universality in gymnosperms. We used 57 gymnosperm species representing 40 genera, 11 families and four subclasses to evaluate the universality of nine candidate matK primers and one rbcL primer in this study. Primer (1F/724R) of rbcL is proposed here as a universal primer for gymnosperms due to high universality. One of the nine candidate matK primers (Gym_F1A/Gym_R1A) is proposed as the best “universal”matK primer for gymnosperms because of high polymerase chain reaction success and routine generation of high quality bidirectional sequences. A specific matK primer for Ephedra was newly designed in this study, which performed well on the sampled species. The primers proposed here for rbcL and matK can be easily and successfully amplified for most gymnosperms.