The invention discloses a burr removing tool for transverse holes of shafts. The burr removing tool comprises a spindle. One end of the spindle is fixedly connected with an output shaft of a drilling machine, a connector is connected to the other end of the spindle and is divided into two portions, the first portion of the connector is close to the spindle, the second portion of the connector is far away from the spindle, a guide pin is fixedly connected to the center of the end surface of the end, which is far away from the spindle, of the second portion, a groove I is formed in a side surface of the guide pin along the axial direction of the guide pin, a plane is arranged at the bottom of the groove I, a cutter capable of sliding along the axial direction of the guide pin is fixed into the groove I, and a cutting edge of the cutter faces outwardly. The burr removing tool has the advantages that the spindle can be driven by the drilling machine to rotate, the transverse holes of the shafts can be chamfered when the cutter rotates along with the spindle, burr at orifices of the transverse holes of the shafts can be simultaneously removed, accordingly, the machining efficiency can be improved for the transverse holes of the shafts, the time can be saved, and the burr removing tool is suitable for meeting requirements on machining the shafts on a large scale.