The Local Medical Committee in Devon say the system wrongly suggests that some surgeries are inadequate.
They've asked the Care Quality Commission, which has published the ratings online, to revise or withdraw them.
The Local Medical Committee says they're partly based on scores GPs achieved for a 'box-ticking' initiative, which Devon practices agreed with the NHS to suspend last year.