I guess you've had no replies to date as you seem to have answered your own question.
Yes go ahead & delete the erroneous entry & make a new one, you are not doing anything wrong.
To remove an entry from Reminders, highlight it & click the minus sign at the foot of the column. This will also remove the entry from the Calendar. However, you will need to also delete the erroneous entry from the register manually.