Use past modals (should have, could have, would have + past participle) to talk about the PAST: regrets, criticism, missed opportunities, or past possibilities that didn't happen.
Practice tip: Regret/criticism? SHOULD HAVE. Past possibility? COULD HAVE. Past conditional? WOULD HAVE. Always use HAVE + past participle!