Why does Access insist on staying open after a connection has been closed and how can I change this?

For example, both locally and remote, when a connection to Access has been opened, it doesn't close for several minutes. I can't overwrite the database, I can't rename it or otherwise change it until it closes. This is frustrating because when I upload for testing then need to make a change, I can't.

Is there a solution to this?