My County FA isn’t running any courses, but the one next door is, can I finish my course with them?

No unfortunately not. As the County FA that you started with ‘owns’ your registration, you will need to finish your qualification with the County FA or centre that you started with.