How to kill a metaflow job that is running in an instance locally, aborting the job via commandline doesnt actually stop the job execution, I could still the job running in metaflow ui

You probably "killed" the job in the cli by doing ctrl-c multiple times. You need to do it just once. When you kill a job, it first kills the job, then sends a message to metafile that the job is killed. When you do it multiple times in a row, you kill the job then you kill the job that tells metaflow you killed the job so metaflow never gets the message