So ... I frogged it again. And then stuck with my idea to work it back to front, so I started with the garter stitch part. It's a bit bigger than 200 stitches because of the way I cast on. But it's working well and I am enjoying this project. However I will be happy when it's finished and I can wear it!