@Alan, i don't think I'm using a curved blade.

Just a good ol' stanley knife blade. I gave it another go today (just finished up the fret i started on). It isn't THAT bad and I don't think I'm not taking out like chunks of wood, you can see colour differences sometimes but i don't know what that means. Regardless if you're a pro or an amateur though, would you need to touch up the board once your finished with some sand paper?
P.S. Once I get a bit further I'll upload a photo trying to get as close as possible just so you guys can see what is going down and let me know if i raping the fretboard ?