If you wanted to get started, and the FWD platform is what you can afford, then that's not a bad way to go. 90% of us on this forum are working with FWD SR20-powered chassis.
The enthusiast in my would recommend you wait and save up for the Silvia, but you would gain just as much experience working with a Primera instead. It may be the most practical route to take if money is tight. You can avoid the drift tax.
You could also just start working on your own daily vehicle. Instead of buying another Primera? I guess you don't want to swap in the SR20DET on the daily though... Lots of down time.