The Internet was initially developed for the military and then extended for academic use. Capitalism wasn't needed to create it. And neither does "not the capitalism we have in the west today" equal to "soviet communism" - it's neither a binary distinction nor is it a one dimensional spectrum.
It wouldn't have become the internet of today without capitalism. The government / military certainly didn't finance everything that happened after it was created.