Thank you, I suspected this is where I remembered it from, I had narrowed it down in my memory to either this book, or something from Vernor Vinge.

And more generally the concept is known as a China brain