No. As a researcher, you can make it your goal to find/invent a smallest possible architecture for a given task (in terms of number parameters, or number of operations). Alternatively, you can try to invent an architecture to learn faster from data (or require less data to achieve state of the art results).
Hobbyist researcher? Seems like a more accessible plan anyway; fuck bothering with huge datasets and long training times and just focus on optimizing small architecture.
