yes, exactly!!!
it is not in the movies, but when you read the companion, canon written material-for either the movie > novel or the stand alone books like AFTERMATH trilogy, you get a better scope of the size of the imperial military and the rebellion
the imperial forces number in the multi millions of personnel, there are individual militaries from planets that are part of the imperial forces, private armies fighting for the empire ,etc (in the CLONE WARS we only really saw the republic's clone trooper forces, but we know that there were many other human and non human armies fighting for the republic as well as non-droid forces for the separatists --every rebel pilot/ leader of any experience by ep 4 got that exp in the clone wars--gen Dodonna, Merrick, etc) and the same fighting for or at least- passively supporting the rebellion
point is?- yes, the galaxy is huge and there is so much more room to tell so many more stories that involve NO Skywalker, Solo, Kenobi or the appearance of R2D2 and 3PO.