Back-in-the-day, when a microcontroller could run at 32 MHz or more, but had no internal frequency multiplier, I used oscillators, as it could be a pain to get a crystal to oscillate correctly much above 22 MHz. Oscillators solved that problem.
The caveat I found was that I had PCB traces with frequencies near or above 30 MHz, which is the lower limit for radiated emission measurements in generic EMC standards. The clock and its overtones can be very happy to show up when doing EMC tests.
Also, back then, oscillators tended to be power hungry. That has most likely changed a lot over the decades.
Since microcontrollers began to have internal frequency multipliers, DLLs and all that (along with USARTs that can work with fractions), I have typically used a 4 MHz crystal. Then frequencies in the VHF range and above are mainly confined to the silicon chip inside the microcontroller. No PCB traces, and smaller area ==> fewer EMC worries.
I don't find crystals hard to use, but @Andrew Neil is absolutely right that one should download and study AN2867, as opposed to throwing something random on the board.