Once you strip it as deep as you think you need, put down a layer of landscape fabric before putting the gravel down. I'd go with a deep bed (4-6") of crusher run in two layers and compact each one. A plate compactor will work well, especially if the gravel is damp, and several runs of the compactor over the crusher run will have it almost like pavement.
Very good process, when you think your done compacting do it one more time.
When we install paver patios and walks, we put down a minimum of two inches of crusher run, compact it, then put down 2" of rock dust, scree it level, and then place our pavers. Then we sweep polymeric sand into the joints, and compact the pavers and sand, then reapply the sand to fill the joints. We've yet to have a walk or patio of ours settle.
Where are you located that this works? we never do less than 6" base then 1" crushed #8 limestone
For something that will get continuous heavy loads like a car, I'd go with a thicker layer. If ever you decide to pave it, you already have the base prepared.
for a driveway with pavers we do 10-12" of base
Not critiquing your work just that the process varies greatly from north to south.