Hello bigmac an pgo, again... I was looking at that specification yesterday and after giving it a lot of thought I decided to start from the lowest voltage I found for the OSC1 pin and start verifying every connection before rising the levels, if it doesn't work. I'm on my way to the electronic components store to ask for the inverters and some crystals. Anyway, I'm going to simulate the circuits before putting the real one together and then test the oscillator alone so if something goes wrong I won't blame the wrong component.
Here are the steps I'm going to follow:
1- Build a board that enters monitor mode when reset vector is blank (crystal/capacitors/resistor arrangement to OSC1 and OSC2).
2- Once that board enters monitor mode and I'm certain is working I will switch to the external oscillator.
3- Build a board with an oscillator that can vary its output voltage. I'm working on a crystal based oscillator, if that one doesn't work I will try using the signal generator and the inverter.
4- Connect the external oscillator with the minimum working voltage for OSC1, as the datasheet specifies.
5- If step 4 allows me to enter monitor mode and program/erase the mcu I will raise the oscillator's voltage gradually until I reach the maximum voltage allowed (Vdd=5V) and confirm that it can still work that way.
About the last step I specified I'm not sure the oscillator will work normally with the highest voltage allowed for osc1. As far as I know the "absolute maximum ratings" are specified as the maximum voltage the pin will tolerate before facing destruction (burning something inside) and it's not a "normal working voltage". But I will give it a try. Nevertheless, if it works with VDD=5V and VOSC=0.3 × VREG I think that the minimum voltage is preferred to the maximum voltage in any application.
I will post all the results, but be patient. I think that I will finish in approximately two weeks because this is a personal project (lets say hobbyist level, although I'm not) and all the time I have for it is weekends and spare time. I will try to write something similar to an application note with the signals involved and what I think is relevant, but that will take some extra time as my mother tongue (native language) is Spanish, not English.
Regards.