Dear Keisuke,
Yes, when the security block is not used, no external 32kHz crystal is needed and the pin connections you proposed would work.
Please, be careful, though – as per the Figure 9-1 of the Reference Manual, the 2 intermediate clocks, LPRC and LFSR, are used for the LPTMR counter and PLL4 blocks, respectively. If you need them for your application, the only alternative would be using the built-in 128kHz IRC (i.e. crystal-less) oscillator instead; it is less accurate but might be good enough for your application.
Sincerely, Naoum Gitnik.