Magnetic properties and Mott transition in the square-lattice Hubbard model with frustration

The magnetic properties and Mott transition of the Hubbard model on the square lattice with frustration are studied at half-filling and zero temperature by the variational cluster approximation. When the on-site repulsion $U$ is large, magnetically disordered state is realized in highly frustrated region between the N\'eel and collinear phases, and no imcommensurate magnetic states are found there. As for the Mott transition, in addition to the Mott gap and double occupancy, which clarify the nature of the transition, the structure of the self-energy in the spectral representation is studied in detail below and above the Mott transition point. The spectral structure of the self-energy is almost featureless in the metallic phase, but clear single dispersion, leading to the Mott gap, appears in the Mott insulator phase.