inv and pinv will invert a permutation matrix, preserving its specialness. det can be applied to a permutation matrix, efficiently calculating the sign of the permutation (which is equal to the determinant).
A permutation matrix can also be returned from the built-in functions lu and qr, if a pivoted factorization is requested.