In this paper, we give a matrix decomposition method used to calculate unified generalized Stirling numbers in an explicit, non-recursive mode, and some of its applications. Then, we define generalized factorial matrices which may be regarded as a generalization in the form of the Vandermonde matrices, and presents some of their properties --- in particular, triangular matrix factors of the inverse matrices of the generalized factorial matrices.