Why computer takes more time in arranging different permutations?

I just learned the heap's algorithm. Well the larger the number of objects get the more time the system takes to arrange them in all possible permutations. But when i calculate the the factorial of that number of objects in a calculator the results are instant. Why does it happen that same no. of permutations take more time than calculating the factorial?