Why doesn't ~x toggle bits (where x is an unsigned integer)

I want to toggle bits of an unsigned integer. Let us say I have an integer x. Why doesn't ~x return the number with toggled bits?