Forcing a vector's allocator to poin to a specific location

I have simple c_style buffer allocated with custom alignment requirements - 64 byte size alignment and 4096 bytes address alignment. I wish to use a std::vector and allocate it such that it's data pointer points to the above mentioned buffer's location ? Is that possible ? And if it is, then what are possible cons ? I will not be resizing the vector ever during it's lifetime. I am forced to work with vectors and have no choice over it.