Implement Numpy library in C++

I'm trying to implement a python Numpy library in C++.
I was inspired by xtensor and numcpp. Looks like they both have very different implementations. I want to support the N-Dimensional matrices and perform Numpy operations on them efficiently without worrying about the memory leaks. How do I start? I am new to this forum, apologizing for any misinformation.