Your project sounds really interesting, you should make a devlog of your own.
When I started, my renderer was at single digits and at that moment it felt like it was impossible for me to get anything working in real time. I was stubborn, and eventually it got better. So keep at it!
The biggest optimizations weren't focused on low level hardware, don't get me wrong, those helped to improve the framerate, but the biggest improvements were changing the way I was doing things. Finding a smarter way to calculate things, to cache everything, to draw only what's really needed, etc.
Good luck with your project!