Thanks for the suggestion, I didn't really think of that because I didn't really playtest my game a lot. Which was kind of an mistake on my end.
Uhh pretty bad, had to git revert a lot because everything was depending on one very badly written shader.