A guy in the comments pointed out some structural issues with the brake setup. Gotta thank him for that.