First it was just an error with my existing redirects, then the plugin redirected my front page. Luckily, there is a solution