Keep getting a 1064 (MySQL) error when trying to run mix test

That’s usually correct. Also worth noting that if you upgrade you sometimes need to run an upgrade to update your DBs too (so always check release notes).