The recently played list only shows the 2 most recent servers you played or it removes the most recent for the new one not sure which way it works, you can just go through the server list and pick the server you want if you are playing more than 2 servers. The ninja is still there just you have to manually pick the server now if you keep playing on 3 different servers.