@TheFuzzStone@fosstodon.org are you in many big channels? because if you get out of sync the server may take a long time to build up the state to sync to you.
they are building a better sync, but it's not rolled out yet, afaik.