You’ll feel isolated from peers. You might not have an environment conducive to work. Poor work/life boundaries.

If the company also works in-office then you're probably missing out on organic communication. You'll be lucky to have people that spread news of changes that happen in person to you. In many cases you're the easiest lay-off too. If someone has to lay you off in person, they might not want to. The remotes will be first.

If the entire company is remote, there is a lot of disorganization, missed opportunities to keep things in sync. And the organization may sometimes also become flatter (less hierarchy). While less hierarchy sounds good, it also comes with the balance that you're more responsible for a bad decision (because often you have to make more decisions).

The best thing, obviously, is earning potentially a million in 3-8 years (depending on your comp) without having to drive to an office.

passive career stagnation. Your bugs are always visible remotely but your quiet daily impact isn't. The people physically seen in the office tend to get promoted faster