I’m pre-revenue, do I need to file taxes?

Yes. If you are a C-Corporation, which most funded startups are, you need to file Form 1120 with the IRS every year, even if there is no activity. There may also be additional reporting requirements with various states you are located in. Failure to file is a disclosable event during due diligence and could put future fundraising at risk.