Do I need a high PageSpeed score?

The short answer is: no you don't. Well, at least not necessarily to pass the Core Web Vitals. This is because the Core Web Vitals will get their data from real user experiences. As a result, the circumstances of your visitors play an important role as well, while the overall PageSpeed score might give you a general impression of your performance and UX hygiene.