Obviously, there are ways to measure and debug these things in a development environment (profilers, NSight, RenderDoc). But how do you gain confidence things are working well in the wild with diverse hardware setups?

I'm thinking about starting a project to help track and measure these types of issues -- sort of like Sentry.io for game performance.

Some pain points I’ve heard and experienced myself: - Game performance is assessed too late in the development cycle - Getting data from a wide range of devices is time consuming - Difficulty enforcing art budgets and performance standards across the team - Challenges identifying the root cause of slow-downs based on player reports - Limited data

How are you handling performance debugging and optimization? What’s missing and how would your dream tool improve this?