With the power off, press and hold the (or Windows + V ) keys.

Most modern HP desktops support "Crisis Recovery" (pressing Win + B keys at startup to force a BIOS reflash from a USB drive). Unfortunately, the HP Pro 3500 MT has a primitive implementation. If the primary boot block inside the 25-series SPI flash chip is damaged, the CPU never executes the code to check the USB port.