One of the main challenges in optical hydrogen sensing is the stability of the sensor material. We found and studied an optimized material combination for fast and reliable optical palladium-based hydrogen sensing devices. It consists of a palladium-nickel alloy that is buffered by calcium fluoride and capped with a very thin layer of platinum. Our system shows response times below 10 s and almost no short-term aging effects. Furthermore, we successfully incorporated this optimized material system into plasmonic nanostructures, laying the foundation for a stable and sensitive hydrogen detector