The dynamic infrared sky is only now starting to be explored. The infrared is key to understand elusive stellar fates that are opaque, cold or dusty. The infrared was key to unveiling the otherwise opaque heavy element nucleosynthesis in binary neutron star mergers. I will describe multiple projects to systematically chart the time-domain in the infrared and discuss possible synergies between jointly studying the X-ray and the infrared. I will begin with the ongoing SPitzer InfraRed Intensive Transients Survey (SPIRITS) and the newly commissioned 25 square degree Palomar Gattini-IR surveyor. We have also begun building WINTER - a new 1 sq deg yJH-band camera on a new 1m telescope at Palomar Observatory.