Ultravision is vision in the ultraviolet range; infravision is vision in the infrared (heat) range. Infravision and ultravision would not be affected by the presence or absence of light in the visible spectrum (red through violet) because infrared and ultraviolet wavelengths are outside this range.

So yes, you could have a room totally lacking light in the visible range, that was clear as day to a high elf because the objects in it were warm, and therefore emitting infrared wavelengths that could be seen with infravision. Likewise you could have something radiating in the ultraviolet range, visible to ultravision but totally dark to a human seeing only the visible range.