Hey there. You should check out Peauproductions visible light filter offerings.
The problem sounds like you’ve removed the IR Filter, but not placed any sort of visible light filter on the system.
There are a few ways you can address this. One is the pre-made filters which PeauProductions and a few others sell. These ranges from glass filters with a “red/gold” mirrored side to Acrylic edges which can be used as well. Another options is to use exposed 35mm film and cut a couple of pieces to fit over the bottom of your lens.
If you’re lens is difficult to get under, I suggest getting a putting an acrylic or full size filter over the top. This takes more material but is quite functional. I use this method for testing lens and new cameras.
what frequency is your IR light? You’ll want to match your filter to the frequency—this is the frequency of light that is allowed through the filter.