Can you please specify what are the xml packages that you are talking about here?
When you move any folders from 10.5 to 10.4.1, it will cause the environment to be unstable and it is advised not to do so unless suggested by Informatica Support.
Let me know if you are trying to export the design objects such as mapping/workflow from QA(10.5) and prod(10.4.1)?
If so, this is not possible, we can not export a file from higher version to lower version whereas vice versa is possible. The objects can be exported from lower version and imported in higher version after upgrading the XML schema using the below command :
infacmd mrs UpgradeExportedObjects