Unable to source path during non-interactive ssh session

In a cluster, non-interactive batch mode, ssh session somehow do not "source" the PATH at /etc/profile or /etc/profile.d/*.sh when launched in an non-interactive mode. For non-interactive mode, ssh session only "source" path the standard binary path such as /usr/local/bin, /usr/bin etc

If your binaries which are placed in non-standard paths and are required to be sourced during the non-interactive session, remember to create .bashrc and .bash_profile file at your home folder and place your sourcing there.
For example:
source PATH=/usr/mpi/gcc/bin:$PATH

In an interactive mode, you should be able to source the PATH provided at /etc/profile or /etc/profile.d