When the source nodes are on the global boundary in the implementation of local boundary integral equation method (LBIEM), singularities in the local boundary integrals need to be treated specially. In the current paper, local integral equations are adopted for the nodes inside the domain and moving least square approximation (MLSA) for the nodes on the global boundary, thus singularities will not occur in the new algorithm. At the same time, approximation errors of boundary integrals are reduced significantly. As applications and numerical tests, Laplace equation and Helmholtz equation problems are considered and excellent numerical results are obtained. Furthermore, when solving the Helmholtz problems, the modified basis functions with wave solutions are adapted to replace the usually-used monomial basis functions. Numerical results show that this treatment is simple and effective and its application is promising in solutions for the wave propagation problem with high wave number.