Bridging the gap between Numerical analysis and Physics-informed Machine Learning: Stability and Theoretical Convergence for Stiff ODEs and PDEs