use of long numbers in python for numerical check of precision of a function: which library?
by floppy_stuttgart from LinuxQuestions.org on (#5KGPC)
Hello,
what is a limit for 64bits PC and the use of float? I have a function and would like to compare its precision with other simplified functions. For this, I would like to start comparison with the 15th digit after the ",".
I see "decimal" is an option https://www.programiz.com/python-programming/numbers
Has anybody any other proposal what I should use for a 64bit PC? (the function has few terms, is not a series and therefore dont need to converge, has pi in it, square, quadrate, integer numbers).
Any advice is welcome.
what is a limit for 64bits PC and the use of float? I have a function and would like to compare its precision with other simplified functions. For this, I would like to start comparison with the 15th digit after the ",".
I see "decimal" is an option https://www.programiz.com/python-programming/numbers
Has anybody any other proposal what I should use for a 64bit PC? (the function has few terms, is not a series and therefore dont need to converge, has pi in it, square, quadrate, integer numbers).
Any advice is welcome.