Mathematical questions concerning floating point numbers, a finite approximation of the real numbers used in computing.
Questions tagged [floating-point]
465 questions
-1
votes
2 answers
least integer not represented in floating point system
Given a floating point system defined as: $F = \{x = (\frac{m}{\beta^t})\beta^e = m\beta^{e-t}\}$, where $m$ is an integer $m \in [1, \beta^t]$, $e$ is an arbitrary integer, and $\beta$ is an integer $\beta \geq 2$. Find an exact formula for the…
Frank
- 880
-1
votes
1 answer
Getting precision of integer given a float precision point
Let's say I have the number 1234567 and I want to get the value 12.34567 with a precision point of 0.01. How would I go about doing this?
If I multiply the precision point and the number, I end up with 12345.67 which is the opposite of what I need…
SnowPie
- 1
-2
votes
1 answer
Converting a number into IEEE floating point format
I have the number 1 00111 010 where there is one signed bit, 5 bits for exp and 3 for frac. I got that the value of it is -1/1024 but I'm not sure if that's right. I also need to get the format B of the representation where there is one signed bit,…
kts
- 1
-3
votes
1 answer
trouble understanding floating point representation
I had a quiz last week on floating point representation. After he graded the quiz, he walked us through each step so that we could see what we did wrong. I took notes so that I could study his procedure but no matter how much I try, I can't get the…
shoebox
- 5
- 3