Math

[MyndFyre]

You don't suppose VB uses its own floating-point library from the days that most computers didn't have coprocessors, do you?

[l2k-Shadow]

Code Select Expand


Sub form_load()
Dim a#, b#, c#, d#
    a = (8000 * 0.3)
    b = 8000 * 3
    c = b / 10
    d = a - c
    Text1.Text = d
    'Answer = 0
End Sub


[FrOzeN]

I just used

Code Select Expand


Sub form_load()
Dim a As Double
    a = 8000 * 0.3 - 8000 * 3 / 10
    Text1.Text = a
End Sub

and got -8.88178419700125E-14 .. what's the problem?

The problem is that it returns the wrong answer, it should be 0.

[l2k-Shadow]

I just used

Code Select Expand


Sub form_load()
Dim a As Double
    a = 8000 * 0.3 - 8000 * 3 / 10
    Text1.Text = a
End Sub

and got -8.88178419700125E-14 .. what's the problem?

The problem is that it returns the wrong answer, it should be 0.

Yeah I just realized that, edited my post.

[111787]

Question: What order does it do it in?
I cant produce that answer doing it in any order.

[Adron]

Question: What order does it do it in?
I cant produce that answer doing it in any order.

Regular math evaluation order... And copying the expression exactly as I typed it should give the nonzero result.

What I was originally doing was take 30% of an input value, and round it down to the nearest integer, i.e. Fix(x * 0.30), and this turned out to be 2399 for the input 8000. Which I thought was kinda odd...

[Tazo]

which would be
Parenthesees
Exponents
Multiplication
Division
Addition
Subtraction

[rabbit]

Question: What order does it do it in?
I cant produce that answer doing it in any order.

Regular math evaluation order... And copying the expression exactly as I typed it should give the nonzero result.

What I was originally doing was take 30% of an input value, and round it down to the nearest integer, i.e. Fix(x * 0.30), and this turned out to be 2399 for the input 8000. Which I thought was kinda odd...

1/3 is 0.333333

[Explicit]

Question: What order does it do it in?
I cant produce that answer doing it in any order.

Regular math evaluation order... And copying the expression exactly as I typed it should give the nonzero result.

What I was originally doing was take 30% of an input value, and round it down to the nearest integer, i.e. Fix(x * 0.30), and this turned out to be 2399 for the input 8000. Which I thought was kinda odd...

1/3 is 0.333333

Where are you even getting 1/3 from?

[rabbit]

I have no clue...I guess I was spacing out..

O well, it was a random fun fact I guess

[Explicit]

I have no clue...I guess I was spacing out..

O well, it was a random fun fact I guess

Silly rabbit, fun facts are for kids! 

[rabbit]

Wow.  That wasn't funny the first time.  Nor the second time.  Why the hell would it be funny the seven hundred twenty first time?

[iNsaNe]

How is this hard. The equation is basically the same on both sides. The rule is PEMDAS stated above, Parenthesis, Exponents, Multiplication OR Division (Left to Right), Addition OR Subtraction(Left to Right).

The original equation: 8000 × 0.3 - 8000 × 3 / 10
- Since PEMDAS goes in order from Multiplication OR division from Left to Right, the "× 3 / 10" means × 0.3

The equation basically says:

= (8000 × 0.3) - (8000 × 0.3)
= 0

Why is it necessary to go in such depth?

[l2k-Shadow]

How is this hard. The equation is basically the same on both sides. The rule is PEMDAS stated above, Parenthesis, Exponents, Multiplication OR Division (Left to Right), Addition OR Subtraction(Left to Right).

The original equation: 8000 × 0.3 - 8000 × 3 / 10
- Since PEMDAS goes in order from Multiplication OR division from Left to Right, the "× 3 / 10" means × 0.3

The equation basically says:

= (8000 × 0.3) - (8000 × 0.3)
= 0

Why is it necessary to go in such depth?

don't bring up 1 month+ old topics please