Re: Losing decimal precision...

I can’t see how that example would ever give the precision you want.

It will always truncate to the decimal positions in Num2 (i.e. 1) - the precision is lost there.

If you do num1 = num2 / 100 you’ll get what you want.

On Nov 6, 2015, at 6:20 PM, Robert Rogerson <rrogerson@xxxxxxxxxxx> wrote:

I think you're right. I think my example should haave been

D num1 s 7p 3
D num2 s 4p 1

/Free
num2 = 12.3;
num2 = num2 / 100;
num1 = num2;
/Endif

Anyways what I was looking for was wrapping it in %Dec() as you suggested. But like I said it Friday....

Thanks Vern and Alan and have a nice weekend,

Rob

On 11/6/2015 6:10 PM, Vernon Hamberg wrote:

I should have done this first - just tried your code at 7.1 - it made num1 = 0000.123

What version are you on? Any special compile settings or control codes?

Vern

On 11/6/2015 4:59 PM, Robert Rogerson wrote:

Hi, how do I code this statement so num1 = .123 not .1?

D num1 s 7p 3
D num2 s 4p 1

/Free
num2 = 12.3;
num1 = num2 / 100;
/Endif


Can I do this without creating a temp variable?

D num1 s 7p 3
D num2 s 4p 1
d num3 s 4p 3

/Free
num2 = 12.3;
num3 = num2 / 100;
num1 = num3;
/Endif

Thanks, I think it's one of those Friday afternoon things....

Rob

--
This is the RPG programming on the IBM i (AS/400 and iSeries) (RPG400-L) mailing list
To post a message email: RPG400-L@xxxxxxxxxxxx
To subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/rpg400-l
or email: RPG400-L-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives
at http://archive.midrange.com/rpg400-l.

Jon Paris

www.partner400.com
www.SystemiDeveloper.com