Re: rules for SQL division and rounding?

If you have two INTs as operands, you get an INT back...

Simple enough...from Rob's First link...

- Two integer operands
<https://www.ibm.com/support/knowledgecenter/ssw_ibm_i_73/db2/rbafz2intoper.htm?view=kc>
If both operands of an arithmetic operator are integers with zero scale,
the operation is performed in binary, and the result is a large integer
unless either (or both) operand is a big integer, in which case the result
is a big integer. Any remainder of division is lost. The result of an
integer arithmetic operation (including *unary minus*) must be within
the range of large or big integers. If either integer operand has nonzero
scale, it is converted to a decimal operand with the same precision and
scale.


- Integer and decimal operands
<https://www.ibm.com/support/knowledgecenter/ssw_ibm_i_73/db2/rbafzintdecoper.htm?view=kc>
If one operand is an integer with zero scale and the other is decimal,
the operation is performed in decimal using a temporary copy of the integer
that has been converted to a decimal number with precision and scale 0.


On Tue, Oct 23, 2018 at 1:50 PM Steve Richter <stephenrichter@xxxxxxxxx>
wrote:

On Tue, Oct 23, 2018 at 3:29 PM Rob Berendt <rob@xxxxxxxxx> wrote:

General rules are here

https://www.ibm.com/support/knowledgecenter/ssw_ibm_i_73/db2/rbafzwarithop.htm

and here

https://www.ibm.com/support/knowledgecenter/ssw_ibm_i_73/db2/rbafznumass.htm

It would help to know the exact type of the source variables:
a.numMonthsActive, a.sumQtyShip

both of those values are returned from sql functions that return decimal.
For some reason the system must have coerced the values to INT.

CREATE OR REPLACE FUNCTION hsdet_SumShipQty(
inCono decimal(2,0),
inItno char(27),
inFromDate date,
inToDate date,
inWhid char(2) default ' ')
RETURNS decimal(7,0)
language sql

CREATE OR REPLACE FUNCTION hsdet_NumMonthsActive(
inCono decimal(2,0),
inItno char(27),
inFromDate date,
inToDate date,
inWhid char(2))
RETURNS decimal(5,0)
language sql
--
This is the Midrange Systems Technical Discussion (MIDRANGE-L) mailing list
To post a message email: MIDRANGE-L@xxxxxxxxxxxx
To subscribe, unsubscribe, or change list options,
visit: https://lists.midrange.com/mailman/listinfo/midrange-l
or email: MIDRANGE-L-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives
at https://archive.midrange.com/midrange-l.

Please contact support@xxxxxxxxxxxx for any subscription related
questions.

Help support midrange.com by shopping at amazon.com with our affiliate
link: http://amzn.to/2dEadiD