Re: iSphere compare editor encoding issue -- WDSCI-L

Lukasz,

Eventually I could reproduce and fix the problem. I assume that I can upload a new iSphere version this evening.

Thomas.

-----Ursprüngliche Nachricht-----
Von: WDSCI-L [mailto:wdsci-l-bounces@xxxxxxxxxxxx] Im Auftrag von Zyto45 Zuzel
Gesendet: Donnerstag, 16. November 2017 09:29
An: Rational Developer for IBM i / Websphere Development Studio Client for System i & iSeries
Betreff: Re: [WDSCI-L] iSphere compare editor encoding issue

Hi,

thanks for checking!

I will try to explain exactly how it looks. I have two source files. I have tried different CCSID and it seems it has no influence here. At the moment one file has CCSID(1141) and another has CCSID(273). In both files there is a member with line like:

D VO C CONST('üJKLMNOPQR')

When I open it in LPEX editor it looks fine. I did a test with different encoding setting for entire workspace and it seems it also does not have influence on the issue. The only problem is when I try to use compare editor. The result is like this:

D VO C CONST(' JKLMNOPQR')

ü (0xC3BC) is converted to (0xef 0xbf 0xbd REPLACEMENT CHARACTER). What is more, when I make some changes in compare editor and save the member, it is saved with wrongly encoded characters. It is not a problem when special character is in comment section but in this case it changes program's logic as well.

The same member opened in LPEX editor after save in compare editor:

D VO C CONST(' JKLMNOPQR')

Best Regards,
Lukasz.

2017-11-16 8:34 GMT+01:00 Thomas Raddatz <thomas.raddatz@xxxxxx>:

So far I am lost with reproducing the problem, because for me using a
source file with encoding 1208 (UTF-8) does not work at all.

Here is what I tried to reproduce the problem:

1) Precondition: my workspace is set to Cp1252, which is the default
Windows encoding
2) Started the test case with creating a source physical file like this:
crtsrcpf raddatz/qsrc1208 ccsid(1208)
3) Added two fresh members.
4) Started the iSphere compare editor and got nothing but garbage.
5) Opened the members with the Lpex editor and got the same garbage.
6) Changed workspace encoding to utf-8.
7) Removed the members from the "RemoteSystemsTempFiles" folder.
8) Opened the members with the Lpex editor and got the same garbage again.

When I debug the iSphere compare editor, then the downloaded resource
files are reported as UTF-8:

System.out.println(((IFile)fLeftResource).getCharset());

But when I open the files, I cannot properly decode them with Notepad++.
All I see is garbage. Hence I am sure it is not utf-8.

iSphere uses the
"QSYSEditableRemoteSourceFileMember.download(IProgressMonitor
monitor)" method for downloading the members and I expect that the
Lpex editor does it the same way. I wonder whether the problem is in
QSYSEditableRemoteSourceFileMember.

Last but not least I did my tests with RDP 8.0 and RDi 9.5.1.2 with
the same results.

Did I do or understand something wrong?

Thomas.

-----Ursprüngliche Nachricht-----
Von: WDSCI-L [mailto:wdsci-l-bounces@xxxxxxxxxxxx] Im Auftrag von
Zyto45 Zuzel
Gesendet: Mittwoch, 15. November 2017 11:36
An: wdsci-l@xxxxxxxxxxxx
Betreff: [WDSCI-L] iSphere compare editor encoding issue

Hi,

I am experiencing some issues while using iSphere Comprae Editor
(3.1.1.r) on sources which contain special characters encoded in
UTF-8. My workspace setup in RDi is set to UTF-8 but still when I use
compare editor all unicode characters are replaced by substitute
character (SUB). It seems like compare editor is not using UTF-8
encoding. I could not find any configuration that would change this
behavior. Do you have any idea if it is possible to force UTF-8 encoding in compare editor?

Thanks!
--
This is the Rational Developer for IBM i / Websphere Development
Studio Client for System i & iSeries (WDSCI-L) mailing list To post a
message
email: WDSCI-L@xxxxxxxxxxxx To subscribe, unsubscribe, or change list
options,
visit: https://lists.midrange.com/mailman/listinfo/wdsci-l
or email: WDSCI-L-request@xxxxxxxxxxxx Before posting, please take a
moment to review the archives at https://archive.midrange.com/wdsci-l.
--
IMPORTANT NOTICE:
This email is confidential, may be legally privileged, and is for the
intended recipient only. Access, disclosure, copying, distribution, or
reliance on any of it by anyone else is prohibited and may be a
criminal offence. Please delete if obtained in error and email
confirmation to the sender.

--
This is the Rational Developer for IBM i / Websphere Development
Studio Client for System i & iSeries (WDSCI-L) mailing list To post a
message email: WDSCI-L@xxxxxxxxxxxx To subscribe, unsubscribe, or
change list options,
visit: https://lists.midrange.com/mailman/listinfo/wdsci-l
or email: WDSCI-L-request@xxxxxxxxxxxx Before posting, please take a
moment to review the archives at https://archive.midrange.com/wdsci-l.

--
This is the Rational Developer for IBM i / Websphere Development Studio Client for System i & iSeries (WDSCI-L) mailing list To post a message email: WDSCI-L@xxxxxxxxxxxx To subscribe, unsubscribe, or change list options,
visit: https://lists.midrange.com/mailman/listinfo/wdsci-l
or email: WDSCI-L-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives at https://archive.midrange.com/wdsci-l.
--
IMPORTANT NOTICE:
This email is confidential, may be legally privileged, and is for the intended recipient only. Access, disclosure, copying, distribution, or reliance on any of it by anyone else is prohibited and may be a criminal offence. Please delete if obtained in error and email confirmation to the sender.