Re: Content-type issue with application/json and application/javascript

Henrik,

I found something you posted a few years ago and tried it and it worked
for me...

Content-type: application/json
Content-encoding: EBCDIC

Is this something deemed incorrect or not a solution? I was actually
surprised it worked. :)

Maybe there is a better solution? It seems we would need to convert all
the output to a specific CCSID before writing it out to StdOut otherwise
(not a huge issue, but may be for some that can't just modify their
toolkits to do this).

Brad
www.bvstools.com

On Tue, Aug 25, 2015 at 3:41 PM, Matt Lavinder <
mlavinder@xxxxxxxxxxxxxxxxxxx> wrote:

Henrik -

Already downloaded it. :)

I noticed you example HTTP instance that you make UTF-8 the default
encoding. I can't do that. If possible, could you send me a very simple
example of how to make this work in PowerEXT Core without changing the
HTTP
Server configuration? I see the procedures for turning on UTF-8 mode but
didn't see any examples that use them. Plus, you said the headers cannot
be UTF-8 encoded.

I already have a CGIDEV2 template setup for my JSON, so I really don't
want
to change gears and use the JSON library, but I have no issue doing a find
replace and changing WRTSECTION to something else and using the PowerEXT
Core. I don't even mind changing the section and variable tags if I need
to.


On Tue, Aug 25, 2015 at 2:18 PM, Henrik Rützou <hr@xxxxxxxxxxxx> wrote:

mark

if you work a lot within this area you will find that ibm i

installations

seldom is able to dictate the content-type

text/json isn't btw an official mime type

On Tue, Aug 25, 2015 at 7:50 PM, Mark Murphy/STAR BASE Consulting Inc. <
mmurphy@xxxxxxxxxxxxxxx> wrote:

Just out of pure ignorance, since application/json causes conversion
issues, and text/json appears to work properly, why do you want to use
application/json? Are there issues that text/json causes on the client

side?

Mark Murphy
STAR BASE Consulting, Inc.
mmurphy@xxxxxxxxxxxxxxx


-----Matt Lavinder <mlavinder@xxxxxxxxxxxxxxxxxxx> wrote: -----
To: "Web Enabling the IBM i (AS/400 and iSeries)" <

web400@xxxxxxxxxxxx>

From: Matt Lavinder <mlavinder@xxxxxxxxxxxxxxxxxxx>
Date: 08/25/2015 11:42AM
Subject: Re: [WEB400] Content-type issue with application/json and
application/javascript

Henrik -

No worries. I have no intention of changing our CGIConvMode, but I

did

want to make sure I understood the implications. The bulk of our CGI
programs produce text/html and they work perfectly fine.

I plan to tweak the programs that produce JSON output and leave

everything

else alone.

On Tue, Aug 25, 2015 at 11:36 AM, Henrik Rützou <hr@xxxxxxxxxxxx>

wrote:

btw if you use binary or recieve application/xxxx content type the

input

also
is recieved as binary without conversion to ebcdic

On Tue, Aug 25, 2015 at 5:34 PM, Henrik Rützou <hr@xxxxxxxxxxxx>

wrote:

matt

you are right

On Tue, Aug 25, 2015 at 5:31 PM, Matt Lavinder <
mlavinder@xxxxxxxxxxxxxxxxxxx> wrote:

Kevin -

It's OK because I know enough to get what he was saying. It

makes

it

pretty clear in the HTTP Server documentation that if you add
"charset=utf-8"
(really, charset=anything) that no conversion occurs on the

body.

I have never tried CGIConvMode %BINARY%, but wouldn't that mean

that

all

your content has to be UTF-8, including output with

"content-type:text/*"?

On Tue, Aug 25, 2015 at 11:23 AM, Kevin Turner <
kevin.turner@xxxxxxxxxxxxxxxxxxxx> wrote:

Henrick

I know English is not your first language, but I couldn't

understand

that

at all :)

But anyway, my observations are not relevant because we always

use

"CGIConvMode BINARY"

Kevin

-----Original Message-----
From: WEB400 [mailto:web400-bounces@xxxxxxxxxxxx] On Behalf Of

Henrik

Rützou
Sent: 25 August 2015 16:19
To: Web Enabling the IBM i (AS/400 and iSeries) <

web400@xxxxxxxxxxxx>

Subject: Re: [WEB400] Content-type issue with application/json

and

application/javascript

apache doesn't neither converts from an ebcdic body if you send

then

the

body also has to be pre-encoded in utf-8

Content-Type: text/html; charset=utf-8

On Tue, Aug 25, 2015 at 5:14 PM, Kevin Turner <
kevin.turner@xxxxxxxxxxxxxxxxxxxx> wrote:

I am pretty sure we always ensure the data is in UTF-8 when

sending

content that has a content type that is anything but

"text/...."

-----Original Message-----
From: WEB400 [mailto:web400-bounces@xxxxxxxxxxxx] On Behalf

Of

Matt

Lavinder
Sent: 25 August 2015 16:12
To: Web Enabling the IBM i (AS/400 and iSeries) <

web400@xxxxxxxxxxxx>

Subject: Re: [WEB400] Content-type issue with

application/json

and

application/javascript

Hello Henrick. That's sort of what I suspected. Do I have

to

change

the

CGI program to produce ASCII output, or is there a way to

tell

Apache

to do an EBCDIC to ASCII conversion on an

"application/javascript"

content type?

On Tue, Aug 25, 2015 at 10:56 AM, Henrik Rützou <

hr@xxxxxxxxxxxx>

wrote:

apache converts ebcdic to utf-8 if the content type is

text/...

othervise not.


On Tue, Aug 25, 2015 at 4:52 PM, Matt Lavinder <
mlavinder@xxxxxxxxxxxxxxxxxxx> wrote:

We have several CGI programs that generate javascript,

usually

JSON.

For years we have set the content type to text/plain or
text/javascript. I'd like to start using the more

standard

"application/json", but I am

hitting

a major snag. The output is garbage. I get the exact

same

output

when I set the content-type to application/javascript.

Just to verify this was related to CGI output, I used

AddType

to

change

the

content-type of static JavaScript files to

"application/javascript".

Those

files look fine, so this must have something to do with

it

being

CGI output.

I don't really know what is up with the output, but I

know

it

isn't EBCDIC. It doesn't convert. Garbage in, garbage

out.

Changing the

content

type back to text/javascript sets everything right.

Anyone have any guesses what is going on here? We use

CGIDEV2

under IBM i 7.1. The default CCSID of our CGI jobs is

37.

Just so we are clear on one thing. We had the following

settings

in our HTTP Conf:

DefaultFsCCSID 037
CGIConvMode %%EBCDIC/EBCDIC%%

I commented both settings out and it had no impact on the

output

whatsoever. All of our CGI programs that use content

type

of

"text/*"

seemed to work. The ones using "application/javascript"

or

"application/json" for content type still looked like

garbage.

The only guess I have is that mod_cgi sees that the

content-type

starts with "application" and treats the output as

binary,

but I

have no idea how I

can

tell mod_cgi to treat "application/javascript" as text,

or

if

that

is

even

the issue.

I am hoping someone has an idea. I know Apache pretty

well,

but

this one has me stumped.

--
Matt
--
This is the Web Enabling the IBM i (AS/400 and iSeries)

(WEB400)

mailing list To post a message email:

WEB400@xxxxxxxxxxxx

To

subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/web400
or email: WEB400-request@xxxxxxxxxxxx Before posting,

please

take

a moment to review the archives at

http://archive.midrange.com/web400.

--
Regards,
Henrik Rützou

http://powerEXT.com <http://powerext.com/>
--
This is the Web Enabling the IBM i (AS/400 and iSeries)

(WEB400)

mailing list To post a message email: WEB400@xxxxxxxxxxxx

To

subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/web400
or email: WEB400-request@xxxxxxxxxxxx Before posting,

please

take a

moment to review the archives at

http://archive.midrange.com/web400

.

--




*Matt Lavinder Programmer AnalystData Management Inc.Phone:

(336)

573-5045Fax: (336) 573-5001*
--
This is the Web Enabling the IBM i (AS/400 and iSeries)

(WEB400)

mailing list To post a message email: WEB400@xxxxxxxxxxxx To
subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/web400
or email: WEB400-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives

at

http://archive.midrange.com/web400.


___________________________________________
This email has been scanned by iomartcloud.
http://www.iomartcloud.com/


________________________________

NOTICE: The information in this electronic mail transmission

is

intended by CoralTree Systems Ltd for the use of the named

individuals

or entity to which it is directed and may contain information

that

is

privileged or otherwise confidential. If you have received

this

electronic mail transmission in error, please delete it from

your

system without copying or forwarding it, and notify the

sender

of

the

error by reply email or by telephone, so that the sender's

address

records can be corrected.

----------------------------------------------------------------------

----------


CoralTree Systems Limited
Company Registration Number 5021022.
Registered Office:
12-14 Carlton Place
Southampton
Hampshire
SO15 2EA
VAT Registration Number 834 1020 74.
--
This is the Web Enabling the IBM i (AS/400 and iSeries)

(WEB400)

mailing list To post a message email: WEB400@xxxxxxxxxxxx To
subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/web400
or email: WEB400-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives

at

http://archive.midrange.com/web400.

--
Regards,
Henrik Rützou

http://powerEXT.com <http://powerext.com/>
--
This is the Web Enabling the IBM i (AS/400 and iSeries)

(WEB400)

mailing

list To post a message email: WEB400@xxxxxxxxxxxx To

subscribe,

unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/web400
or email: WEB400-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives at
http://archive.midrange.com/web400.


___________________________________________
This email has been scanned by iomartcloud.
http://www.iomartcloud.com/


________________________________

NOTICE: The information in this electronic mail transmission is

intended

by CoralTree Systems Ltd for the use of the named individuals

or

entity

to

which it is directed and may contain information that is

privileged

or

otherwise confidential. If you have received this electronic

mail

transmission in error, please delete it from your system

without

copying or

forwarding it, and notify the sender of the error by reply

email

or

by

telephone, so that the sender's address records can be

corrected.

--------------------------------------------------------------------------------

CoralTree Systems Limited
Company Registration Number 5021022.
Registered Office:
12-14 Carlton Place
Southampton
Hampshire
SO15 2EA
VAT Registration Number 834 1020 74.
--
This is the Web Enabling the IBM i (AS/400 and iSeries)

(WEB400)

mailing

list
To post a message email: WEB400@xxxxxxxxxxxx
To subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/web400
or email: WEB400-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives
at http://archive.midrange.com/web400.

--




*Matt Lavinder Programmer AnalystData Management Inc.Phone: (336)
573-5045Fax: (336) 573-5001*
--
This is the Web Enabling the IBM i (AS/400 and iSeries) (WEB400)

mailing

list
To post a message email: WEB400@xxxxxxxxxxxx
To subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/web400
or email: WEB400-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives
at http://archive.midrange.com/web400.

--
Regards,
Henrik Rützou

http://powerEXT.com <http://powerext.com/>

--
Regards,
Henrik Rützou

http://powerEXT.com <http://powerext.com/>
--
This is the Web Enabling the IBM i (AS/400 and iSeries) (WEB400)

mailing

list
To post a message email: WEB400@xxxxxxxxxxxx
To subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/web400
or email: WEB400-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives
at http://archive.midrange.com/web400.

--




*Matt Lavinder Programmer AnalystData Management Inc.Phone: (336)
573-5045Fax: (336) 573-5001*
--
This is the Web Enabling the IBM i (AS/400 and iSeries) (WEB400)

mailing

list
To post a message email: WEB400@xxxxxxxxxxxx
To subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/web400
or email: WEB400-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives
at http://archive.midrange.com/web400.
--
This is the Web Enabling the IBM i (AS/400 and iSeries) (WEB400)

mailing

list
To post a message email: WEB400@xxxxxxxxxxxx
To subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/web400
or email: WEB400-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives
at http://archive.midrange.com/web400.

--
Regards,
Henrik Rützou

http://powerEXT.com <http://powerext.com/>
--
This is the Web Enabling the IBM i (AS/400 and iSeries) (WEB400) mailing
list
To post a message email: WEB400@xxxxxxxxxxxx
To subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/web400
or email: WEB400-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives
at http://archive.midrange.com/web400.

--




*Matt Lavinder Programmer AnalystData Management Inc.Phone: (336)
573-5045Fax: (336) 573-5001*
--
This is the Web Enabling the IBM i (AS/400 and iSeries) (WEB400) mailing
list
To post a message email: WEB400@xxxxxxxxxxxx
To subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/web400
or email: WEB400-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives
at http://archive.midrange.com/web400.