Re: Event files and business integration (was Re: Monitoring a file for changes from Java?)

James,
 
It looks like you are doing this at the data level...There are numerous 
implemenations of files and database adapters that also look at the problem at 
the data level. 
 
Yes logging the key only does present the problem, it also presumes the key is 
unique and does not alter over time. It would not satisfy many audit 
requirements of indetifiying who changed the value
 
Other implementations at this level I've seen are:
 
 (a) As you describe capture before and after images. 
 (b) Capture only the after image, assumes the previous version will already be 
know or is not relevant
 (c) Capture before and after then diff to identify fields that have changed. 
 
Other areas to be considered are commitment control, not only rollback etc but 
an ability to group multiple records from perhaps different files into one 
based on commit cycle. Or the ability within the integration layer to undestand 
relationships between tables and hence integrate at the business layer.
 
Based on your description I am not sure what you would be offering over 
something like DataProp or DataMirror. (i.e. read of journals and propogate  
the information to other domains/applications). 
 

James H H Lampert <jamesl@xxxxxxxxxxx> wrote:

Does anybody here have any business integration experience?

My file monitoring experiment has an ultimate goal of developing part of a
business integration adaptor, the part that handles outgoing events.

I'm faced with a decision, though:

If I put complete record images into the event file, the event file
records could become quite large. As in multiple kilobytes apiece.
Especially if, for whatever reason, we keep both before and after images.
And even after the event has been passed on to the business integration
server, we're still stuck with a huge record in the event archive. But if
I put record keys in, instead, I end up with the following potential
scenario:

Suppose the outgoing-event-processing thread is handling a flurry of
events. Event 23 involves a change in field FOO of record 47 from a value
of BAR to a value of BAZ, while Event 42 changes FOO of record 47 from BAZ
to QUX. Suppose further that Event 42 occurs before the thread has gotten
to Event 23. If we have a complete record image in the event file, then we
capture both the BAR-to-BAZ transition from Event 23, and the BAZ-to-QUX
transition from Event 42. But if we only have keys in the event file, then
we end up seeing the results of Event 42 twice.

Am I straining at gnats here?

--
JHHL


--
This is the Java Programming on and around the iSeries / AS400 (JAVA400-L) 
mailing list
To post a message email: JAVA400-L@xxxxxxxxxxxx
To subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/java400-l
or email: JAVA400-L-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives
at http://archive.midrange.com/java400-l.



                
---------------------------------
Do you Yahoo!?
 Take Yahoo! Mail with you! Get it on your mobile phone.