<html><head><meta http-equiv="content-type" content="text/html; charset=utf-8"></head><body dir="auto">I don’t know what’s entailed with overwriting these methods, but it would be an interesting exercise.<div><br></div><div>Grant have you ever seen performance issues for reasons other than on message thread hogging?<br><br><div id="AppleMailSignature">Sent from my iPhone</div><div><br>On Apr 23, 2018, at 10:33, Gabe Barwick <<a href="mailto:barwickhome@hotmail.com">barwickhome@hotmail.com</a>> wrote:<br><br></div><blockquote type="cite"><div>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
<div id="divtagdefaultwrapper" style="font-size:12pt;color:#000000;font-family:Calibri,Helvetica,sans-serif;" dir="ltr">
<p style="margin-top:0;margin-bottom:0"><br>
</p>
<p style="margin-top:0;margin-bottom:0">Hi James,</p>
<p style="margin-top:0;margin-bottom:0"><br>
</p>
<p style="margin-top:0;margin-bottom:0">Thanks for your input.</p>
<p style="margin-top:0;margin-bottom:0"><br>
</p>
<p style="margin-top:0;margin-bottom:0">I do everything with my own code in OnMessage on background threads.</p>
<p style="margin-top:0;margin-bottom:0"><br>
</p>
<p style="margin-top:0;margin-bottom:0">BUT QuickFix/N writes the FIX log message and event files itself on main thread. Do you recommend overriding these as well?</p>
<p style="margin-top:0;margin-bottom:0"><br>
</p>
<p style="margin-top:0;margin-bottom:0"><br>
</p>
<br>
<div style="color: rgb(0, 0, 0);">
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font style="font-size:11pt" color="#000000" face="Calibri, sans-serif"><b>From:</b> Quickfixn <<a href="mailto:quickfixn-bounces@lists.quickfixn.com">quickfixn-bounces@lists.quickfixn.com</a>> on behalf of James Riehl <<a href="mailto:pete.riehl@gmail.com">pete.riehl@gmail.com</a>><br>
<b>Sent:</b> 23 April 2018 14:24<br>
<b>To:</b> Mailing list for QuickFIX/n<br>
<b>Subject:</b> Re: {{Quickfixn}} Volume of data</font>
<div> </div>
</div>
<div dir="auto">Your on message should do nothing other than queue processing. If your writing to disk in the onMessage then you’re doing too much. Queue up and process, I recommend blocking collection. <br>
<br>
<div id="x_AppleMailSignature">Sent from my iPhone</div>
<div><br>
On Apr 23, 2018, at 10:13, Gabe Barwick <<a href="mailto:barwickhome@hotmail.com" id="LPlnk330583" previewremoved="true">barwickhome@hotmail.com</a>> wrote:<br>
<br>
</div>
<blockquote type="cite">
<div>
<div id="x_divtagdefaultwrapper" dir="ltr" style="font-size:12pt; color:#000000; font-family:Calibri,Helvetica,sans-serif">
<p style="margin-top:0; margin-bottom:0">Hi Kunal,</p>
<p style="margin-top:0; margin-bottom:0"><br>
</p>
<p style="margin-top:0; margin-bottom:0">So you think the QuickFix/N own FIX message logger is too slow even with SSD?</p>
<p style="margin-top:0; margin-bottom:0"><br>
</p>
<p style="margin-top:0; margin-bottom:0">I can override it easily, but was hoping it was unnecessary - but you think it would be worthwhile?<br>
</p>
<br>
<br>
<div style="color:rgb(0,0,0)">
<hr tabindex="-1" style="display:inline-block; width:98%">
<div id="x_divRplyFwdMsg" dir="ltr"><font style="font-size:11pt" color="#000000" face="Calibri, sans-serif"><b>From:</b> Quickfixn <<a href="mailto:quickfixn-bounces@lists.quickfixn.com" id="LPlnk959812" previewremoved="true">quickfixn-bounces@lists.quickfixn.com</a>>
on behalf of Kunal CHANGELA <<a href="mailto:kunal.changela@us.bnpparibas.com" id="LPlnk953476" previewremoved="true">kunal.changela@us.bnpparibas.com</a>><br>
<b>Sent:</b> 23 April 2018 13:59<br>
<b>To:</b> Mailing list for QuickFIX/n<br>
<b>Subject:</b> Re: {{Quickfixn}} Volume of data</font>
<div> </div>
</div>
<div lang="EN-US">
<div class="x_x_WordSection1">
<p class="x_x_MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri","sans-serif"; color:#1F497D">Instead of writing to disk you could write to an in-memory queue and then have another thread consume that.</span></p>
<p class="x_x_MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri","sans-serif"; color:#1F497D">I think you want to effectively receive the message, add to your queue and return back….dont spend time in the handler of the message to do work.</span></p>
<p class="x_x_MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri","sans-serif"; color:#1F497D"> </span></p>
<div>
<p class="x_x_MsoNormal" style="line-height:115%"><span style="font-size:11.0pt; line-height:115%; font-family:"Calibri","sans-serif"; color:#1F497D" lang="EN-GB">Thanks,</span><span style="font-size:11.0pt; line-height:115%; font-family:"Calibri","sans-serif"; color:#1F497D"></span></p>
<table class="x_x_MsoNormalTable" style="background:white" cellspacing="0" cellpadding="0" border="0">
<tbody>
<tr>
<td colspan="2" style="padding:0in 0in 0in 0in">
<p class="x_x_MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri","sans-serif"; color:#1F497D"><img id="x_x__x0000_i1027" alt="CIB_BM_Sign_E_Q" tabindex="0" width="623" height="41" src="cid:image001.png@01D3DAE9.CBFEB9A0"></span><span style="font-family:"Tahoma","sans-serif"; color:#1F497D"></span></p>
</td>
</tr>
<tr>
<td style="padding:0in 0in 0in 0in" valign="top">
<p class="x_x_MsoNormal" style="margin-left:41.25pt"><b><span style="font-size:8.5pt; font-family:"Arial","sans-serif"; color:#1F497D">Kunal Changela</span></b></p>
<p class="x_x_MsoNormal" style="margin-left:41.25pt"><b><span style="font-size:7.0pt; font-family:"Tahoma","sans-serif"; color:gray">Credit Risk and PnL Development</span></b></p>
</td>
<td style="padding:0in 0in 0in 0in" valign="top">
<p class="x_x_MsoNormal"><span style="font-size:7.0pt; font-family:"Tahoma","sans-serif"; color:#1F497D">Group Email:
<a href="mailto:crditny@us.bnpparibas.com" id="LPlnk315636" previewremoved="true">
<span style="color:blue">DL CRD IT NY</span></a> (x841 4876, Intl: x721 4876) </span>
</p>
<p class="x_x_MsoNormal"><span style="font-size:7.0pt; font-family:"Tahoma","sans-serif"; color:#1F497D"> </span></p>
<p class="x_x_MsoNormal"><span style="font-size:7.0pt; font-family:"Tahoma","sans-serif"; color:#1F497D">787 7th Avenue, New York, NY 10019</span></p>
<p class="x_x_MsoNormal"><span style="font-size:7.0pt; font-family:"Tahoma","sans-serif"; color:#1F497D">Tel: +1 212 841 2640</span></p>
<p class="x_x_MsoNormal"><span style="font-size:7.0pt; font-family:"Tahoma","sans-serif"; color:#1F497D">Mobile: +1 917 216 8852</span></p>
<p class="x_x_MsoNormal"><span style="font-size:7.0pt; font-family:"Tahoma","sans-serif"; color:#1F497D"><a href="mailto:kunal.changela@us.bnpparibas.com" id="LPlnk160242" previewremoved="true"><span style="color:black">kunal.changela@us.bnpparibas.com</span></a>
</span></p>
<p class="x_x_MsoNormal"><span style="font-size:7.0pt; font-family:"Tahoma","sans-serif"; color:#1F497D"> </span></p>
</td>
</tr>
<tr>
<td colspan="2" style="padding:0in 0in 0in 0in"></td>
</tr>
<tr>
<td colspan="2" style="padding:0in 0in 0in 0in">
<p class="x_x_MsoNormal"><span style="font-family:"Tahoma","sans-serif"; color:#1F497D"><image002.gif></span></p>
</td>
</tr>
</tbody>
</table>
<p class="x_x_MsoNormal"><b><span style="font-size:7.0pt; font-family:"Verdana","sans-serif"; color:#00814F"><image003.jpg> Do not print this document unless it is necessary, consider the environment</span></b><span style="font-size:11.0pt; font-family:"Calibri","sans-serif"; color:#1F497D"></span></p>
</div>
<p class="x_x_MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri","sans-serif"; color:#1F497D"> </span></p>
<div>
<div style="border:none; border-top:solid #B5C4DF 1.0pt; padding:3.0pt 0in 0in 0in">
<p class="x_x_MsoNormal"><b><span style="font-size:10.0pt; font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt; font-family:"Tahoma","sans-serif""> Quickfixn [<a href="mailto:quickfixn-bounces@lists.quickfixn.com" id="LPlnk492916" previewremoved="true">mailto:quickfixn-bounces@lists.quickfixn.com</a>]
<b>On Behalf Of </b>Gabe Barwick<br>
<b>Sent:</b> Monday, April 23, 2018 9:47 AM<br>
<b>To:</b> <a href="mailto:quickfixn@lists.quickfixn.com" id="LPlnk987757" previewremoved="true">
quickfixn@lists.quickfixn.com</a><br>
<b>Subject:</b> [EXTERNAL] {{Quickfixn}} Volume of data</span></p>
</div>
</div>
<p class="x_x_MsoNormal"> </p>
<div id="x_x_divtagdefaultwrapper">
<p><span style="font-family:"Calibri","sans-serif"; color:black">Hi,</span></p>
<p><span style="font-family:"Calibri","sans-serif"; color:black"> </span></p>
<p><span style="font-family:"Calibri","sans-serif"; color:black">I am receiving a large amount of data (1K+ fix messages per second) from a vendor on my Windows 2008 server.</span></p>
<p><span style="font-family:"Calibri","sans-serif"; color:black"> </span></p>
<p><span style="font-family:"Calibri","sans-serif"; color:black">In OnMessage() I put a return so that I don't actually do anything with the data. All that happens is that QuickFix/N itself writes fix message to SS disk.</span></p>
<p><span style="font-family:"Calibri","sans-serif"; color:black"> </span></p>
<p><span style="font-family:"Calibri","sans-serif"; color:black">My vendor tells me that I am a slow "consumer" at peak times, meaning I am not handling messages fast enough.</span></p>
<p><span style="font-family:"Calibri","sans-serif"; color:black"> </span></p>
<p><span style="font-family:"Calibri","sans-serif"; color:black">What can I do to improve things? As I am not doing anything other than disk-write, am I correct to assume this is the problem?</span></p>
<p><span style="font-family:"Calibri","sans-serif"; color:black"> </span></p>
<p><span style="font-family:"Calibri","sans-serif"; color:black">Should I use a background writing class (on separate thread) instead of QuickFix's</span></p>
<p><span style="font-family:"Calibri","sans-serif"; color:black">own?</span></p>
<p><span style="font-family:"Calibri","sans-serif"; color:black"> </span></p>
<p><span style="font-family:"Calibri","sans-serif"; color:black">Any thoughts greatly appreciated</span></p>
<p><span style="font-family:"Calibri","sans-serif"; color:black"> </span></p>
</div>
</div>
<p><br>
This message and any attachments (the "message") is intended solely for the addressees and is confidential. If you receive this message in error, please delete it and immediately notify the sender. Any use not in accord with its purpose, any dissemination or
disclosure, either whole or partial, is prohibited except formal approval. The internet can not guarantee the integrity of this message. BNP PARIBAS (and its subsidiaries) shall (will) not therefore be liable for the message if modified. Please note that certain
functions and services for BNP Paribas may be performed by BNP Paribas RCC, Inc.</p>
<p><br>
Unless otherwise provided above, this message was sent by BNP Paribas, or one of its affiliates in Canada, having an office at 1981 McGill College Avenue, Montreal, QC, H3A 2W8, Canada. To the extent this message is being sent from or to Canada, you may unsubscribe
from receiving commercial electronic messages by using this link: <a href="https://nam03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.bnpparibas.ca%2Fen%2Funsubscribe%2F&data=02%7C01%7C%7C14784293a1ef4be5091008d5a9227966%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636600887884678532&sdata=ESJ0aR5ax8N6l%2BlTPfE5y56UD%2F2khcFVYrSCiCFBCPM%3D&reserved=0" originalsrc="http://www.bnpparibas.ca/en/unsubscribe/" shash="phNkkg5UL29BVfgGXI4KsoCdjsBepSwGsSBp8qxd1Wa9LAyQxtOXQXlVF0PumicU83yDfWDM2cenblWF6UPsNcNPSxqDEpLjsmdbhF64cHbk9g9yJkrf1Y4uCAHlewe8LH+vOwIDnSch0mkoqBHHxkjwjGDXziSp9RYnOQhyeOk=" id="LPlnk187648" previewremoved="true">
www.bnpparibas.ca/en/unsubscribe/</a>. See <a href="https://nam03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.bnpparibas.ca&data=02%7C01%7C%7C14784293a1ef4be5091008d5a9227966%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636600887884678532&sdata=%2FEh7bSwGT5I52PaftnDruQuVD051L8nuj71KILFDNaY%3D&reserved=0" originalsrc="http://www.bnpparibas.ca" shash="uevWHq0+OoLLwdyFZXZPusPtlxzZsmJlbnL0vQdsmF+GBMzBrAhxkn+7zfxJyGZ3WEhatvFEjfS14YGdPe1Q36VzEi3jlGiH8uaH4+UC718n0SFc/L0sAYL08P68svLMiHUgzISij9LKYddg/YjgkpjvmNyqGHV21ZNHOfufV00=" id="LPlnk494757" previewremoved="true">
www.bnpparibas.ca</a> for more information on BNP Paribas, in Canada.</p>
</div>
</div>
</div>
</div>
</blockquote>
<blockquote type="cite">
<div><span>_______________________________________________</span><br>
<span>Quickfixn mailing list</span><br>
<span><a href="mailto:Quickfixn@lists.quickfixn.com" id="LPlnk44935" previewremoved="true">Quickfixn@lists.quickfixn.com</a></span><br>
<span><a href="https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Flists.quickfixn.com%2Flistinfo.cgi%2Fquickfixn-quickfixn.com&data=02%7C01%7C%7C6b6d927cbbf04c7210ec08d5a926ad31%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636600905928462604&sdata=VbZFSBCasiv2IitiUmqwb1kHklsLoX%2FhOvHXbGVN%2FbA%3D&reserved=0" originalsrc="http://lists.quickfixn.com/listinfo.cgi/quickfixn-quickfixn.com" shash="e47IY5OCiawNLt4JPjAT8kDMQkJL9HyDG0y7RbpJjCoJc6MbXxrIu8vKQYFSZtSw/dbjs/1fJKYX1yHx8Ug0mE8rsJYhZenMMlorRVZdZydXA0TwvMV1Ewcp/fE2VWTGY9RgbdCBUjfh1peNlNE5KyaBDwRjH2CT3iCuf2vKyEg=" id="LPlnk985016" previewremoved="true">http://lists.quickfixn.com/listinfo.cgi/quickfixn-quickfixn.com</a></span><br>
</div>
</blockquote>
</div>
</div>
</div>
</div></blockquote><blockquote type="cite"><div><span>_______________________________________________</span><br><span>Quickfixn mailing list</span><br><span><a href="mailto:Quickfixn@lists.quickfixn.com">Quickfixn@lists.quickfixn.com</a></span><br><span><a href="http://lists.quickfixn.com/listinfo.cgi/quickfixn-quickfixn.com">http://lists.quickfixn.com/listinfo.cgi/quickfixn-quickfixn.com</a></span><br></div></blockquote></div></body></html>