[omniORB] High heap memory consumption due to omni layer memory management [OMNI ORB version 4.1.4]

[Sahoo, Dibendu Kumar]

Hi Duncan/All,

    Could you please let us know on " platform configuration parameters options for memory allocator" . It would really help us. If we can bring back the memory acquired by OS by means of some configuration change , then it would be really great. We are seeing that memory is acquired/consumed ( same way as explained by you ) but it is never going down/released. 

Thanks in advance.

Regards
Dibendu

-----Original Message-----
From: Sahoo, Dibendu Kumar 
Sent: Friday, July 25, 2014 9:50 AM
To: 'Duncan Grisby'; Agarwal, Shelendra
Cc: omniorb-list at omniorb-support.com; Vijayan, Pratheesh T (Enterprise Services - CMS); Thondapu, Chennarao; Rani, Chandrika M; Sahoo, Dibendu Kumar; Bhatia, Neeraj
Subject: RE: [omniORB] High heap memory consumption due to omni layer memory management [OMNI ORB version 4.1.4]

Hi Duncan ,

 Thanks a lot for your response. 

You mentioned :

>>They allocate large blocks of memory from the OS, and then keep hold of it without giving it back to the OS .

We are in HP-UX Itanium platform. What we are seeing is : memory is being acquired by the thread during the business action. But it does not get released even if the operation is finished. Or in other words, for filling say around 10000 records, memory from heap has been acquired by omni ORB ,but once those records are rendered/dispatched to UI, that memory already acquired during this operation is not coming down. This behavior is little surprising. We were thinking that memory usage will be more during the operation and will come down after it and again go up for the subsequent iterations/operations. 


You have mentioned about some platform configuration parameters options for memory allocator. Could you please let us know what are they. It would be really helpful for us.


Thanks & regards
Dibendu

-----Original Message-----
From: Duncan Grisby [mailto:duncan at grisby.org]
Sent: Friday, July 18, 2014 8:09 PM
To: Agarwal, Shelendra
Cc: omniorb-list at omniorb-support.com; Vijayan, Pratheesh T (Enterprise Services - CMS); Thondapu, Chennarao; Sahoo, Dibendu Kumar; Rani, Chandrika M
Subject: Re: [omniORB] High heap memory consumption due to omni layer memory management [OMNI ORB version 4.1.4]

On Thu, 2014-07-17 at 11:29 +0000, Agarwal, Shelendra wrote:

[...]
> The leak detector tools are clearly telling that, there are no leaks 
> in our application or in omni. With this we are getting an impression 
> that it’s a different kind of memory management technique. But then 
> the concern is, for each serving thread if it allocates good amount of 
> heap memory and keep with it as working area/memory then we are 
> running out of resources.

omniORB does not do anything special with memory management. It just uses new and delete.

What you describe is actually a common way for system memory allocators to behave. They allocate large blocks of memory from the OS, and then keep hold of it without giving it back to the OS. You don't say what platform your server is using, but you may find there are some platform configuration options that affect the bahaviour of the memory allocator.

Cheers,

Duncan.

-- 
 -- Duncan Grisby         --
  -- duncan at grisby.org     --
   -- http://www.grisby.org --