[stuart_wildcat]

Since there are no more open issues with 5.0.1 does this mean this issue will be fixed? I don't see a 5.0.1 download yet but hopefully that will show up sometime Monday...

Maybe once 5.0.1 is available 'bdean42' can do a deploy-a-thon for us to test this out :)

Thanks,
Stuart

[dimitris]

5.0.1.GA should be out really soon. It's tagged (done!) and awaits the final QA/bundling/uploading.

Then you are welcome to stress test it as much you like :)

[alesj]

Then you are welcome to stress test it as much you like :)

The temps should definitely go away,
but I'm not so sure about that memory issue we once saw here,
as due to '"/" at the end' fiddling, it just might be too many String ops out there. :-(

Hence 2.1 version, hoping we'll optimize this better in 2.2 :-).

[amardhole]

Hi, I am using JBOSS 5.0.1 but still I am having the same problem of vfs-temp increses indefinte. This is observed on windows2003 server with service pack1. It creates a copy of all the jar every min. but windows Xp has no problem.

did the patch has any OS relation?

did LRU will has any performace impact if we decided to use the LRU
instated of CombinedVFSCache.

[jaikiran]

"AmarDhole" wrote:
Hi, I am using JBOSS 5.0.1 but still I am having the same problem of vfs-temp increses indefinte. This is observed on windows2003 server with service pack1. It creates a copy of all the jar every min. but windows Xp has no problem.

Could you please post the console logs (the initial few lines) from both these installations? Like these:

=========================================================================

 JBoss Bootstrap Environment

 JBOSS_HOME: /NotBackedUp/jpai/jboss-5.0.1.GA

 JAVA: /home/jpai/Java/JDK-1.5/jdk1.5.0_17/bin/java

 JAVA_OPTS: -Dprogram.name=run.sh -server -Xms128m -Xmx512m -XX:MaxPermSize=256m -Dorg.jboss.resolver.warning=true -Dsun.rmi.dgc.client.gcInterval=3600000 -Dsun.rmi.dgc.server.gcInterval=3600000 -Djava.net.preferIPv4Stack=true

 CLASSPATH: /NotBackedUp/jpai/jboss-5.0.1.GA/bin/run.jar:/home/jpai/Java/JDK-1.5/jdk1.5.0_17/lib/tools.jar

=========================================================================

13:06:12,783 INFO [ServerImpl] Starting JBoss (Microcontainer)...
13:06:12,799 INFO [ServerImpl] Release ID: JBoss [Morpheus] 5.0.1.GA (build: SVNTag=JBoss_5_0_1_GA date=200902231221)
13:06:12,799 INFO [ServerImpl] Bootstrap URL: null
13:06:12,800 INFO [ServerImpl] Home Dir: /NotBackedUp/jpai/jboss-5.0.1.GA
13:06:12,800 INFO [ServerImpl] Home URL: file:/NotBackedUp/jpai/jboss-5.0.1.GA/
13:06:12,800 INFO [ServerImpl] Library URL: file:/NotBackedUp/jpai/jboss-5.0.1.GA/lib/
13:06:12,802 INFO [ServerImpl] Patch URL: null
13:06:12,802 INFO [ServerImpl] Common Base URL: file:/NotBackedUp/jpai/jboss-5.0.1.GA/common/
13:06:12,802 INFO [ServerImpl] Common Library URL: file:/NotBackedUp/jpai/jboss-5.0.1.GA/common/lib/
13:06:12,802 INFO [ServerImpl] Server Name: default
13:06:12,803 INFO [ServerImpl] Server Base Dir: /NotBackedUp/jpai/jboss-5.0.1.GA/server
13:06:12,803 INFO [ServerImpl] Server Base URL: file:/NotBackedUp/jpai/jboss-5.0.1.GA/server/
13:06:12,803 INFO [ServerImpl] Server Config URL: file:/NotBackedUp/jpai/jboss-5.0.1.GA/server/default/conf/
13:06:12,804 INFO [ServerImpl] Server Home Dir: /NotBackedUp/jpai/jboss-5.0.1.GA/server/default
13:06:12,804 INFO [ServerImpl] Server Home URL: file:/NotBackedUp/jpai/jboss-5.0.1.GA/server/default/
13:06:12,804 INFO [ServerImpl] Server Data Dir: /NotBackedUp/jpai/jboss-5.0.1.GA/server/default/data
13:06:12,804 INFO [ServerImpl] Server Library URL: file:/NotBackedUp/jpai/jboss-5.0.1.GA/server/default/lib/
13:06:12,805 INFO [ServerImpl] Server Log Dir: /NotBackedUp/jpai/jboss-5.0.1.GA/server/default/log
13:06:12,805 INFO [ServerImpl] Server Native Dir: /NotBackedUp/jpai/jboss-5.0.1.GA/server/default/tmp/native
13:06:12,805 INFO [ServerImpl] Server Temp Dir: /NotBackedUp/jpai/jboss-5.0.1.GA/server/default/tmp
13:06:12,806 INFO [ServerImpl] Server Temp Deploy Dir: /NotBackedUp/jpai/jboss-5.0.1.GA/server/default/tmp/deploy
13:06:13,587 INFO [ServerImpl] Starting Microcontainer, bootstrapURL=file:/NotBackedUp/jpai/jboss-5.0.1.GA/server/default/conf/bootstrap.xml
13:06:14,411 INFO [VFSCacheFactory] Initializing VFSCache [org.jboss.virtual.plugins.cache.CombinedVFSCache]
13:06:14,413 INFO [VFSCacheFactory] Using VFSCache [CombinedVFSCache[real-cache: null]]
13:06:15,585 INFO [CopyMechanism] VFS temp dir: /NotBackedUp/jpai/jboss-5.0.1.GA/server/default/tmp
13:06:15,609 INFO [ZipEntryContext] VFS force nested jars copy-mode is enabled.
13:06:17,214 INFO [ServerInfo] Java version: 1.5.0_17,Sun Microsystems Inc.
13:06:17,214 INFO [ServerInfo] Java Runtime: Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_17-b04)
13:06:17,214 INFO [ServerInfo] Java VM: Java HotSpot(TM) Server VM 1.5.0_17-b04,Sun Microsystems Inc.
13:06:17,215 INFO [ServerInfo] OS-System: Linux 2.6.18-126.el5,i386
13:06:17,436 INFO [JMXKernel] Legacy JMX core initialized
13:06:20,836 INFO [ProfileServiceImpl] Loading profile: default from: org.jboss.system.server.profileservice.repository.SerializableDeploymentRepository@1204425(root=/NotBackedUp/jpai/jboss-5.0.1.GA/server, key=org.jboss.profileservice.spi.ProfileKey@143b82c3[domain=default,server=default,name=default])
13:06:20,838 INFO [ProfileImpl] Using repository:org.jboss.system.server.profileservice.repository.SerializableDeploymentRepository@1204425(root=/NotBackedUp/jpai/jboss-5.0.1.GA/server, key=org.jboss.profileservice.spi.ProfileKey@143b82c3[domain=default,server=default,name=default])
13:06:20,838 INFO [ProfileServiceImpl] Loaded profile: ProfileImpl@1735f84{key=org.jboss.profileservice.spi.ProfileKey@143b82c3[domain=default,server=default,name=default]}

[amardhole]

Hi, thanks for quick reply.

Following log from windows XP box.

Microsoft Windows XP [Version 5.1.2600]
(C) Copyright 1985-2001 Microsoft Corp.

C:\Documents and Settings\app>e:

E:\>cd JBOSS5\bin

E:\JBOSS5\bin>run.bat -c test80 -b 0.0.0.0
===============================================================================

 JBoss Bootstrap Environment

 JBOSS_HOME: E:\JBOSS5

 JAVA: C:\jdk1.6.0_12\bin\java

 JAVA_OPTS: -Dprogram.name=run.bat -server -Xms128m -Xmx512m -XX:MaxPermSize=512m -Dorg.jboss.resolver.warning=true -Dsun.rmi.dgc.client.gc
Interval=3600000 -Dsun.rmi.dgc.server.gcInterval=3600000

 CLASSPATH: E:\JBOSS5\bin\run.jar
 -Djboss.vfs.forceCopy=false
===============================================================================

15:47:49,937 INFO [ServerImpl] Starting JBoss (Microcontainer)...
15:47:49,968 INFO [ServerImpl] Release ID: JBoss [Morpheus] 5.0.1.GA (build: SVNTag=JBoss_5_0_1_GA date=200902232048)
15:47:49,968 INFO [ServerImpl] Bootstrap URL: null
15:47:49,968 INFO [ServerImpl] Home Dir: E:\JBOSS5
15:47:49,968 INFO [ServerImpl] Home URL: file:/E:/JBOSS5/
15:47:49,968 INFO [ServerImpl] Library URL: file:/E:/JBOSS5/lib/
15:47:49,968 INFO [ServerImpl] Patch URL: null
15:47:49,968 INFO [ServerImpl] Common Base URL: file:/E:/JBOSS5/common/
15:47:49,968 INFO [ServerImpl] Common Library URL: file:/E:/JBOSS5/common/lib/
15:47:49,968 INFO [ServerImpl] Server Name: test80
15:47:49,968 INFO [ServerImpl] Server Base Dir: E:\JBOSS5\server
15:47:49,968 INFO [ServerImpl] Server Base URL: file:/E:/JBOSS5/server/
15:47:49,968 INFO [ServerImpl] Server Config URL: file:/E:/JBOSS5/server/test80/conf/
15:47:49,968 INFO [ServerImpl] Server Home Dir: E:\JBOSS5\server\test80
15:47:49,968 INFO [ServerImpl] Server Home URL: file:/E:/JBOSS5/server/test80/
15:47:49,968 INFO [ServerImpl] Server Data Dir: E:\JBOSS5\server\test80\data
15:47:49,968 INFO [ServerImpl] Server Library URL: file:/E:/JBOSS5/server/test80/lib/
15:47:49,968 INFO [ServerImpl] Server Log Dir: E:\JBOSS5\server\test80\log
15:47:49,968 INFO [ServerImpl] Server Native Dir: E:\JBOSS5\server\test80\tmp\native
15:47:49,968 INFO [ServerImpl] Server Temp Dir: E:\JBOSS5\server\test80\tmp
15:47:49,968 INFO [ServerImpl] Server Temp Deploy Dir: E:\JBOSS5\server\test80\tmp\deploy
15:47:51,046 INFO [ServerImpl] Starting Microcontainer, bootstrapURL=file:/E:/JBOSS5/server/test80/conf/bootstrap.xml
15:47:52,109 INFO [VFSCacheFactory] Initializing VFSCache [org.jboss.virtual.plugins.cache.CombinedVFSCache]
15:47:52,125 INFO [VFSCacheFactory] Using VFSCache [CombinedVFSCache[real-cache: null]]
15:47:52,484 INFO [CopyMechanism] VFS temp dir: E:\JBOSS5\server\test\tmp
15:47:52,625 INFO [ZipEntryContext] VFS force nested jars copy-mode is enabled.
15:47:54,468 INFO [ServerInfo] Java version: 1.6.0_12,Sun Microsystems Inc.
15:47:54,468 INFO [ServerInfo] Java Runtime: Java(TM) SE Runtime Environment (build 1.6.0_12-b04)
15:47:54,468 INFO [ServerInfo] Java VM: Java HotSpot(TM) Server VM 11.2-b01,Sun Microsystems Inc.
15:47:54,468 INFO [ServerInfo] OS-System: Windows XP 5.1,x86
15:47:54,531 INFO [JMXKernel] Legacy JMX core initialized
15:47:57,515 INFO [ProfileServiceImpl] Loading profile: test80 from: org.jboss.system.server.profileservice.repository.SerializableDeploymen
tRepository@992725(root=E:\JBOSS5\server, key=org.jboss.profileservice.spi.ProfileKey@bbfa2a61[domain=default,server=default,name=test80])
15:47:57,515 INFO [ProfileImpl] Using repository:org.jboss.system.server.profileservice.repository.SerializableDeploymentRepository@992725(
root=E:\JBOSS5\server, key=org.jboss.profileservice.spi.ProfileKey@bbfa2a61[domain=default,server=default,name=test80])
15:47:57,515 INFO [ProfileServiceImpl] Loaded profile: ProfileImpl@ec366a{key=org.jboss.profileservice.spi.ProfileKey@bbfa2a61[domain=defau
lt,server=default,name=test80]}
15:48:00,687 INFO [WebService] Using RMI server codebase: http://phalera-dt:8083/
15:48:08,484 INFO [NativeServerConfig] JBoss Web Services - Stack Native Core
15:48:08,484 INFO [NativeServerConfig] 3.0.5.GA

Following log from windows server3, problem is with install.
Microsoft Windows Server 2003
Standard Edition
Service Pack 1

E:\jboss-5.0.1.GA\bin>run.bat -c test81 -b 0.0.0.0
===============================================================================

 JBoss Bootstrap Environment

 JBOSS_HOME: E:\jboss-5.0.1.GA

 JAVA: c:/jdk1.6\bin\java

 JAVA_OPTS: -Dprogram.name=run.bat -server -Xms512m -Xmx1024m -XX:+UseParNewGC -XX:PermSize=128m -XX:MaxPermSize=256m -Dorg.jboss.resolver.wa
rning=true -Dsun.rmi.dgc.client.gcInterval=3600000 -Dsun.rmi.dgc.server.gcInterval=3600000

 CLASSPATH: E:\jboss-5.0.1.GA\bin\run.jar

===============================================================================

10:57:51,906 INFO [ServerImpl] Starting JBoss (Microcontainer)...
10:57:51,921 INFO [ServerImpl] Release ID: JBoss [Morpheus] 5.0.1.GA (build: SVNTag=JBoss_5_0_1_GA date=200902232048)
10:57:51,921 INFO [ServerImpl] Bootstrap URL: null
10:57:51,921 INFO [ServerImpl] Home Dir: E:\jboss-5.0.1.GA
10:57:51,921 INFO [ServerImpl] Home URL: file:/E:/jboss-5.0.1.GA/
10:57:51,921 INFO [ServerImpl] Library URL: file:/E:/jboss-5.0.1.GA/lib/
10:57:51,921 INFO [ServerImpl] Patch URL: null
10:57:51,921 INFO [ServerImpl] Common Base URL: file:/E:/jboss-5.0.1.GA/common/
10:57:51,921 INFO [ServerImpl] Common Library URL: file:/E:/jboss-5.0.1.GA/common/lib/
10:57:51,921 INFO [ServerImpl] Server Name: test81
10:57:51,921 INFO [ServerImpl] Server Base Dir: E:\jboss-5.0.1.GA\server
10:57:51,921 INFO [ServerImpl] Server Base URL: file:/E:/jboss-5.0.1.GA/server/
10:57:51,921 INFO [ServerImpl] Server Config URL: file:/E:/jboss-5.0.1.GA/server/test81/conf/
10:57:51,921 INFO [ServerImpl] Server Home Dir: E:\jboss-5.0.1.GA\server\test81
10:57:51,921 INFO [ServerImpl] Server Home URL: file:/E:/jboss-5.0.1.GA/server/test81/
10:57:51,921 INFO [ServerImpl] Server Data Dir: E:\jboss-5.0.1.GA\server\test81\data
10:57:51,921 INFO [ServerImpl] Server Library URL: file:/E:/jboss-5.0.1.GA/server/test81/lib/
10:57:51,921 INFO [ServerImpl] Server Log Dir: E:\jboss-5.0.1.GA\server\test81\log
10:57:51,921 INFO [ServerImpl] Server Native Dir: E:\jboss-5.0.1.GA\server\test81\tmp\native
10:57:51,921 INFO [ServerImpl] Server Temp Dir: E:\jboss-5.0.1.GA\server\test81\tmp
10:57:51,921 INFO [ServerImpl] Server Temp Deploy Dir: E:\jboss-5.0.1.GA\server\test81\tmp\deploy
10:57:53,546 INFO [ServerImpl] Starting Microcontainer, bootstrapURL=file:/E:/jboss-5.0.1.GA/server/test81/conf/bootstrap.xml
10:57:54,796 INFO [VFSCacheFactory] Initializing VFSCache [org.jboss.virtual.plugins.cache.CombinedVFSCache]
10:57:54,796 INFO [VFSCacheFactory] Using VFSCache [CombinedVFSCache[real-cache: null]]
10:57:55,327 INFO [CopyMechanism] VFS temp dir: E:\jboss-5.0.1.GA\server\test81\tmp
10:57:55,327 INFO [ZipEntryContext] VFS force nested jars copy-mode is enabled.
10:57:57,609 INFO [ServerInfo] Java version: 1.6.0_12,Sun Microsystems Inc.
10:57:57,609 INFO [ServerInfo] Java Runtime: Java(TM) SE Runtime Environment (build 1.6.0_12-b04)
10:57:57,609 INFO [ServerInfo] Java VM: Java HotSpot(TM) Server VM 11.2-b01,Sun Microsystems Inc.
10:57:57,609 INFO [ServerInfo] OS-System: Windows 2003 5.2,x86
10:57:57,734 INFO [JMXKernel] Legacy JMX core initialized
10:58:01,234 INFO [ProfileServiceImpl] Loading profile: test81 from: org.jboss.system.server.profileservice.repository.SerializableDeploymentR
epository@1ec41c0(root=E:\jboss-5.0.1.GA\server, key=org.jboss.profileservice.spi.ProfileKey@bdcc1e81[domain=default,server=default,name=test81
])
10:58:01,234 INFO [ProfileImpl] Using repository:org.jboss.system.server.profileservice.repository.SerializableDeploymentRepository@1ec41c0(r
oot=E:\jboss-5.0.1.GA\server, key=org.jboss.profileservice.spi.ProfileKey@bdcc1e81[domain=default,server=default,name=test81])
10:58:01,234 INFO [ProfileServiceImpl] Loaded profile: ProfileImpl@834af6{key=org.jboss.profileservice.spi.ProfileKey@bdcc1e81[domain=default
,server=default,name=test81]}
10:58:04,249 INFO [WebService] Using RMI server codebase: http://cimwin2k33:8083/
10:58:13,421 INFO [NativeServerConfig] JBoss Web Services - Stack Native Core
10:58:13,421 INFO [NativeServerConfig] 3.0.5.GA

please let me know if more info needed.

[jaikiran]

Before going to details about what's happening - i see that there are differences in the parameters that you use in both these setups.

1) In the XP setup,

JAVA_OPTS: -Dprogram.name=run.bat -server -Xms128m -Xmx512m -XX:MaxPermSize=512m -Dorg.jboss.resol
ver.warning=true -Dsun.rmi.dgc.client.gc
Interval=3600000 -Dsun.rmi.dgc.server.gcInterval=3600000

 CLASSPATH: E:\JBOSS5\bin\run.jar
 -Djboss.vfs.forceCopy=false

The -Djboss.vfs.forceCopy=false is at the wrong place. It shouldn't be set in the CLASSPATH. Right now, its completely ignored because of the way its set.

15:47:52,625 INFO [ZipEntryContext] VFS force nested jars copy-mode is enabled.

I have to re-read this entire thread first to understand whether that flag needs to be set or not, but if at all you have to set it, it should be set in the JAVA_OPTS in run.bat as follows (all in one line):

set JAVA_OPTS=%JAVA_OPTS% -Dsun.rmi.dgc.client.gcInterval=3600000 -Dsun.rmi.dgc.server.gcInterval=3600000 -Djboss.vfs.forceCopy=false

2) Your 2003 setup doesn't set this flag (again i don't know whether this has to be set or not)

And finally please explain exactly what's happening on both your setups:

1) When do you see that the number of files are increasing? Immediately after deploy? After some time? If yes how much time.

2) Size of which folder in the server is increasing with time?

3) Are you doing any activities (like redeploy) when this happens?

4) How long have the servers been up?

[amardhole]

Hi,
-Djboss.vfs.forceCopy=false was an echo. not added in classpath either.

answers to the question as follows:
1) On 2003 server we have not set this flag.

1) we can see the the increase in the file size from next day after install. we dont shutdown the server it was running throughout night.
2) vsf-temp grows to available disc size, this increases the files every minitues.
3) No, no redeploy. we starts the server and works on it, server remains open throughout the night, next day we again starts work on it, immmediately within 5-10 min disc size grows to available free space.
4) 30Hr server was Up.

[jaikiran]

Thanks for the information. Let's wait for someone with more experience on this to reply.

On a related note, i am looking at the vfs.xml that shipped in 5.0.1.GA and i see this:

<bean name="VFSCache">
 <constructor factoryClass="org.jboss.virtual.spi.cache.VFSCacheFactory" factoryMethod="getInstance">
 <!-- Use the CombinedVFSCache implementation -->
 <parameter>org.jboss.virtual.plugins.cache.CombinedVFSCache</parameter>
 </constructor>
 <start ignored="true"/>

Does this mean, the cache won't be started?

[alesj]

"jaikiran" wrote:

Does this mean, the cache won't be started?

The cache is already started as part of factory instantiation.

[alesj]

The point of cache is to cover all working roots.
e.g. deploy/ or common/lib/

If you have a working root outside those listed in vfs.xml
make sure you add it to vfs.xml,
otherwise it means it doesn't get cached, hence gets hit every time you access direct URL.

[amardhole]

all the working root are correct, we have ear placed under deploy directory.

but i want to now why the VFS-temp directory grows to infinite under windows server 2003 and not in windows XP, do we need to set any thing ?

[alesj]

"AmarDhole" wrote:

but i want to now why the VFS-temp directory grows to infinite under windows server 2003 and not in windows XP, do we need to set any thing ?

This is weird.
I'm not aware of any diff that could cause this.

I'll appreciate it if you post any findings.
And I'll also try to investigate a bit ...

[cpinon]

Hi all,

not sure if I should open a new thread or continue this one ..?..

It seems that this behaviour is still true in JBOSS 5.1.GA
Some nested jar/war get unzip multiples in the "vfs_nested.tmp"
As we've got few ears containing ~ 10 wars/jars which size vary from 20 MB to 50Mb ==> disk usage is very high

Neverthless, note that some of these nested jar get deleted by the finalized method in the ZipFileWrapper class.


If I set forceCopy to false ==> I get OutOfMemory with 3-4 ear , -Xmx 1.4 GB on a 64 bit VM

So for now, I keep forceCopy=true and use the LRU CacheImpl
==> first tests seems to be OK. (and memory usage is lower.)

Is there any drawbacks on using LRU cache impl instead of Timed Cache ?
If none, don't you think LRU should be the default ?
Any feedbacks will be appreciated.

Thanks very much!
CP

[alesj]

"cpinon" wrote:

Is there any drawbacks on using LRU cache impl instead of Timed Cache ?
If none, don't you think LRU should be the default ?

In 5.1 the VFS cache used is Combined:
- http://anonsvn.jboss.org/repos/jbossas/projects/vfs/trunk/src/main/java/org/jboss/virtual/plugins/cache/CombinedVFSCache.java

We permanently store the most used roots (deploy/, deployers/, ...),
whereas the rest is currently Timed.
How you handle temp roots is up to you, your use case.

Or did you change from Combined to LRU?