Blog stuffs

How do I organize my GIS projects?

2012-02-08T06:15:00.000-08:00

from http://gis.stackexchange.com/questions/18199/how-do-i-organize-my-gis-projects

Base Files/DBS

These are files that are "raw" in nature and constitute the base of all my analysis
These files, databases, and data are hosted outside of my projects folder, and are hosted on my internet server, local computer, and dropbox. I always have access to them, and they are very organized, dis and aggregated. You'll spend a lot of time organizing these.
I put them all in databases whether in Arc or PostGIS.
To each table, I add 3 fields in the table itself or the meta data: DATE_OBTAINED, DATA_DATE, SOURCE_NOTES
Also Base files could be queries of multiple other tables. For example, a table could aggregate all the traffic count I obtain into one large query/table.
I also put here all other data that I find scouring the internet.
I NEVER DO ANY DIRECT ANALYSIS ON ANY OF THE FILES IN THE BASE FILES

Project Files

All my project files go in a my_projects folder. It contains everything related to that project as in, if I copy and paste that folder somewhere else, it will contain everything.
Usually I have the following structure:
- my_project/
  - admin/
  - communication/
  - raw_data/
  - analyzed_data/
  - output_data/
  - from_client/
  - FINAL/
  - code/
  - some_document_date_time.doc
  - README
Slowly I've been moving to a local GIT. (you can even host it locally or on your own server). The reason I do not put it on GitHub is that github has a 1.2gb limit which is useless for GIS analysis
For my projects, I usually replicate all the GIS tables that I need for my analysis into a new db: project_whatever.
9 times out of 10, I work only in shp files and I save all my GIS (images, excel, coordinates, etc) to my projects/my_project/raw_data, projects/my_projects/analyzed_data, andprojects/my_projects/output_data.
When a project is complete, I put the final submitted copy inmy_projects/FINAL/date_submitted
For my MXD, I usually save to a new MXD every 2 or 3 hours my_proj_dec_22_11__13_20.mxdfor example
For Ms Word documents, illustrations, and mostly editing documents, they go in my_projects folder such as RFP_TENDER_Dec_22_11__11_15.doc and draft_ver5_Dec_31_11__12_30.doc. Again all my final deliverables go in in the FINAL folder
For R, Python code and some C#, it gets a bit tricky, as I host it outside of the project but with a working copy to my_projects/code folder. I do this as most of the python code is reusable. If you put all your python code besides the projects, you'll forget about them. Also, all my python code goes on github.
To me project files include any file types including time tracking, communications (I save all my emails as .msg files), I log all our verbal communications in a word file, and I put all those files my_project/communication
With ArcGIS use Models, LYR, and "save selection as a new shp layer". These tools will make it easy to store files in smaller formats, reuse files, and with models, be able to use something in another place.

Final Output

Each project when finalized gets zipped and put on my external harddrive.
All final products are converted to files from Tables, and to PDF from all other formats.
Every Project I do, gets printed for a hard copy backup

The Bottom Line

Each person uses multiple and different software and tools. A lot of people I know get organized using basecamp, Harvest, or any other multitude of tools. Also people have different working habits and OCD tendencies. I'm fairly obsessed with getting stuff organized maybe a bit more than others. So develop the system that causes you the least stress while guaranteeing you'll be consistent in applying and updating it
Backup and replicate everything
Don't work directly on your raw / base data
For your projects always use a replica file, as data changes over time, and you don't want to be scrambling to find the base_layer_2006.shp.
each my_projects folder must have a README text file that you edit it while you're doing the projects to give some basic information that you know you'll forget later when you visit the project 2 years down the road

Orbeon XForms and ANZLIC Metadata Editor

2012-01-17T19:40:00.000-08:00

http://orbeon.com/ has a very good platform to build XForms based web-application.

This is very suitable for an ANLIC Metadata Editor which should have the same or more functionality than
xMET (eXtensible Metadata Editing Tool)
http://www.mymaps.gov.au/xmet/1.0t/xmet-setup.exe

Other XForms implementation:
1. FormFaces, a javascript implementation of XForms Engine
2. AJAXForms, XSLTForms, betterFORM, Chiba and Orbeon Forms

Broadleafdemo-1.5 & IBM Websphere v8.5

2012-01-04T07:01:00.000-08:00

Once you got broadleafdemo running in JBoss 7 as per http://lydonchandra.blogspot.com/2011/12/running-broadleaf-ecommerce-150-demo-in.html , then it should be trivial to deploy it onto IBM Websphere v8.5.

1. Go to Websphere admin console http://host:9043/ibm/console
2. Applications > New Application > New Enterprise Application
3. Choose "Local file system" and select a compressed broadleafdemo.war (not exploded).
4. Choose "Details" settings, and make sure you map broadleafdemo.war onto /broadleafdemo context (and not onto the root context / )
5. Save and start broadleafdemo.

Using Glassfish built-in connection pool (rather than dbcp or c3p0)

2011-12-28T10:49:00.000-08:00

From http://skytteren.blogspot.com/2009/06/using-mysql-connection-pool-in.html

Using MySQL connection pool in Glassfish V3
I tried with a simple data source in Spring, but it isn't meant for production environments. So I wanted to move from:

<bean id="simpleDataSource" class="org.springframework.jdbc.datasource.DriverManagerDataSource">
<property name="driverClassName" value="com.mysql.jdbc.Driver"/>
<property name="url" value="jdbc:mysql://localhost:3306/database"/>
<property name="username" value="database"/>
<property name="password" value="s3cr3t"/>
</bean>

to:

<bean id="jndiDataSource" class="org.springframework.jndi.JndiObjectFactoryBean">
<property name="jndiName" value="jdbc/databasePool" />
</bean>

This can be done from within Glassfish admin, by creating the connection pool with the specified jndi name.

c3p0 connection pool in broadleafdemo (instead of dbcp)

2011-12-28T08:45:00.000-08:00

Why c3p0 ?
The old dbcp (1.2.2 is used in broadleafdemo) is less robust than c3p0.
http://stackoverflow.com/questions/520585/connection-pooling-options-with-jdbc-dbcp-vs-c3p0
Will do some performance testing with dbcp 1.4.

1. Open broadleafdemo.war\WEB-INF\applicationContext-demo.xml

2. Modify your webDS and webStorageDS beans

2a. change the class to com.mchange.v2.c3p0.ComboPooledDataSource

2b. change property name to driverClass (from driverClassName)

2c. change property name to jdbcUrl (from url)

2d. change property name to user (from username)

</bean>

</bean>

3. Download c3p0 from http://sourceforge.net/projects/c3p0/files/latest/download , extract, and copy c3p0-xxxx.jar (c3p0-0.9.1.2.jar at the time of this writing) into broadleafdemo.war\WEB-INF\lib

4. (Optional) You can also remove commons-dbcp.jar from broadleafdemo.war\WEB-INF\lib as it's no longer used.

References:
http://stackoverflow.com/questions/3002899/spring-configuration-of-c3p0-with-hibernate
http://stackoverflow.com/questions/520585/connection-pooling-options-with-jdbc-dbcp-vs-c3p0
http://sourceforge.net/projects/c3p0/

Running CLUSTERED Broadleaf Ecommerce 1.5.0 Demo in Oracle GlassFish Server 3.1.1

2011-12-26T09:42:00.000-08:00

Once you have Broadleafdemo running in Oracle Glassfish 3.1.1 (read http://lydonchandra.blogspot.com/2011/12/running-broadleaf-ecommerce-150-demo-in_26.html), you might want to run it in a clustered Glassfish configuration using Apache 2.2 + mod_jk connector.

Most of the instructions below are obtained from http://tiainen.sertik.net/2011/03/load-balancing-with-glassfish-31-and.html
1. From Glassfish admin, create a new cluster, say cluster1

2. Once cluster1 is created, go to Instances tab, and create 2 new instances, instance1 and instance2

3. Create mod_jk listener, go to Configurations > Network Config > Network Listener , and click on New.
3a. Enter "mod-jk" on Name textbox,
3b. enter 28009 as port number and
3c. make sure you check the JK Listener checkbox. Click Save.
3d. Stop and start the cluster

4. Download Apache 2.2 and mod_jk (http://tomcat.apache.org/download-connectors.cgi), extract Apache 2.2 and mod_jk.so into Apache22/modules directory

5. Add the following to Apache httpd.conf

Include conf/mod-jk.conf

6. create conf/mod-jk.conf

LoadModule jk_module modules/mod_jk.so

# Where to find workers.properties

JkWorkersFile conf/workers.properties

# Where to put jk logs

JkLogFile logs/mod_jk1.log

# Set the jk log level [debug/error/info]

JkLogLevel info

# Select the log format

JkLogStampFormat "[%a %b %d %H:%M:%S %Y]"

# JkOptions indicates to send SSK KEY SIZE

JkOptions +ForwardKeySize +ForwardURICompat -ForwardDirectories

# JkRequestLogFormat

JkRequestLogFormat "%w %V %T"

# Mount your applications

JkMountFile conf/uriworkermap.properties

# Add shared memory.

# This directive is present with 1.2.10 and

# later versions of mod_jk, and is needed for

# for load balancing to work properly

JkShmFile logs/jk.shm

# Add jkstatus for managing runtime data

JkMount status

Order deny,allow

Deny from all

Allow from 127.0.0.1

7. Create worker.properties with the following information, put the correct ip address on worker.node1.host

worker.node1.port=28009

worker.node1.host=127.0.0.1

worker.node1.type=ajp13

worker.node1.lbfactor=1

worker.status.type=status

worker.loadbalancer.sticky_session=1

worker.loadbalancer.type=lb

worker.loadbalancer.balance_workers=node1

worker.list=loadbalancer,status

8. Create uriworkermap.properties to tell mod_jk which webapp to mount

/=loadbalancer

/*=loadbalancer

/broadleafdemo=loadbalancer

/broadleafdemo/*=loadbalancer

9. Start httpd

Running Broadleaf Ecommerce 1.5.0 Demo in Oracle GlassFish Server 3.1.1

2011-12-26T02:00:00.000-08:00

Once you got it deployed and running in JBoss 7 (read my previous post http://lydonchandra.blogspot.com/2011/12/running-broadleaf-ecommerce-150-demo-in.html)

you can just use the same broadleafdemo.war (which has modified compass JAR) and

deploy it as an Web-Application from the GlassFish Server administration page > Applications > Deploy

Running Broadleaf Ecommerce 1.5.0 Demo in JBoss 7.1.0.CR1b

2011-12-25T09:24:00.000-08:00

A bit more complicated as it should be in the beginning, where JBoss changes the protocol name from vfszip to vfs,

1. so I had to build the latest Compass trunk (rev 3940) from http://svn.compass-project.org/svn/compass/trunk/

2. Modify http://svn.compass-project.org/svn/compass/trunk/src/main/src/org/compass/core/config/binding/scanner/ScannerFactoy.java

to:

else if ( url.getProtocol().equals("vfszip") ||

url.getProtocol().equals("vfs") ) {

url = new URL(urlString);

return new JarScanner(basePackage, url.openStream(), filter);

}

3. Replaced the broadleaf's supplied compass-2.2.0.jar with the newly built Compass jar file ( available from http://www.multiupload.com/AY0F7UPKX6 as of Dec 25 2011)

4. Start JBoss (in standalone mode), everything should work fine!!

* Licensed under the Apache License, Version 2.0 (the "License");

* you may not use this file except in compliance with the License.

* You may obtain a copy of the License at

* http://www.apache.org/licenses/LICENSE-2.0

* Unless required by applicable law or agreed to in writing, software

* distributed under the License is distributed on an "AS IS" BASIS,

* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.

* See the License for the specific language governing permissions and

* limitations under the License.

package org.compass.core.config.binding.scanner;

import java.io.File;

import java.io.IOException;

import java.net.URL;

/**

* @author kimchy

public class ScannerFactoy {

public static Scanner create(String basePackage, URL url, Filter filter) throws IOException {

String urlString = url.toString();

urlString = urlString.substring(0, urlString.lastIndexOf(basePackage));

if (urlString.endsWith("!/")) {

urlString = urlString.substring(4);

urlString = urlString.substring(0, urlString.length() - 2);

url = new URL(urlString);

}

if (!urlString.endsWith("/")) {

return new JarScanner(basePackage, url.openStream(), filter);

} else if (url.getProtocol().equals("file")) {

File f = new File(url.getPath());

if (f.isDirectory()) {

return new FileScanner(basePackage, f, filter);

} else {

return new JarScanner(basePackage, url.openStream(), filter);

}

} else if ( url.getProtocol().equals("vfszip") ||

url.getProtocol().equals("vfs") ) {

url = new URL(urlString);

return new JarScanner(basePackage, url.openStream(), filter);

} else {

throw new IOException("Protocol [" + url.getProtocol() + "] is not supported by scanner");

}

Running Broadleaf eCommerce Demo 1.5.0 in JBoss 5.1

2011-12-25T05:10:00.000-08:00

I had problems deploying Broadleaf eCommerce Demo 1.5.0 in JBoss 7.0. So I went back to JBoss 5.1 and followed this forum post and finally got the broadleafdemo.war to deploy in JBoss 5.1.

Why JBoss you ask ? Well some enterprise users use JBoss and we want to give them an easier option to deploy inside their JBoss app server, rather asking them to install Tomcat or run from Jetty.

If they have to install Tomcat or run from Jetty, then they will have to configure their network security settings etc etc, it's just not fun. So why JBoss again ? To make deployment easier, for now at least :)

Steps:

1. Download and extract JBoss 5.1 if you haven't already, and make sure you can run broadleaf with mysql as your database (follow my previous post about running broadleaf with mysql or google it).

2. Remove jboss-5.1.0.CR\common\lib\hibernate-validator.jar (or move it somewhere else)

3. Copy the expanded broadleafdemo.war to jboss-5.1.0.CR\server\default\deploy

4. Download compass-2.3.1-beta1.jar from either java2s.com or rutgersmaps and replace broadleafdemo.war\WEB-INF\lib\compass-2.2.0.jar

5. Start JBoss, and you should be able to access http://myserver:8080/broadleafdemo

Running Broadleaf E-commerce demo in Various Java Application Server and Database

2011-12-24T16:12:00.000-08:00

First we start using MySQL and Tomcat 7.0

1. Extract broadleafdemo.war file into an expanded war
2. As detailed here in http://www.broadleafcommerce.org/forum/viewtopic.php?f=9&t=379

2a. in META-INF/persistence-demo.xml' file replace
- org.hibernate.dialect.HSQLDialect by org.hibernate.dialect.MySQLDialect in the 'blPU' and 'blSecurePU' persistence unit configurations

2b. in WEB-INF/applicationContext-demo.xml' file replace the following lines

<bean id="webDS" class="org.apache.commons.dbcp.BasicDataSource" destroy-method="close">
<property name="driverClassName" value="org.hsqldb.jdbcDriver" />
<property name="url" value="jdbc:hsqldb:mem:broadleaf;ifexists=false" />
<property name="username" value="sa" />
<property name="password" value="" />
</bean>

with

<bean id="webDS" class="org.apache.commons.dbcp.BasicDataSource"
destroy-method="close">


<property name="driverClassName" value="com.mysql.jdbc.Driver" />
<property name="url" value="jdbc:mysql://localhost:3306/broadleaf" />
<property name="username" value="MY_USER_NAME" />
<property name="password" value="MY_PASSWORD" />
</bean>

and update the username and password properties accordingly!!!

3. login to mysql and create database 'broadleaf'

mysql>> create database broadleaf;

4. copy the expanded broadleaf.war directory created in #1 above into Tomcat 7.0 directory

5. download & copy mysql-connector-java-5.1.17.jar into broadleafdemo.war/WEB-INF/lib

6. start tomcat.

Caveat:

For some reason Spring Framework complains about NOT finding the com.mysql.jdbc.Driver ?
However the broadleafdemo site works OK.

[ INFO] 07:56:49 SchemaExport - exporting generated schema to database
Cannot load JDBC driver class 'org.mysql.jdbc.Driver'
java.lang.ClassNotFoundException: org.mysql.jdbc.Driver
at org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoa
at org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoa
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:169)
at org.apache.commons.dbcp.BasicDataSource.createDataSource(BasicDataSou
at org.apache.commons.dbcp.BasicDataSource.getConnection(BasicDataSource
at org.hibernate.ejb.connection.InjectedDataSourceConnectionProvider.get
ataSourceConnectionProvider.java:71)

Reading big file quickly by skipping

2011-12-19T06:26:00.000-08:00

This is to read a grid file with columns such as
a1 b1 c1
a2 b2 c2
a3 b3 c3
a4 b4 c4
a5 b5 c5
a6 b6 c6
a7 b7 c7
a8 b8 c8
a9 b9 c9
a10 b10 c10

say we want to read 'approximately' every 4 lines, i.e. line2 then line6 and then line10, then what we can do is
to jump using the file offset. As we only want to read a 'whole' line and we can't guarantee whether a line is 'whole' or not if we use the file offset, we read and then discard a line, and read the next one. This assumes a line is separated by newline.

read line and discard
read line and save //a2 b2 c2
jump 27bytes ahead //a line is approx 9bytes with a newline
read line and discard
read line and save //a6 b6 c6
jump 27bytes ahead
read line and discard
read line and save //a10 b10 c10
...

using boost::iostreams::position_to_offset;
     using boost::iostreams::seek;
     using boost::iostreams::stream_offset;

     stream_offset off;

         // save EOF offset so we know if we have finished reading the file
     stream_offset endoff = position_to_offset(seek(in, 0, BOOST_IOS::end));
// go back to beginning of file, we have gone to EOF in line above seek(in, 0, BOOST_IOS::beg);
     string line2;
     while( true ) {
                 // first read, we get "incomplete line", so ignore it
         getline(in, line2);

                 // second read, we get "complete" line
         getline(in, line2);
         //cout << line2 << endl;

                 // jump approximately 1000 lines ahead
         off = position_to_offset(seek(in, 200000, BOOST_IOS::cur));

                 // finish reading the file
         if( off > endoff ) {
             break;
         }
     }

     cout << "finished" << endl;

Java Object Size

2011-12-18T03:33:00.000-08:00

To get the object size, YourKit Profiler v9.0.2 is used and for SimpleClass, shallow sizes are used.

public class SimpleClass {
public int x;
}
For 32bit Java, the size of the object is 16 bytes.
For 64bit Java, size is 24 bytes

public class SimpleClass {
public int x;
public int y;
}
32bit Java -> 16 bytes.
64bit Java -> 24bytes.

public class SimpleClass {
public int x;
public int y;
public int z;
}
32bit Java -> 24 bytes.
64bit Java -> 32 bytes.

http://javaquirks.blogspot.com/2008/03/it-gets-worse.html

______32-bit 64-bit
Object 8 16
Integer 16 24
Long 16 24
Float 16 24
Double 16 24
String 40 64
Date 24 32
Calendar 432 544
byte[0] 16 24
byte[32] 48 56
byte[128][0] 2576 4120
ArrayList(1) 56 96
ArrayList(2) 80 128

Profiling geoserver 2.1.2 using YourKit Java Profiler 9

2011-12-15T06:17:00.001-08:00

[Load Testing Geoserver]

[background]

- Load testing is done using Apache JMeter 2.5.1 r1177103

- A text file with the url (including random bbox, not scaled) is loaded by JMeter

- YourKit Java Profiler 9 is used to profile geoserver

- An image file 4.5GB in size is served.

- The urls are generated using the following python script:

import random
#http://10.1.1.2:8080/geoserver/don/wms?service=WMS&version=1.1.0&request=GetMap&layers=don:china&styles=&bbox=73.115,19.934,135.103,53.597&width=607&height=330&srs=EPSG:4326&format=image/png
minx = 73.115
miny = 19.934
maxx = 78.103
maxy = 23.597
thefile = open('geoload2.txt', 'w')
wms1 = 'geoserver/don/wms?service=WMS&version=1.1.0&request=GetMap&layers=don:china&styles=&width=800&height=600&srs=EPSG:4326&format=image/png&bbox='
distancex = maxx - minx
distancey = maxy - miny
for n in range(1000):
minx1 = minx + random.random() * distancex
miny1 = miny + random.random() * distancey
thefile.write( wms1 + str(minx1) + ',' + str(miny1) + ',' + str(maxx) + ',' + str(maxy) + '\n' );

[load-testing-shape-file]
Serving up a 150MB shape file as WMS,
The throughput is about 2.2 per second

Stack trace of one of the hotspot org.geotools.index.quadtree.LazySearchIterator.hasNext() which is called 50% of the time,
can be seen in the appendix section below.

[to-do]
1. Reduce the number of filters and see if it performs better.
-> no it doesn't improve throughput in measurable amount. will check if cpu usage is significantly less.

[appendix]
"Name","Time (ms)","Invocation Count"
"org.geotools.index.quadtree.LazySearchIterator.hasNext()","287819","76580"
"org.geotools.data.shapefile.indexed.IndexedShapefileDataStore.getAttributesReader(boolean, boolean, Query, SimpleFeatureType)","286712","57"
"org.geotools.data.shapefile.indexed.IndexedShapefileDataStore.getFeatureReader(String, Query)","",""
"org.geotools.data.AbstractDataStore.getFeatureReader(Query, Transaction)","",""
"org.geotools.data.DefaultFeatureResults.reader()","",""
"org.geotools.data.store.DataFeatureCollection.openIterator()","",""
"org.geotools.data.store.DataFeatureCollection.iterator()","",""
"org.geotools.data.store.DataFeatureCollection.features()","",""
"org.geotools.data.store.DataFeatureCollection.features()","",""
"org.geotools.data.crs.ForceCoordinateSystemFeatureResults.openIterator()","",""
"org.geotools.feature.collection.AbstractFeatureCollection.iterator()","",""
"org.geotools.renderer.lite.StreamingRenderer.drawPlain(Graphics2D, MapLayer, AffineTransform, CoordinateReferenceSystem, String, Collection, FeatureCollection, NumberRange, ArrayList)","",""
"org.geotools.renderer.lite.StreamingRenderer.processStylers(Graphics2D, MapLayer, AffineTransform, CoordinateReferenceSystem, Envelope, Rectangle, String)","",""
"org.geotools.renderer.lite.StreamingRenderer.paint(Graphics2D, Rectangle, ReferencedEnvelope, AffineTransform)","",""
"org.geotools.data.shapefile.indexed.IndexedShapefileAttributeReader.hasNext()","1044","38269"
"org.geotools.data.FIDFeatureReader.hasNext()","",""
"org.geotools.data.FilteringFeatureReader.hasNext()","",""
"org.geotools.feature.FeatureReaderIterator.hasNext()","",""
"org.geotools.feature.collection.DelegateFeatureIterator.hasNext()","",""
"org.geotools.data.crs.ForceCoordinateSystemIterator.hasNext()","",""
"org.geotools.renderer.lite.StreamingRenderer.drawPlain(Graphics2D, MapLayer, AffineTransform, CoordinateReferenceSystem, String, Collection, FeatureCollection, NumberRange, ArrayList)","",""
"org.geotools.renderer.lite.StreamingRenderer.processStylers(Graphics2D, MapLayer, AffineTransform, CoordinateReferenceSystem, Envelope, Rectangle, String)","",""
"org.geotools.renderer.lite.StreamingRenderer.paint(Graphics2D, Rectangle, ReferencedEnvelope, AffineTransform)","",""
"org.geoserver.wms.map.RenderedImageMapOutputFormat.produceMap(WMSMapContext, boolean)","",""
"org.geoserver.wms.map.RenderedImageMapOutputFormat.produceMap(WMSMapContext)","",""
"org.geoserver.wms.map.RenderedImageMapOutputFormat.produceMap(WMSMapContext)","",""
"org.geoserver.wms.GetMap.run(GetMapRequest, WMSMapContext)","",""
"org.geoserver.wms.GetMap.run(GetMapRequest)","",""
"org.geoserver.wms.DefaultWebMapService.getMap(GetMapRequest)","",""
"java.lang.reflect.Method.invoke(Object, Object[])","",""
"org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(Object, Method, Object[])","",""
"org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint()","",""
"org.springframework.aop.framework.ReflectiveMethodInvocation.proceed()","",""
"org.geoserver.gwc.wms.CacheSeedingWebMapService.invoke(MethodInvocation)","",""
"org.geoserver.gwc.wms.CacheSeedingWebMapService.invoke(MethodInvocation)","",""
"org.springframework.aop.framework.ReflectiveMethodInvocation.proceed()","",""
"org.geoserver.gwc.wms.CachingWebMapService.invoke(MethodInvocation)","",""
"org.geoserver.gwc.wms.CachingWebMapService.invoke(MethodInvocation)","",""
"org.springframework.aop.framework.ReflectiveMethodInvocation.proceed()","",""
"org.geoserver.ows.util.RequestObjectLogger.invoke(MethodInvocation)","",""
"org.springframework.aop.framework.ReflectiveMethodInvocation.proceed()","",""
"org.springframework.aop.framework.JdkDynamicAopProxy.invoke(Object, Method, Object[])","",""
"java.lang.reflect.Method.invoke(Object, Object[])","",""
"org.geoserver.ows.Dispatcher.execute(Request, Operation)","",""
"org.geoserver.ows.Dispatcher.handleRequestInternal(HttpServletRequest, HttpServletResponse)","",""
"org.springframework.web.servlet.mvc.AbstractController.handleRequest(HttpServletRequest, HttpServletResponse)","",""
"org.springframework.web.servlet.mvc.SimpleControllerHandlerAdapter.handle(HttpServletRequest, HttpServletResponse, Object)","",""
"org.springframework.web.servlet.DispatcherServlet.doDispatch(HttpServletRequest, HttpServletResponse)","",""
"org.springframework.web.servlet.DispatcherServlet.doService(HttpServletRequest, HttpServletResponse)","",""
"org.springframework.web.servlet.FrameworkServlet.processRequest(HttpServletRequest, HttpServletResponse)","",""
"org.springframework.web.servlet.FrameworkServlet.doGet(HttpServletRequest, HttpServletResponse)","",""
"javax.servlet.http.HttpServlet.service(ServletRequest, ServletResponse)","",""
"org.mortbay.jetty.servlet.ServletHolder.handle(ServletRequest, ServletResponse)","",""
"org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletRequest, ServletResponse)","",""
"org.geoserver.filters.ThreadLocalsCleanupFilter.doFilter(ServletRequest, ServletResponse, FilterChain)","",""
"org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletRequest, ServletResponse)","",""
"org.geoserver.filters.SpringDelegatingFilter$Chain.doFilter(ServletRequest, ServletResponse)","",""
"org.geoserver.filters.SpringDelegatingFilter.doFilter(ServletRequest, ServletResponse, FilterChain)","",""
"org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletRequest, ServletResponse)","",""
"org.geoserver.platform.AdvancedDispatchFilter.doFilter(ServletRequest, ServletResponse, FilterChain)","",""
"org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletRequest, ServletResponse)","",""
"org.vfny.geoserver.filters.SetCharacterEncodingFilter.doFilter(ServletRequest, ServletResponse, FilterChain)","",""
"org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletRequest, ServletResponse)","",""
"org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(ServletRequest, ServletResponse)","",""
"org.springframework.security.intercept.web.FilterSecurityInterceptor.invoke(FilterInvocation)","",""
"org.springframework.security.intercept.web.FilterSecurityInterceptor.doFilter(ServletRequest, ServletResponse, FilterChain)","",""
"org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(ServletRequest, ServletResponse)","",""
"org.springframework.security.ui.ExceptionTranslationFilter.doFilterHttp(HttpServletRequest, HttpServletResponse, FilterChain)","",""
"org.springframework.security.ui.SpringSecurityFilter.doFilter(ServletRequest, ServletResponse, FilterChain)","",""
"org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(ServletRequest, ServletResponse)","",""
"org.springframework.security.providers.anonymous.AnonymousProcessingFilter.doFilterHttp(HttpServletRequest, HttpServletResponse, FilterChain)","",""
"org.springframework.security.ui.SpringSecurityFilter.doFilter(ServletRequest, ServletResponse, FilterChain)","",""
"org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(ServletRequest, ServletResponse)","",""
"org.springframework.security.ui.basicauth.BasicProcessingFilter.doFilterHttp(HttpServletRequest, HttpServletResponse, FilterChain)","",""
"org.springframework.security.ui.SpringSecurityFilter.doFilter(ServletRequest, ServletResponse, FilterChain)","",""
"org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(ServletRequest, ServletResponse)","",""
"org.springframework.security.context.HttpSessionContextIntegrationFilter.doFilterHttp(HttpServletRequest, HttpServletResponse, FilterChain)","",""
"org.springframework.security.ui.SpringSecurityFilter.doFilter(ServletRequest, ServletResponse, FilterChain)","",""
"org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(ServletRequest, ServletResponse)","",""
"org.springframework.security.util.FilterChainProxy.doFilter(ServletRequest, ServletResponse, FilterChain)","",""
"org.springframework.security.util.FilterToBeanProxy.doFilter(ServletRequest, ServletResponse, FilterChain)","",""
"org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletRequest, ServletResponse)","",""
"org.geoserver.filters.LoggingFilter.doFilter(ServletRequest, ServletResponse, FilterChain)","",""
"org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletRequest, ServletResponse)","",""
"org.geoserver.filters.ReverseProxyFilter.doFilter(ServletRequest, ServletResponse, FilterChain)","",""
"org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletRequest, ServletResponse)","",""
"ch.lydon.TestFilter.TestFilter.doFilter(ServletRequest, ServletResponse, FilterChain)","",""
"org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletRequest, ServletResponse)","",""
"org.geoserver.filters.GZIPFilter.doFilter(ServletRequest, ServletResponse, FilterChain)","",""
"org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletRequest, ServletResponse)","",""
"org.geoserver.filters.SessionDebugFilter.doFilter(ServletRequest, ServletResponse, FilterChain)","",""
"org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletRequest, ServletResponse)","",""
"org.mortbay.jetty.servlet.ServletHandler.handle(String, HttpServletRequest, HttpServletResponse, int)","",""
"org.mortbay.jetty.security.SecurityHandler.handle(String, HttpServletRequest, HttpServletResponse, int)","",""
"org.mortbay.jetty.servlet.SessionHandler.handle(String, HttpServletRequest, HttpServletResponse, int)","",""
"org.mortbay.jetty.handler.ContextHandler.handle(String, HttpServletRequest, HttpServletResponse, int)","",""
"org.mortbay.jetty.webapp.WebAppContext.handle(String, HttpServletRequest, HttpServletResponse, int)","",""
"org.mortbay.jetty.handler.ContextHandlerCollection.handle(String, HttpServletRequest, HttpServletResponse, int)","",""
"org.mortbay.jetty.handler.HandlerCollection.handle(String, HttpServletRequest, HttpServletResponse, int)","",""
"org.mortbay.jetty.handler.HandlerWrapper.handle(String, HttpServletRequest, HttpServletResponse, int)","",""
"org.mortbay.jetty.Server.handle(HttpConnection)","",""
"org.mortbay.jetty.HttpConnection.handleRequest()","",""
"org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete()","",""
"org.mortbay.jetty.HttpParser.parseNext()","",""
"org.mortbay.jetty.HttpParser.parseAvailable()","",""
"org.mortbay.jetty.HttpConnection.handle()","",""
"org.mortbay.io.nio.SelectChannelEndPoint.run()","",""
"org.mortbay.thread.BoundedThreadPool$PoolThread.run()","",""
"org.geotools.index.quadtree.LazySearchIterator.next()","62","38254"

Set Authorization header in Apache 2.2

2011-12-05T03:53:00.001-08:00

RewriteCond %{REQUEST_METHOD} POST
RewriteCond %{QUERY_STRING} ^tocwidget=true&service=CSW&version=2.0.2&elementSetName=full&outputSchema=EBRIM&request=GetRecordById&id=(.*)$

RequestHeader set Authorization "Basic xxxxxxxxxxx"
RewriteRule ^/erdas-apollo/catalog/csw(.*)$ /erdas-apollo/catalog/csw?%{QUERY_STRING} [R,L]

To use environment variable:

RewriteCond %{REQUEST_METHOD} POST

RewriteCond %{QUERY_STRING} ^tocwidget=true&service=CSW&version=2.0.2&elementSetName=full&outputSchema=EBRIM&request=GetRecordById&id=(.*)$

SetEnvIfNoCase Request_URI "/erdas-apollo/catalog/csw" havedon

RequestHeader set Authorization "Basic xxxxxxxx" env=havedon

RewriteRule ^/erdas-apollo/catalog/csw(.*)$ /erdas-apollo/catalog/csw?%{QUERY_STRING} [R,L]

CakePHP 2.0.2 problem PHPUnit 3.6

2011-11-24T20:49:00.000-08:00

Fix is in 2.0.3 https://github.com/cakephp/cakephp/commit/bfd95d0e04235396b5011b790042765da856d4ea#diff-2

For now, all we need to do is to replace /lib/Cake/Test and /lib/Cake/TestSuite with the ones from CakePHP 2.0.3

Adding Indonesian Locale to Java web-app

2011-09-21T00:33:00.001-07:00

Due to this bug
http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=6457127

you must have resources_in.properties
(not resources_id.properties) for the translation to work.

Indonesian code is in_ID and due to the bug above
"The indonesian locale gets parsed from both the identifiers "id" and "in". ISO 639 specifies only "id" as correct. When you ask the locale customer for its representation, it returns "in", which is not correct."

When will Java JIT start compiling into native code ?

2011-09-07T02:01:00.000-07:00

With this following code, and

java version "1.7.0"
Java(TM) SE Runtime Environment (build 1.7.0-b147)
Java HotSpot(TM) Client VM (build 21.0-b17, mixed mode, sharing)

The main method will be compiled into native code when count is greater or equal to 170,000 (more or less, i didn't try to get a more accurate result)

>> jdk1.7.0/bin/java -XX:+PrintCompilation -XX:+UnlockDiagnosticVMOptions -XX:+PrintAssembly t5

public class t5 {

public static void main(String[] args) {

int count = 170000;
int sum = 3;
int A = 4;
int B = 5;
for(int i=0; i sum += A + B;
}
}
}

Native code printed:

Code:
[Disassembling for mach='i386']
[Entry Point]
[Verified Entry Point]
[Constants]
# {method} 'main' '([Ljava/lang/String;)V' in 't5'
0x02ccd480: mov %eax,0xffffd000(%esp)
0x02ccd487: push %ebp
0x02ccd488: sub $0x28,%esp ;*ldc ; - t5::main@0 (line 6)
0x02ccd48b: mov $0x0,%esi
0x02ccd490: mov $0x5,%edi
0x02ccd495: mov $0x4,%ebx
0x02ccd49a: mov $0x3,%eax
0x02ccd49f: mov $0x29810,%edx
0x02ccd4a4: jmp 0x02ccd4bb ;*iload
; - t5::main@13 (line 10)
0x02ccd4a9: xchg %ax,%ax
0x02ccd4ac: mov %ebx,%ecx
0x02ccd4ae: add %edi,%ecx
0x02ccd4b0: add %eax,%ecx
0x02ccd4b2: inc %esi ; OopMap{off=51}
;*goto
; - t5::main@29 (line 10)
0x02ccd4b3: test %eax,0x1c0100 ; {poll}
0x02ccd4b9: mov %ecx,%eax ;*goto
; - t5::main@29 (line 10)
0x02ccd4bb: cmp %edx,%esi
0x02ccd4bd: jl 0x02ccd4ac ;*if_icmpge
; - t5::main@16 (line 10)
0x02ccd4bf: add $0x28,%esp
0x02ccd4c2: pop %ebp
0x02ccd4c3: test %eax,0x1c0100 ; {poll_return}
0x02ccd4c9: ret ;*return
; - t5::main@32 (line 16)
0x02ccd4ca: mov %eax,0xffffd000(%esp)
0x02ccd4d1: push %ebp
0x02ccd4d2: sub $0x28,%esp
0x02ccd4d5: mov 0x10(%ecx),%esi
0x02ccd4d8: mov 0xc(%ecx),%edi
0x02ccd4db: mov 0x8(%ecx),%ebx
0x02ccd4de: mov 0x4(%ecx),%eax
0x02ccd4e1: mov (%ecx),%edx
0x02ccd4e3: mov %ecx,(%esp)
0x02ccd4e6: mov %esi,0x20(%esp)
0x02ccd4ea: mov %edi,0x1c(%esp)
0x02ccd4ee: mov %ebx,0x18(%esp)
0x02ccd4f2: mov %eax,0x14(%esp)
0x02ccd4f6: mov %edx,0x10(%esp)
0x02ccd4fa: call 0x636aad50 ; {runtime_call}
0x02ccd4ff: mov 0x10(%esp),%edx
0x02ccd503: mov %edx,%esi
0x02ccd505: mov 0x14(%esp),%eax
0x02ccd509: mov %eax,%edi
0x02ccd50b: mov 0x18(%esp),%ebx
0x02ccd50f: mov 0x1c(%esp),%eax
0x02ccd513: mov 0x20(%esp),%edx
0x02ccd517: jmp 0x02ccd4bb
0x02ccd519: nop
0x02ccd51a: nop
0x02ccd51b: mov %fs:0x0,%esi
0x02ccd523: mov 0xfffffff4(%esi),%esi
0x02ccd526: mov 0x184(%esi),%eax
0x02ccd52c: movl $0x0,0x184(%esi)
0x02ccd536: movl $0x0,0x188(%esi)
0x02ccd540: add $0x28,%esp
0x02ccd543: pop %ebp
0x02ccd544: jmp 0x02c9ba40 ; {runtime_call}
0x02ccd549: hlt
0x02ccd54a: hlt
0x02ccd54b: hlt
0x02ccd54c: hlt
0x02ccd54d: hlt
0x02ccd54e: hlt
0x02ccd54f: hlt
[Exception Handler]
[Stub Code]
0x02ccd550: call 0x02ccbb80 ; {no_reloc}
0x02ccd555: push $0x638dcd40 ; {external_word}
0x02ccd55a: call 0x02ccd55f
0x02ccd55f: pusha
0x02ccd560: call 0x637cf5f0 ; {runtime_call}
0x02ccd565: hlt
[Deopt Handler Code]
0x02ccd566: push $0x2ccd566 ; {section_word}
0x02ccd56b: jmp 0x02c8c930 ; {runtime_call}

JDK 7 Print JIT'ed code

2011-09-06T02:38:00.000-07:00

>> jdk1.7.0/bin/java -XX:+PrintCompilation -XX:+UnlockDiagnosticVMOptions -XX:+PrintAssembly t4 100000

Output:

Java HotSpot(TM) Client VM warning: PrintAssembly is enabled; turning on DebugNonSafepoints to gain additional output
32 1 java.lang.String::hashCode (67 bytes)
Loaded disassembler from hsdis-i386.dll

...
... String methods such as hashCode(), charAt() have been removed for clarity
...

Decoding compiled method 0x0290db08:
Code:
[Disassembling for mach='i386']
[Entry Point]
[Verified Entry Point]
[Constants]
# {method} 'theSum' '(I)I' in 't4'
# parm0: ecx = int
# [sp+0x20] (sp of caller)
0x0290dc00: mov %eax,0xffffd000(%esp)
0x0290dc07: push %ebp
0x0290dc08: sub $0x18,%esp ;*bipush
; - t4::theSum@0 (line 15)
0x0290dc0b: mov $0x0,%eax
0x0290dc10: mov $0x0,%esi
0x0290dc15: jmp 0x0290dc29 ;*iload
; - t4::theSum@11 (line 18)
0x0290dc1a: xchg %ax,%ax
0x0290dc1c: add $0xbb,%esi
0x0290dc22: inc %eax ; OopMap{off=35}
;*goto
; - t4::theSum@26 (line 18)
0x0290dc23: test %eax,0x1d0100 ;*goto
; - t4::theSum@26 (line 18)
; {poll}
0x0290dc29: cmp %ecx,%eax
0x0290dc2b: jl 0x0290dc1c ;*if_icmpge
; - t4::theSum@14 (line 18)
0x0290dc2d: mov %esi,%eax
0x0290dc2f: add $0x18,%esp
0x0290dc32: pop %ebp
0x0290dc33: test %eax,0x1d0100 ; {poll_return}
0x0290dc39: ret
0x0290dc3a: nop
0x0290dc3b: nop
0x0290dc3c: mov %fs:0x0,%esi
0x0290dc44: mov 0xfffffff4(%esi),%esi
0x0290dc47: mov 0x184(%esi),%eax
0x0290dc4d: movl $0x0,0x184(%esi)
0x0290dc57: movl $0x0,0x188(%esi)
0x0290dc61: add $0x18,%esp
0x0290dc64: pop %ebp
0x0290dc65: jmp 0x028dba40 ; {runtime_call}
0x0290dc6a: hlt
0x0290dc6b: hlt
0x0290dc6c: hlt
0x0290dc6d: hlt
0x0290dc6e: hlt
0x0290dc6f: hlt
[Exception Handler]
[Stub Code]
0x0290dc70: call 0x0290bb80 ; {no_reloc}
0x0290dc75: push $0x5c3ccd40 ; {external_word}
0x0290dc7a: call 0x0290dc7f
0x0290dc7f: pusha
0x0290dc80: call 0x5c2bf5f0 ; {runtime_call}
0x0290dc85: hlt
[Deopt Handler Code]
0x0290dc86: push $0x290dc86 ; {section_word}
0x0290dc8b: jmp 0x028cc930 ; {runtime_call}
1377 2 % t4::main @ 9 (26 bytes)
Decoding compiled method 0x0290dd48:
Code:
[Disassembling for mach='i386']
[Entry Point]
[Verified Entry Point]
[Constants]
# {method} 'main' '([Ljava/lang/String;)V' in 't4'
0x0290de50: mov %eax,0xffffd000(%esp)
0x0290de57: push %ebp
0x0290de58: sub $0x28,%esp ;*aload_0
; - t4::main@0 (line 5)
0x0290de5b: cmpl $0x0,0x8(%ecx) ; implicit exception: dispatches to 0x02
90dee9
0x0290de62: jbe 0x0290def3
0x0290de68: mov 0xc(%ecx),%ecx ;*aaload
; - t4::main@2 (line 5)
0x0290de6b: mov $0xa,%edx ;*invokestatic parseInt
; - java.lang.Integer::parseInt@3 (line
527)
; - t4::main@3 (line 5)
0x0290de70: nop
0x0290de71: nop
0x0290de72: nop
0x0290de73: call 0x028cd5c0 ; OopMap{off=40}
;*invokestatic parseInt
; - java.lang.Integer::parseInt@3 (line
527)
; - t4::main@3 (line 5)
; {static_call}
0x0290de78: mov $0x0,%esi
0x0290de7d: jmp 0x0290deac ;*iload_2
; - t4::main@9 (line 8)
0x0290de82: xchg %ax,%ax
0x0290de84: mov $0x0,%edi
0x0290de89: mov $0x0,%ebx
0x0290de8e: jmp 0x0290dea1 ;*iload
; - t4::theSum@11 (line 18)
; - t4::main@15 (line 9)
0x0290de93: nop
0x0290de94: add $0xbb,%ebx
0x0290de9a: inc %edi ; OopMap{off=75}
;*goto
; - t4::theSum@26 (line 18)
; - t4::main@15 (line 9)
0x0290de9b: test %eax,0x1d0100 ;*goto
; - t4::theSum@26 (line 18)
; - t4::main@15 (line 9)
; {poll}
0x0290dea1: cmp %eax,%edi
0x0290dea3: jl 0x0290de94 ;*if_icmpge
; - t4::theSum@14 (line 18)
; - t4::main@15 (line 9)
0x0290dea5: inc %esi ; OopMap{off=86}
;*goto
; - t4::main@22 (line 8)
0x0290dea6: test %eax,0x1d0100 ;*goto
; - t4::main@22 (line 8)
; {poll}
0x0290deac: cmp %eax,%esi
0x0290deae: jl 0x0290de84 ;*if_icmpge
; - t4::main@11 (line 8)
0x0290deb0: add $0x28,%esp
0x0290deb3: pop %ebp
0x0290deb4: test %eax,0x1d0100 ; {poll_return}
0x0290deba: ret ;*return
; - t4::main@25 (line 12)
0x0290debb: mov %eax,0xffffd000(%esp)
0x0290dec2: push %ebp
0x0290dec3: sub $0x28,%esp
0x0290dec6: mov 0x4(%ecx),%esi
0x0290dec9: mov (%ecx),%edi
0x0290decb: mov %ecx,(%esp)
0x0290dece: mov %esi,0x1c(%esp)
0x0290ded2: mov %edi,0x18(%esp)
0x0290ded6: call 0x5c19ad50 ; {runtime_call}
0x0290dedb: mov 0x18(%esp),%edi
0x0290dedf: mov %edi,%esi
0x0290dee1: mov 0x1c(%esp),%edi
0x0290dee5: mov %edi,%eax
0x0290dee7: jmp 0x0290deac
0x0290dee9: call 0x0290a850 ; OopMap{ecx=Oop off=158}
;*aaload
; - t4::main@2 (line 5)
; {runtime_call}
0x0290deee: call 0x0290a850 ; OopMap{ecx=Oop off=163}
;*aaload
; - t4::main@2 (line 5)
; {runtime_call}
0x0290def3: movl $0x0,(%esp)
0x0290defa: call 0x0290a550 ; OopMap{ecx=Oop off=175}
;*aaload
; - t4::main@2 (line 5)
; {runtime_call}
0x0290deff: nop
0x0290df00: nop
0x0290df01: mov %fs:0x0,%esi
0x0290df09: mov 0xfffffff4(%esi),%esi
0x0290df0c: mov 0x184(%esi),%eax
0x0290df12: movl $0x0,0x184(%esi)
0x0290df1c: movl $0x0,0x188(%esi)
0x0290df26: add $0x28,%esp
0x0290df29: pop %ebp
0x0290df2a: jmp 0x028dba40 ; {runtime_call}
0x0290df2f: hlt
[Stub Code]
0x0290df30: nop ; {no_reloc}
0x0290df31: nop
0x0290df32: mov $0x0,%ebx ; {static_stub}
0x0290df37: jmp 0x0290df37 ; {runtime_call}
[Exception Handler]
0x0290df3c: call 0x0290bb80 ; {runtime_call}
0x0290df41: push $0x5c3ccd40 ; {external_word}
0x0290df46: call 0x0290df4b
0x0290df4b: pusha
0x0290df4c: call 0x5c2bf5f0 ; {runtime_call}
0x0290df51: hlt
[Deopt Handler Code]
0x0290df52: push $0x290df52 ; {section_word}
0x0290df57: jmp 0x028cc930 ; {runtime_call}

t4.java

public class t4 {

public static void main(String[] args) {

int count = Integer.parseInt(args[0]);
for(int i=0; i theSum(count);
}
}

public static int theSum(int count) {
int A = 88;
int B = 99;
int sum = 0;
for (int i = 0; i < count; i++)
sum += A + B;

return sum;
}
}

Geoserver : Implementing a RESTful Service

2011-07-20T20:47:00.000-07:00

I was following this tutorial
http://docs.geoserver.org/stable/en/developer/programming-guide/rest-ser...

to add a rest service endpoint to geoserver 2.1.1 and hit a few snags:
1. must modify restconfig applicationContext.xml
and
add the "hello" bean
and
routes mapping
(by "modify" i mean re-build the module, and the web/app module)

2. "txt" extension does not map to any MediaType, hence if we try
http://localhost:8080/geoserver/rest/hello.txt
we will get HTTP Error 500.

3. therefore we use hello.json, so we have to add
formats.add(new StringFormat( MediaType.APPLICATION_JSON ));
into HelloResource.java

4. we can go to
http://localhost:8080/geoserver/rest/hello.json
and now can successfully get the json file

Outlook 2007 and rss feed

2010-11-02T22:48:00.000-07:00

Opening rss feed in Outlook from Firefox makes Outlook 2007 convert the url into lowercase, so if you have a camelCase http param, then it wouldn't work.

Solution is to have all lowercase http get param as your feed url.

2010-10-25T02:11:00.001-07:00

Using Image as a submit button

function openElt() {

var jsonRequest =
{
"template": {
"id": [currentQueryParams.identifier],
"class": "com.erdas.rsp.babel.model.CatalogItem"
},
"maxresults": -1,
"profile": "eac-brief"
};

var AjaxObject = {

handleSuccess:function(o) {
var xmlToDownload = o.responseText;
var downloadForm = window.document.forms['downloadFormPOST'];

var xmlInput = document.getElementById("xmlToDownload");
xmlInput.value = xmlToDownload;
downloadForm.submit();

},

handleFailure:function(o) {
},

startRequest:function() {

var jsonString = YAHOO.lang.JSON.stringify(jsonRequest);
YAHOO.util.Connect.initHeader('Accept', 'application/x-vnd.elt+xml; charset=utf-8', true);
YAHOO.util.Connect.asyncRequest('POST',
'http://<%=request.getServerName()%>:<%=request.getServerPort()%>/erdas-apollo/catalog/content/search',
callback,
jsonString
);
}

};

var callback = {
success:AjaxObject.handleSuccess,
failure:AjaxObject.handleFailure,
scope: AjaxObject
};

AjaxObject.startRequest();
}

<%
String xmlToDownload = request.getParameter("xmlToDownload");
if( xmlToDownload != null && !"".equals(xmlToDownload) ) {

response.setContentType("application/x-vnd.elt+xml; charset=utf-8");
String outputExtension = "elt";
String nowStr = new SimpleDateFormat("yyyy_MM_dd-HH_mm_ss").format(new Date());
response.setHeader("Content-Disposition", "attachment; filename=results-" + nowStr + "." + outputExtension);
PrintWriter writer = response.getWriter();
writer.println(xmlToDownload);
}
%>

JBoss NTLM Auth + (Maybe Drupal NTLM Auth)

2010-10-14T20:41:00.000-07:00

http://www.ioplex.com/jespa.html for NTLMv2 (http://jcifs.samba.org/ only support NTLMv1)

http://code.google.com/p/jespa-spring/ (for Spring-Framework NTLM), this is for spring-security-3.x

I modified jespa-spring for spring-security-2.x in http://github.com/lydonchandra/jespa-spring2 (just remember to create src/main/java directory and put the source files into it if I haven't done it)

To find domain controller:

echo %LOGONSERVER%

Drupal NTLM auth (this might be NTLMv1)

http://drupal.org/node/44718

Drupal + OpenLayer + Apollo

2010-10-12T23:01:00.000-07:00

1. At Administer > Site building > Modules, enable the PHP filter module.

2. <script src="http://localhost:8080/apollo-client/OpenLayers.js"></script>

<?php
drupal_add_js(
'$(document).ready(function(){

var map = new OpenLayers.Map("myWorldMap");

var wms = new OpenLayers.Layer.WMS(
"OpenLayers WMS",
"http://don_laptop:8080/erdas-apollo/vector/WORLDWIDE",
{layers: "cntry98gen02"}
);

map.addLayers([wms]);
map.zoomToMaxExtent();
});',
'inline'
);
?>

<div id="myWorldMap" style="width: 600px; height: 300px">
</div>

3. Also I needed to avoid cross-domain error because I have AJAX request going from localhost:8082 (drupal) to localhost:8080 (erdas-apollo)

ProxyRequests Off

ProxyPass /apollo-json http://don_laptop:8080/erdas-apollo/catalog/content/search.json

ProxyPassReverse /apollo-json http://don_laptop:8080/erdas-apollo/catalog/content/search.json

Flushing JAAS aut cache

2010-10-10T20:17:00.000-07:00

To disable caching you need to set the DefaultCacheTimeout to 0:
in jboss-service.xml,
<attribute name="DefaultCacheTimeout">0</attribute>

LDAP JBoss authentication and authorization

2010-10-09T01:25:00.000-07:00

<policy>

<application-policy name="apollo">
<authentication>
<login-module code="org.jboss.security.auth.spi.LdapExtLoginModule"
flag="required">
<module-option name="debug">true</module-option>
<module-option name="java.naming.provider.url">ldap://localhost:389/</module-option>
<module-option name="java.naming.security.authentication">simple</module-option>
<module-option name="bindDN">CN=admin,CN=Users,CN=donLaptop,DC=don,DC=com</module-option>
<module-option name="bindCredential">secretpassword</module-option>
<module-option name="baseCtxDN">CN=Users,CN=donLaptop,DC=don,DC=com</module-option>

<module-option name="baseFilter">(CN={0})</module-option>
<module-option name="rolesCtxDN">CN=Users,CN=donLaptop,DC=don,DC=com</module-option>
<module-option name="roleFilter">(member={1})</module-option>

<module-option name="roleAttributeID">memberOf</module-option>
<module-option name="roleAttributeIsDN">true</module-option>
<module-option name="roleNameAttributeID">CN</module-option>


<module-option name="roleRecursion">2</module-option>
<module-option name="searchScope">SUBTREE_SCOPE</module-option>

<module-option name="allowEmptyPasswords">false</module-option>
</login-module>


<login-module code="org.jboss.security.ClientLoginModule" flag="required">
<module-option name="restore-login-identity">true</module-option>
<module-option name="multi-threaded">true</module-option>
</login-module>
</authentication>
</application-policy>
</policy>

#
#############################################################################
#
# The nms-ldap.properties file is referenced by login-config.xml and is used
# by the NmsLdapLoginModule. This file controls whether LDAP access to a
# directory service is enabled for user passwords (and, optionally, user
# roles), and what parameter values are used.
#
# Contact your directory service administrator to determine the correct
# values to use in this file.
#
# This file is accessed before each attempt to sign in to the NNMi console,
# so its contents may be modified without restarting ovjboss.
#
# Whole line comments are allowed when start with a "#", but "#" characters
# at the end of a line are considered part of the value:
# paramName=paramValue # This string is part of paramName
#
# Any error messages from incorrect configuration of this file are logged to
# /log/nnm/jbossServer.log.
#
# While testing changes to this file, be sure to use "File:Sign Out",
# instead of just closing the browser, to ensure you are fully signed
# out. Doing so prevents the browser from using cached credentials.
#
# For detailed information about configuring LDAP access to a directory
# service, see the HP Network Node Manager i-series Software Deployment and
# Migration Guide.
#
#############################################################################
#

#
# java.naming.provider.url:
#
# The URL for accessing the directory service.
#
# This parameter must be set to enable LDAP access to a directory service.
# If this parameter is not set in this file, LDAP queries are not
# attempted during user sign in.
#
# The value is in the form "ldap://ldap.myco.com" or
# "ldap://ldap.myco.com:636" (which is the same as
# "ldaps://ldap.myco.com:636").
#
# If a port is specified in the URL, the specified port overrides the
# default. If unspecified, port 389 is used for non-SSL connections, or
# port 636 is used for SSL connections (as defined by
# java.naming.security.protocol).
#
# To disable login attempts through LDAP, comment out this parameter.
#
# It is recommended that all User Accounts be deleted from NNMi after
# enabling this feature, and that all Principals be deleted from NNMi after
# disabling this feature. Doing so prevents accidental access through
# previously configured values.
#
#java.naming.provider.url=ldap://ldap.myco.com:389/

#
# java.naming.security.protocol:
#
# If this parameter is set to "ssl", NNMi uses the Secure Sockets Layer
# protocol for communications with the directory service.
#
# Enable SSL if you see an error in the jbossServer.log file that is
# similar to:
# javax.naming.AuthenticationNotSupportedException:
# [LDAP: error code 13 - confidentiality required]
#
# To enable SSL, import your company's trust store certificate into the
# /shared/nnm/certificates/nnm.truststore, with a command such
# as (for UNIX):
#
# /opt/OV/nonOV/jdk/nnm/bin/keytool -storepass ovpass -import \
# -file my_certificate_authority_cert.txt -alias 'nnmi_ldap' \
# -keystore /var/opt/OV/shared/nnm/certificates/nnm.truststore
#
# where my_certificate_authority_cert.txt is a file containing the
# certificate required by the directory service for SSL communication.
#
#java.naming.security.protocol=ssl

#
# bindDN:
# bindCredential:
#
# By default, the request to validate a username and password uses
# anonymous login. However some directory services (such as
# Active Directory Services) disallow anonymous access. Use this to
# provide credentials to the directory service.
# Note that as with any entry in this file, if you want to
# specify a backslash ('\'), it must be escaped as '\\'
#
#bindDN=MyDomain\\Some User Name
#bindCredential=someUserPassword

#############################################################################
#
# The distinguished name that is passed to the directory service for
# authenticating a user is the concatenation of the baseFilter value and the
# baseCtxDN value.
#
# For example, if baseFilter is set to "uid={0}", baseCtxDN is set to
# "ou=People,o=myco.com", and a user signs in to NNMi as "john.doe", then the
# string passed to the directory service is:
# uid=john.doe,ou=People,o=myco.com
#
#############################################################################

#
# baseCtxDN:
#
# Required. The user name search context, which is the fixed portion of the
# distinguished name for the user search.
#
# For an Active Directory server, this might be a value like:
# baseCtxDN=CN=Users,DC=mycompany,DC=com
#
baseCtxDN=ou=People,o=myco.com

#
# baseFilter:
#
# Required. The variable portion of the distinguished name for the user search.
#
# The baseFilter incorporates the user name entered for NNMi signin into the
# format needed for the distinguished name.
#
# The exact user name entered at the NNMi signin dialog is substituted for
# the expression "{0}" anywhere that it appears in the filter.
#
# A common value for baseFilter for OpenLDAP servers is:
# baseFilter=uid={0}
# A common value for baseFilter for Active Directory servers is:
# baseFilter=CN={0}
# or to use the Window NT 4.0 SAM-Account-Name:
# baseFilter=sAMAccountName={0}
#
baseFilter=uid={0}

#############################################################################
#
# You can verify the correctness of the above information in an LDAP client
# application, such as Microsoft Internet Explorer 7 or Mozilla Firefox 2.
#
# Enter an RFC 1959-compliant directory service URL with the above
# information, substituting a valid signin id. For instance, using the above
# values, and a signin of john.doe, you could test with a URL similar to:
# ldap://ldap.myco.com:389/uid=john.doe,ou=People,o=myco.com
# which is formed by concatenating the java.naming.provider.url, the
# baseFilter substituted with the signin name, a comma, and the baseCtxDN.
#
# If this URL times out, you probably have an incorrect directory service URL
# or port number.
#
# If you are using Active Directory (which does not allow anonymous binding),
# you can use an LDAP browsing program to verify your values are correct.
#
#############################################################################

#
# defaultRole:
#
# Optional. Use this parameter to specify a default role that applies to any
# directory service user who signs in to NNMi through LDAP. The value of this
# parameter applies regardless of where role mappings are stored (in the NNMi
# database or in the directory service). If a user is also a member of a group
# with an NNMi role attribute, NNMi uses the role with more privileges.
#
# Valid values are the NNMi roles: admin, level2, level1, guest, or client.
#
# If commented out, no default role is used, and the role mapping must
# be defined else the user will not be able to sign in to the NNMi console.
#
#defaultRole=guest

#############################################################################
#
# The remainder of the parameters in this file apply to customers who assign
# NNMi roles in the directory service.
#
# If you maintain NNMi role mapping in the NNMi database, stop here.
#
#############################################################################

#############################################################################
#
# After a user has been authenticated, NNMi queries the groups to which that
# user belongs to determine the NNMi roles that the user will have in NNMi.
# (When a user is assigned multiple roles, NNMi uses the role with more
# privileges.)
#
# The distinguished name that is passed to the directory service for
# identifying the groups to which a user belongs is the concatenation of the
# roleFilter value and the rolesCtxDN value.
#
# For example, if roleFilter is set to "member={1}", rolesCtxDN is set to
# "ou=Groups,o=myco.com", and the authenticated user distinguished name is
# "john.doe@myco.com", then the string passed to the directory service is:
# member=john.doe@myco.com,ou=Groups,o=myco.com
#
# All group distinguished names which have an attribute (uidAttributeID)
# that match the authenticated user will be used to assign the roles for
# the user. Any matching groups will use an attribute (roleAttributeID)
# to determine the role for the user.
#
#############################################################################

#
# rolesCtxDN:
#
# The group name search context, which is the fixed portion of the
# distinguished name for the user group search.
#
# This parameter must be set to enable directory service queries for NNMi
# role assignments through LDAP. If this parameter is not set in this file,
# LDAP queries for user roles are not attempted during user sign in.
#
# To disable directory service queries for NNMi role assignments through LDAP,
# comment out this parameter. The remaining values in this file will not be
# used.
#
# For a faster search, you can identify one or more directory service groups
# that contain NNMi roles. If the group names form a pattern, you can specify
# a wildcard. For example, if the directory service includes groups named
# "USERS-NNMi-administrators", "USERS-NNMi-level1Operators", and so forth,
# you could use a search context similar to:
# rolesCtxDN=cn=USERS-NNMi-*,ou=Groups,o=myco.com
# For an Active Directory server, this might be a value like:
# rolesCtxDN=CN=Users,DC=myco,DC=com
# which might be the same as baseCtxDN because Active Directory configurations
# sometime stores Groups and Users at the same level.
#
#rolesCtxDN=ou=Groups,o=myco.com

#
# roleFilter:
#
# The variable portion of the distinguished name for the user group search.
#
# The user name entered for signin is substituted for the expression {0}
# anywhere that it appears in the filter.
#
# The distinguished name of the authenticated user is substituted for the
# expression {1} anywhere that it appears in the filter.
#
# An example role filter that matches on the (short) user name entered for
# signin is: member={0}
#
# An example role filter that matches on the authenticated (full) user
# distinguished name is: member={1}
#
roleFilter=member={1}

#############################################################################
#
# You can verify the correctness of the group query by passing a URL
# similar to the following, and entering it into a web browser, unless
# your directory server does not allow anonymous authentication (as
# is the default case for Active Directory). An example is:
# ldap://ldap.myco.com:389/ou=Groups,o=myco.com??sub?(cn=SOME-PATTERN-*)
# which is formed by concatenating the java.naming.provider.url, the
# baseCtxDN, and an optional search context limiter.
#
# If you are using Active Directory, you can use an LDAP browsing program
# to verify your values are correct.
#
#############################################################################

#
# roleAttributeIsDN:
# roleAttributeID:
# roleNameAttributeID:
#
# roleAttributeIsDN is a flag indicating whether the user's role attribute
# contains the fully distinguished name of a role object, or the users's role
# attribute contains the role name.
# In certain directory schemas (for example, Microsoft Active Directory),
# role (group) attributes in the user object are stored as distinguished names
# to role objects instead of as simple names, in which case, this property
# should be set to roleAttributeIsDN=true
# In non-Active Directory cases, false is the correct value
# of roleAttributeIsDN.
#
#
# If roleAttributeIsDN=false, the role name is taken directly from the
# value of the user's role attribute (roleAttributeID).
# For non-Active Directory servers, it is recommended that a group be created
# with an additional attribute called "roleName" that contains a value of
# admin (for Administrator role), level2 (for Level 2 Operator role),
# level1 (for Level 1 Operator role), guest (for Guest role), or
# client (if required when using the NNMi SDK and integrations). In such
# a case, you would use
# roleAttributeID=roleName
# This attribute is the name of the attribute in the group, which is
# set to a different value for each NNMi role-defining group.
#
#
# If roleAttributeIsDN=true, the following definitions apply.
# roleAttributeID is the name of the attribute in the group that stores the NNMi role value that
# applies to the members of the directory server group. For Active Directory,
# this is usually:
# roleAttributeID=memberOf
# The role attribute (roleNameAttributeID) represents
# the distinguished name of a role object, and the role name is taken from the
# value of the "roleAttributeID" attribute of the corresponding group
# specified by roleNameAttributeID.
# This is also useful if you are unable to change the schema to add an attribute
# (such as roleName), and just want the name of the group to be the role. In
# that case, you could use roleNameAttributeID=name or
# roleNameAttributeID=CN to actually use the name of the group as the nnmi
# role. This implies that you created groups specifically called admin, level2,
# level1, guest or client.
#
# In some Active Directory implementations you cannot create a new attribute
# to store the NNMi role. Active Directory groups have an "info" attribute
# you can change (often named "Notes" in the Active Directory
# configuration). In this case you would set the "info" attribute
# in your Level 2 Group in Active Directory to "level2", and use
# roleNameAttributeID=info
#
roleAttributeIsDN=false
roleAttributeID=nnmiRole
#
# Active Directory instead uses roleAttributeIsDN=true
# In this case, the actual attribute to get the role is two hops
# away, using roleAttributeID to find the DN which actually contains
# the attribute.
#
#roleAttributeIsDN=true
#roleAttributeID=memberOf
#roleNameAttributeID=info

#############################################################################
#
# The following two attributes are used to enable Incident Assignment
#
#############################################################################

#
# userRoleFilterList:
#
# A semicolon-separated list of NNMi roles whose associated users can be
# assigned incidents in the NNMi console. The roles in this list apply only
# to directory service user names authenticated through LDAP.
# If this value is incorrect, sign in will find the correct user Role,
# but selecting an Incident and picking Actions -> Assign Incident... will
# bring up a dialog with no users.
#
# Valid values are the NNMi roles: admin, level2, level1, guest, or client.
#
userRoleFilterList=admin;level2;level1

#
# uidAttributeID:
#
# The name of the attribute in the group that stores the directory service user ID.
# The value of this attribute is used to locate the user's role. It is
# usually the attribute portion of roleFilter. This attribute is used for
# looking up the list of users for Incident assignment.
# If this value is incorrect, sign in will find the correct user Role,
# but selecting an Incident and picking Actions -> Assign Incident... will
# bring up a dialog with no users.
#
uidAttributeID=member

#############################################################################
#
# The following only needs to be modified if you are finding timeouts
# when accessing a distant directory server.
#
#############################################################################

#
# searchTimeLimit
#
# If you have a slow responding directory service, you may get errors like:
# javax.naming.TimeLimitExceededException: [LDAP: error code 3 - Timelimit Exceeded]
# in this case, you can increase the searchTimeLimit. This value is
# in milliseconds. The default value is 10000 (10 seconds)
#
#searchTimeLimit=10000

Abusing? javascript functional powers

2010-09-21T19:40:00.000-07:00

Javascript being a functional language makes it very easy to pass functions around as param to other function.

However when we do that we might lose readability of the code

Consider this:

mapcar1 is just another function, same as dojo.forEach in functionality.

The code in bold has lots of redirection and very hard to debug as it calls the callback if something is successful etc.

withTransforms : function (transforms, callback, errorCallback, config) {

if (reqNeeded) {

var trs = mapcar1 (
function (t) {

return {
"toSrs" : t.to
};
},
transforms);

var callbacks =
{
success : callback,
failure :this.cbWithTransformsFailed,
b4Success : this.cbB4SuccessWithTransforms,
scope : this
};

this.ajaxTool.post (
getWebappBaseUrl () + "/transformGeometry.do",
{
"transformRequests" : trs
},
callbacks,
config);

} else {

callback (
mapcar1 (
function (t) {

return t.geometry;
},
transforms));
}
},

Java Hidden Iterator causing ConcurrentModificationException

2010-09-19T09:43:00.000-07:00

The " System.out.println("DEBUG: added ten elements to " + set);" effectively compiles into a HiddenIterator that iterates the "set", and this is not thread-safe.

Work around is to wrap "set" into a synchronizedSet

public class HiddenIterator {
@GuardedBy("this")
private final Set set = new HashSet();

public synchronized void add(Integer i) { set.add(i); }
public synchronized void remove(Integer i) { set.remove(i); }

public void addTenThings() {
Random r = new Random();
for (int i = 0; i < 10; i++)
add(r.nextInt());
System.out.println("DEBUG: added ten elements to " + set);
}
}

Weblogic + maven2 + war

2010-09-15T00:31:00.000-07:00

1. Add the following to your pom.xml, making sure you have the correct path to weblogic
[...]
<plugin>
<groupId>org.codehaus.cargo</groupId>
<artifactId>cargo-maven2-plugin</artifactId>
<configuration>
<container>
<containerId>weblogic103x</containerId>
<home>C:OracleMiddlewarewlserver_10.3</home>
</container>
</configuration>
</plugin>
[...]

2. mvn cargo:start

Erdas apollo catalog searching new properties

2010-07-13T20:45:00.000-07:00

As described in the Apollo Advantage guide

modify the queryables.xml

and then

modify the babel-types-infos.js

{
"name" : "properties.newlyAddedProperty",
"title" : "my newly added property",
"type" : "string",
"autoLike" : true
}

So the json query posted to the backend will be

{
"maxresults": 15,
"start": 0,
"profile": "eac-brief",
"orderby": ["class asc", "registrationDate desc"],
"maxresultcount": 501,
"template": {
"wmsEnabled": {
"_op": "eq",
"value": true,
"type": "boolean"
},
"properties": {
"anzlic": {
"value": "messi*",
"_op": "like",
"type": "string"
}
},
"class": "com.erdas.rsp.babel.model.imagery.ImageReference",
"nameQualifier": "babel://coverages"
}
}

SqlJdbcDriver 3.0 + ERDAS APOLLO 2010.1 + SQL Server 2008

2010-06-30T20:59:00.000-07:00

By default, ERDAS Apollo 2010.1 uses SqlJdbcDriver 2.0, where the jar files are:
1 .../jboss/server/default/lib/jdbc-driver-2.0.jar and sqljdbc.jar
2 .../erdas-apollo.ear/lib/jdbc-driver-2.0.jar

Hence if the new sqljdbc_xa.dll is installed in the SQLServer Binn directory, it should be backward compatible with the jdbc-driver-2.0.jar

The .../erdas-apollo.ear/lib/jdbc-driver-2.0.jar is required for the DataManager application to function.

To upgrade Apollo2010.1 to use SqlJdbcDriver3.0, some manual copy and paste have to be done.
1. Download the SqlJdbcDriver 2.0 from microsoft website http://www.microsoft.com/downloads/details.aspx?FamilyID=%20a737000d-68d0-4531-b65d-da0f2a735707&displaylang=en

2. Shutdown jboss.

3. Extract the files and copy sqljdbc.jar into
- .../jboss/server/default/lib/ (overwrite the existing one, if any)
- and .../erdas-apollo.ear/lib/

4. Delete the existing
- .../jboss/server/default/lib/jdbc-driver-2.0.jar and
- .../erdas-apollo.ear/lib/jdbc-driver-2.0.jar

5. Start Jboss.

6. Verify users can login from Datamanager and erdas-apollo can connect to the database by looking at the jboss server.log

ERDAS Apollo 2010 + SQL Server 2008 Express

2010-06-29T01:50:00.000-07:00

- Download SQL Server 2008 Express from http://www.microsoft.com/downloads/details.aspx?displaylang=en&FamilyID=58ce885d-508b-45c8-9fd3-118edd8e6fff and then install it.

- Enable tcp/ip port (I use port 1433) in "SQL Server Configuration Manager" -> "SQL Server Network Configuration" -> Protocols for SQLEXPRESS => TCP/IP : {enabled, Right-Click/Properties: TCP Port: 1433}.
Test with: "telnet localhost 1433" or change localhost to server's ip address

- Create database for apollo

create database apollo on
(name = apollo_dat, FILENAME = 'E:\work\apollo.mdf', size = 200MB, FILEGROW
TH=5)
LOG ON (name='apollo_log', FILENAME = 'E:\work\apollo_log.ldf', size=200MB, FILEGROWTH=5)
GO

- Supply the params to APOLLO installer.

- If you get

javax.transaction.xa.XAException, refer to my previous post:

http://lydonchandra.blogspot.com/2010/06/javaxtransactionxaxaexception.html

@@

javax.transaction.xa.XAException

2010-06-29T01:32:00.001-07:00

Issue:

javax.transaction.xa.XAException: com.microsoft.sqlserver.jdbc.SQLServerException: Failed to create the XA control connection. Error: "Could not find stored procedure 'master..xp_sqljdbc_xa_init_ex'."

Resolution:

1. Ensure Microsoft Distributed Transaction Coordinator is installed and running on every SQL Server machine that will participate in distributed transactions.

a. From Control Panel, open Administrative Tools, and then open Component Services. You can also click the Start button, click Run, type dcomcnfg in the Open box, and then press OK to open Component Services.

b. Expand Component Services, Computers and right-click My Computer, and then select Properties.

c. Click the MSDTC tab, and then click Security Configuration.

d. Select the Enable XA Transactions check box, and then click OK. This will cause a MS DTC service restart.

e. Click OK again to close the Properties dialog box, and then close Component Services.

f. Stop and then restart SQL Server to ensure that it syncs up with the MS DTC changes

2. Install the Microsoft SQL Server JDBC driver 2.0 from the url in the reference section.

3. Copy the sqljdbc_xa.dll from this directory to the Binn directory of every SQL Server machine that will participate in distributed transactions.

4. Execute the database script xa_install.sql on every SQL Server machine that will participate in distributed transactions.

5. Check that apollo db user has execute permission to the "master" database because xa_install.sql installs procedures in the master database.

Reference:

http://msdn.microsoft.com/en-us/library/aa342335.aspx
http://www.microsoft.com/downloads/details.aspx?FamilyID=99B21B65-E98F-4A61-B811-19912601FDC9&displaylang=en

Erdas Apollo 2010 Change server name

2010-06-08T22:14:00.000-07:00

Recently I changed the computer name that hosts Erdas Apollo 2010, and services stop working.
So I basically did
1. search and replace on the *.xml, *.fac, *.txt that refer to old-computer-name and replace them with new-computer-name
2. search and replace on apollo-client.war
Because this is effectively a zip file, I had to unzip it, did search and replace, zip it again, and place it in \APOLLO2010\jboss\server\default\deploy directory

FAZ position

2010-06-07T05:28:00.000-07:00

Entry price: ~15.50 to $16.00 (Currently quite far from MA)
Target1: $20
Target2: $25
Stop: $13.98
Reward2RiskRatio: 4/2

US Stockmarket 1 year view

2010-06-07T03:33:00.000-07:00

My uneducated guess for SPY in a year time (Jun 2011)
- It will be sitting ard $85 to $95, which is just the trading range in April-June 2009 before it broke out of resistance.
- It is a bearish view because:
- The governments around the world are running out of stimulus money
- Austerity programs in Europe will take place
- BRIC (Brazil, Russia, India, and China) are tightening their economy to control inflation (especially property prices in China)
- Very high level of debt among developed countries ( as detailed in http://www.debtdeflation.com/blogs/)
- refer to Nouriel Roubini http://www.youtube.com/watch?v=f7RjqfdRQDQ

Erjang on OSX 10.6.x

2010-06-06T03:29:00.000-07:00

A few obstacles I was having when trying to setup Erjang on OSX 10.6.x
1. Perl version
Erjang requires perl 5.10.0, and the default perl on the system is 5.8.x.
Perl 5.10.x is installed on the system however, so all I have to do is to modify build.xml,
replacing executable="perl" with executable="perl5.10.0"
2. Erlang environment vars
To make it easy, I add a soft link /sw that points to /opt/local

Then I can just do

./erl.sh -pa ./src/main/erl -noshell -s ring main

Dojo generate colors

2010-05-19T03:00:00.001-07:00

The one that I want is in

dojox.color.Generator.monochromatic ({ base:myColor, num:6 })
http://bugs.dojotoolkit.org/browser/dojox/trunk/color/Generator.js?rev=14628

This monochromatic function does NOT do what I want
dojo.require("dojox.color.Palette");
var colors = dojox.color.Palette.generators.monochromatic ({ base:myColor, num:6 });

Dojo How to ColorPalette + TooltipDialog + DropDownButton

2010-05-18T22:35:00.000-07:00

Erlang parse file

2010-05-13T09:43:00.000-07:00

Trying to parse csv file with the following contents

INTC,07-May-2010 16:51,21.31,21.31,21.31,21.31,200\n
INTC,07-May-2010 16:47,21.31,21.31,21.31,21.31,100\n
INTC,07-May-2010 16:42,21.31,21.31,21.31,21.31,300\n

The erlang code

getCompanyEff(Filename,Company) ->
{ok,Device} = file:open(Filename,read),
getLinesCompany(Device,[],Company).

getLinesCompany(Device,Accum,Company) ->
case io:get_line(Device,"") of
eof -> Accum;
Line ->
case regexp:first_match(Line, Company ++ ",*") of
{match,_,_} -> getLinesCompany(Device, [Line|Accum], Company);
nomatch -> getLinesCompany(Device, Accum, Company)
end
end.

and to execute:
erl> module:getCompanyEff("/path/to/file", "CompanyName").

HTML 5 postMessage (Cross-Domain Message) on Firefox 3.6.3

2010-05-10T02:02:00.000-07:00

This only works in Firefox because IE uses attachEvent(). You can always use dojo.connect( window, 'message', func() ) so it works in Firefox and IE.

A (http://localhost/cross.htm) has an iframe containing B (http://otherdomain/cross.htm)

After the iframe is loaded in A, then a message is sent to it (containing string 'Hello'). The origin is checked in B, and if it matches an alert is displayed.

on A (http://localhost/cross.htm)
<script type="text/javascript">
function iframeload() {
var o = document.getElementById('crossid').contentWindow;
o.postMessage('Hello', "http://otherdomain/cross.htm");
}
</script>

<iframe id="crossid" onload="iframeload();" src="http://otherdomain/cross.htm" width="700px" height="700px">
</iframe>

on B (http://otherdomain/cross.htm)
window.addEventListener('message',function(e) {
if (e.origin == 'http://localhost') {
if (e.data == 'Hello') {
alert(e.data);
e.source.postMessage('Hello');
} else {
alert(e.data);
}
}
}, false);

Javascript for loop + closure

2010-05-07T19:14:00.000-07:00

This for loop uses closure to get the value of i for every iteration.
Without closure, every element in divvar will get the last value of x(length-1) from iteration.

for( var i=0;i<divvar.length;i++ ) {
(
function(x) { // -> capture looping variable
divvar[x].onclick = function() {
console.debug("clicked:", x);
}
}
)(i); // -> pass in looping variable
}

Compare this to the standar loop without closure

for( var i=0;i<divvar.length;i++ ) {
divvar[i].onclick = function() {
console.debug("clicked:", i);
};
}

Or we can use dojo.forEach to fix this

ESRI ArcXML get service info

2010-05-06T20:48:00.001-07:00

HTTP POST to http://xxx/IMS/servlet/com.esri.esrimap.Esrimap?ServiceName=six_combo&CustomService=query

ARCXML service info:

<?xml version="1.0" encoding="UTF-8"?>
<ARCXML version="1.1">
<REQUEST>
<GET_SERVICE_INFO fields="false" envelope="false" renderer="false" extensions="true" acetateinfo="false" />
</REQUEST>
</ARCXML>

The response:
<?xml version="1.0" encoding="UTF-8"?>
<ARCXML version="1.1">
<RESPONSE>
<SERVICEINFO>
<ENVIRONMENT>
<LOCALE language="en" country="AU" />
<UIFONT name="Arial" color="0,0,0" size="12" style="regular" />
<SEPARATORS cs=" " ts=";"/>
<CAPABILITIES forbidden="" disabledtypes="" returngeometry="xmlmode"/>
<SCREEN dpi="74"/>
</ENVIRONMENT>
<PROPERTIES>
<FEATURECOORDSYS string="GEOGCS["GCS_GDA_1994",DATUM["D_GDA_1994",SPHEROID["GRS_1980",6378137.0,298.257222101]],PRIMEM["Greenwich",0.0],UNIT["Degree",0.0174532925199433]]" id="4283" />
<FILTERCOORDSYS string="GEOGCS["GCS_GDA_1994",DATUM["D_GDA_1994",SPHEROID["GRS_1980",6378137.0,298.257222101]],PRIMEM["Greenwich",0.0],UNIT["Degree",0.0174532925199433]]" id="4283" />
<ENVELOPE minx="140.05983881892" miny="-37.740334035" maxx="154.575951211079" maxy="-27.924909045" name="Initial_Extent" />
<ENVELOPE minx="140.05983881892" miny="-37.740334035" maxx="154.575951211079" maxy="-27.924909045" name="Extent_Limit" />
<MAPUNITS units="decimal_degrees" />
<LEGEND/>
</PROPERTIES>
<LAYERINFO type="featureclass" visible="true" name="Suburb Labels" id="Suburb_Label_1" minscale="0.0000308686210057027" maxscale="0.000308686210057027">
<FCLASS type="polygon">
<FIELD name="delivsdm:geodb.Suburb.cadid" type="4" size="10" precision="0" />
<FIELD name="delivsdm:geodb.Suburb.createdate" type="91" size="0" precision="0" />
<FIELD name="delivsdm:geodb.Suburb.modifieddate" type="91" size="0" precision="0" />
<FIELD name="delivsdm:geodb.Suburb.suburbname" type="12" size="40" precision="0" />
<FIELD name="delivsdm:geodb.Suburb.postcode" type="4" size="10" precision="0" />
<FIELD name="delivsdm:geodb.Suburb.state" type="5" size="5" precision="0" />
<FIELD name="#SHAPE#" type="-98" size="0" precision="0" />
<FIELD name="delivsdm:geodb.Suburb.objectid" type="-99" size="16" precision="0" />
<FIELD name="SE_Area(shape)" type="8" size="16" precision="8" />
<FIELD name="SE_Length(shape)" type="8" size="16" precision="8" />
</FCLASS>
</LAYERINFO>

<LAYERINFO type="featureclass" visible="true" name="Local Government Area Labels" id="LocalGovernmentArea_Label_1" minscale="0.000246948968045622" maxscale="0.000926058630171081">
<FCLASS type="polygon">
<FIELD name="delivsdm:geodb.LocalGovernmentArea.cadid" type="4" size="10" precision="0" />
<FIELD name="delivsdm:geodb.LocalGovernmentArea.createdate" type="91" size="0" precision="0" />
<FIELD name="delivsdm:geodb.LocalGovernmentArea.modifieddate" type="91" size="0" precision="0" />
<FIELD name="delivsdm:geodb.LocalGovernmentArea.lganame" type="12" size="60" precision="0" />
<FIELD name="delivsdm:geodb.LocalGovernmentArea.councilname" type="12" size="80" precision="0" />
<FIELD name="delivsdm:geodb.LocalGovernmentArea.abscode" type="4" size="10" precision="0" />
<FIELD name="delivsdm:geodb.LocalGovernmentArea.ltocode" type="4" size="10" precision="0" />
<FIELD name="delivsdm:geodb.LocalGovernmentArea.vgcode" type="4" size="10" precision="0" />
<FIELD name="delivsdm:geodb.LocalGovernmentArea.wbcode" type="4" size="10" precision="0" />
<FIELD name="#SHAPE#" type="-98" size="0" precision="0" />
<FIELD name="delivsdm:geodb.LocalGovernmentArea.objectid" type="-99" size="16" precision="0" />
<FIELD name="SE_Area(shape)" type="8" size="16" precision="8" />
<FIELD name="SE_Length(shape)" type="8" size="16" precision="8" />
</FCLASS>
</LAYERINFO>

<LAYERINFO type="featureclass" visible="false" name="Locality Labels" id="Locality_Label_1" maxscale="0.0000000308686210057027">
<FCLASS type="point">
<FIELD name="delivsdm:geodb.placepoint.topoid" type="4" size="10" precision="0" />
<FIELD name="delivsdm:geodb.placepoint.createdate" type="91" size="0" precision="0" />
<FIELD name="delivsdm:geodb.placepoint.objectmoddate" type="91" size="0" precision="0" />
<FIELD name="delivsdm:geodb.placepoint.featuremoddate" type="91" size="0" precision="0" />
<FIELD name="delivsdm:geodb.placepoint.classsubtype" type="4" size="10" precision="0" />
<FIELD name="delivsdm:geodb.placepoint.featurereliabilitydate" type="91" size="0" precision="0" />
<FIELD name="delivsdm:geodb.placepoint.attributereliabilitydate" type="91" size="0" precision="0" />
<FIELD name="delivsdm:geodb.placepoint.capturesourcecode" type="5" size="5" precision="0" />
<FIELD name="delivsdm:geodb.placepoint.capturemethodcode" type="5" size="5" precision="0" />
<FIELD name="delivsdm:geodb.placepoint.planimetricaccuracy" type="6" size="6" precision="2" />
<FIELD name="delivsdm:geodb.placepoint.verticalaccuracy" type="6" size="6" precision="2" />
<FIELD name="delivsdm:geodb.placepoint.operationalstatus" type="5" size="5" precision="0" />
<FIELD name="delivsdm:geodb.placepoint.generalnameoid" type="4" size="10" precision="0" />
<FIELD name="delivsdm:geodb.placepoint.generalname" type="12" size="50" precision="0" />
<FIELD name="delivsdm:geodb.placepoint.alternativelabel" type="12" size="50" precision="0" />
<FIELD name="delivsdm:geodb.placepoint.placetype" type="5" size="5" precision="0" />
<FIELD name="delivsdm:geodb.placepoint.population" type="4" size="10" precision="0" />
<FIELD name="delivsdm:geodb.placepoint.popsourcedate" type="91" size="0" precision="0" />
<FIELD name="delivsdm:geodb.placepoint.placesignificance" type="5" size="5" precision="0" />
<FIELD name="#SHAPE#" type="-98" size="0" precision="0" />
<FIELD name="delivsdm:geodb.placepoint.objectid" type="-99" size="16" precision="0" />
<FIELD name="SE_Area(shape)" type="8" size="16" precision="8" />
<FIELD name="SE_Length(shape)" type="8" size="16" precision="8" />
</FCLASS>
<EXTENSION type="StoredQuery">
<STOREDQUERIES>
<STOREDQUERY name="generalname">
<QUERY subfields="" where="generalname LIKE '[%var%]%'" >
</QUERY>
<SQVAR name="[%var%]" position="0">
<FIELD name="delivsdm:geodb.placepoint.generalname" type="12" />
</SQVAR>
</STOREDQUERY>
</STOREDQUERIES>
</EXTENSION>

</LAYERINFO>

<LAYERINFO type="featureclass" visible="true" name="Road Labels" id="RoadSegment_Label_1">
<FCLASS type="line">
<FIELD name="delivsdm:geodb.RoadSegment.topoid" type="4" size="10" precision="0" />
<FIELD name="delivsdm:geodb.RoadSegment.createdate" type="91" size="0" precision="0" />
<FIELD name="delivsdm:geodb.RoadSegment.objectmoddate" type="91" size="0" precision="0" />
<FIELD name="delivsdm:geodb.RoadSegment.featuremoddate" type="91" size="0" precision="0" />
<FIELD name="delivsdm:geodb.RoadSegment.classsubtype" type="4" size="10" precision="0" />
<FIELD name="delivsdm:geodb.RoadSegment.featurereliabilitydate" type="91" size="0" precision="0" />
<FIELD name="delivsdm:geodb.RoadSegment.attributereliabilitydate" type="91" size="0" precision="0" />
<FIELD name="delivsdm:geodb.RoadSegment.capturesourcecode" type="5" size="5" precision="0" />
<FIELD name="delivsdm:geodb.RoadSegment.capturemethodcode" type="5" size="5" precision="0" />
<FIELD name="delivsdm:geodb.RoadSegment.planimetricaccuracy" type="6" size="6" precision="2" />
<FIELD name="delivsdm:geodb.RoadSegment.verticalaccuracy" type="6" size="6" precision="2" />
<FIELD name="delivsdm:geodb.RoadSegment.operationalstatus" type="5" size="5" precision="0" />
<FIELD name="delivsdm:geodb.RoadSegment.roadnameoid" type="4" size="10" precision="0" />
<FIELD name="delivsdm:geodb.RoadSegment.roadnamebase" type="12" size="50" precision="0" />
<FIELD name="delivsdm:geodb.RoadSegment.roadnametype" type="12" size="20" precision="0" />
<FIELD name="delivsdm:geodb.RoadSegment.roadnamesuffix" type="12" size="10" precision="0" />
<FIELD name="delivsdm:geodb.RoadSegment.functionhierarchy" type="5" size="5" precision="0" />
<FIELD name="delivsdm:geodb.RoadSegment.roadontype" type="5" size="5" precision="0" />
<FIELD name="delivsdm:geodb.RoadSegment.surface" type="5" size="5" precision="0" />
<FIELD name="delivsdm:geodb.RoadSegment.lanecount" type="5" size="5" precision="0" />
<FIELD name="#SHAPE#" type="-98" size="0" precision="0" />
<FIELD name="delivsdm:geodb.RoadSegment.objectid" type="-99" size="16" precision="0" />
<FIELD name="SE_Area(shape)" type="8" size="16" precision="8" />
<FIELD name="SE_Length(shape)" type="8" size="16" precision="8" />
</FCLASS>
</LAYERINFO>

<LAYERINFO type="featureclass" visible="true" name="Town Labels" id="Town_Label_1" minscale="0.000246948968045622">
<FCLASS type="point">
<FIELD name="OBJECTID" type="8" size="10" precision="0" />
<FIELD name="NAME" type="12" size="32" precision="0" />
<FIELD name="POSTCODE" type="8" size="10" precision="0" />
<FIELD name="POP_1996" type="8" size="10" precision="0" />
<FIELD name="#SHAPE#" type="-98" size="0" precision="0" />
<FIELD name="#ID#" type="-99" size="16" precision="0" />
</FCLASS>
</LAYERINFO>

<LAYERINFO type="featureclass" visible="true" name="Local Government Area" id="LocalGovernmentArea_1" minscale="0.000246948968045622" maxscale="0.000926058630171081">
<FCLASS type="polygon">
<FIELD name="delivsdm:geodb.LocalGovernmentArea.cadid" type="4" size="10" precision="0" />
<FIELD name="delivsdm:geodb.LocalGovernmentArea.createdate" type="91" size="0" precision="0" />
<FIELD name="delivsdm:geodb.LocalGovernmentArea.modifieddate" type="91" size="0" precision="0" />
<FIELD name="delivsdm:geodb.LocalGovernmentArea.lganame" type="12" size="60" precision="0" />
<FIELD name="delivsdm:geodb.LocalGovernmentArea.councilname" type="12" size="80" precision="0" />
<FIELD name="delivsdm:geodb.LocalGovernmentArea.abscode" type="4" size="10" precision="0" />
<FIELD name="delivsdm:geodb.LocalGovernmentArea.ltocode" type="4" size="10" precision="0" />
<FIELD name="delivsdm:geodb.LocalGovernmentArea.vgcode" type="4" size="10" precision="0" />
<FIELD name="delivsdm:geodb.LocalGovernmentArea.wbcode" type="4" size="10" precision="0" />
<FIELD name="#SHAPE#" type="-98" size="0" precision="0" />
<FIELD name="delivsdm:geodb.LocalGovernmentArea.objectid" type="-99" size="16" precision="0" />
<FIELD name="SE_Area(shape)" type="8" size="16" precision="8" />
<FIELD name="SE_Length(shape)" type="8" size="16" precision="8" />
</FCLASS>
</LAYERINFO>

<LAYERINFO type="featureclass" visible="true" name="Suburbs" id="Suburb_1" minscale="0.0000308686210057027" maxscale="0.000308686210057027">
<FCLASS type="polygon">
<FIELD name="delivsdm:geodb.Suburb.cadid" type="4" size="10" precision="0" />
<FIELD name="delivsdm:geodb.Suburb.createdate" type="91" size="0" precision="0" />
<FIELD name="delivsdm:geodb.Suburb.modifieddate" type="91" size="0" precision="0" />
<FIELD name="delivsdm:geodb.Suburb.suburbname" type="12" size="40" precision="0" />
<FIELD name="delivsdm:geodb.Suburb.postcode" type="4" size="10" precision="0" />
<FIELD name="delivsdm:geodb.Suburb.state" type="5" size="5" precision="0" />
<FIELD name="#SHAPE#" type="-98" size="0" precision="0" />
<FIELD name="delivsdm:geodb.Suburb.objectid" type="-99" size="16" precision="0" />
<FIELD name="SE_Area(shape)" type="8" size="16" precision="8" />
<FIELD name="SE_Length(shape)" type="8" size="16" precision="8" />
</FCLASS>
</LAYERINFO>

<LAYERINFO type="featureclass" visible="true" name="Topographic Map Index" id="Topographic_Map_Index_1" maxscale="0.000617372420114054">
<FCLASS type="polygon">
<FIELD name="delivsdm:geodb.topomapindex.mapnumber" type="12" size="10" precision="0" />
<FIELD name="delivsdm:geodb.topomapindex.maptitle" type="12" size="32" precision="0" />
<FIELD name="delivsdm:geodb.topomapindex.nominalpresentationscale" type="4" size="8" precision="0" />
<FIELD name="delivsdm:geodb.topomapindex.mgazone" type="5" size="5" precision="0" />
<FIELD name="delivsdm:geodb.topomapindex.hundredkmapnumber" type="4" size="5" precision="0" />
<FIELD name="delivsdm:geodb.topomapindex.presentationformat" type="5" size="5" precision="0" />
<FIELD name="#SHAPE#" type="-98" size="0" precision="0" />
<FIELD name="delivsdm:geodb.topomapindex.objectid" type="-99" size="16" precision="0" />
<FIELD name="SE_Area(shape)" type="8" size="16" precision="8" />
<FIELD name="SE_Length(shape)" type="8" size="16" precision="8" />
</FCLASS>
</LAYERINFO>

<LAYERINFO type="featureclass" visible="true" name="NSW Border" id="Border_1" minscale="0.00617372420114054">
<FCLASS type="line">
<FIELD name="IGDS_CLASS" type="4" size="5" precision="0" />
<FIELD name="IGDS_COLOR" type="4" size="5" precision="0" />
<FIELD name="GROUP" type="4" size="5" precision="0" />
<FIELD name="IGDS_STYLE" type="4" size="5" precision="0" />
<FIELD name="WEIGHT" type="4" size="5" precision="0" />
<FIELD name="#SHAPE#" type="-98" size="0" precision="0" />
<FIELD name="#ID#" type="-99" size="16" precision="0" />
</FCLASS>
</LAYERINFO>

</SERVICEINFO>
</RESPONSE>
</ARCXML>

ArcGIS Polygon Search

2010-04-29T00:47:00.000-07:00

--Polygon Search for Transport Spending

URL: http://xxxxx/arcgis/rest/services/TransportSpending/MapServer/0/query

Filter Geometry: {"rings":[[[272276.48887,6179999.947118772],[385469.50589442987,6361478.599097537]]]}

Geometry Type: Polygon

Input Spatial Reference (WKID): 28356

Spatial Relationship: contains

Where clause: empty

I found this by sniffing the traffic of a page that I created by copying and pasting the html in http://resources.esri.com/help/9.3/arcgisserver/apis/javascript/arcgis/help/jssamples_start.htm#jssamples/util_simplify.html

Installing Erdas Professional 2010 on Amazon EC2

2010-04-12T19:15:00.000-07:00

Erdas Professional can only be installed on Windows platform.
1. Basic 64-bit Microsoft Windows Server 2008 (AMI Id: ami-cdc22ea4)
2. Download Erdas Apollo Professional 2010 from Erdas website (http://www.erdas.com/Products/ERDASProductInformation/tabid/84/currentid/3148/objectid/3148/default.aspx), you will need to register, and an instruction of how to download it from ftp.erdas.com will be given.
3. Install PostgreSQL (at least 8.3) and PostGIS extension 1.5
4. Create a new database using template_postgis. The username/password/database info will need to be entered into Apollo installation window at some point.
5. Download and install the Erdas net-License Manager (http://www.erdas.com/Products/ERDASProductInformation/tabid/84/currentid/3148/objectid/3148/~/tabid/84/currentid/2491/default.aspx)
6. Request evaluation license from Erdas websites, and follow the instruction of how to install it.
7. Once the license file is installed, you should be able to access http://your-amazon-ec2:8080/apollo-client and http://your-amazon-ec2:8080/erdas-apollo.

mod_wsgi + apache

2010-03-18T02:48:00.001-07:00

mod_wsgi

sudo vim /etc/sysconfig/apache2
sudo /usr/sbin/rcapache2 restart

Netstat + find process Id

2010-03-15T01:49:00.000-07:00

Many a times you would get a "Bind Exception", "Address already in use" kind of errors and need to find the process that's using the port. For example say the port is 8080. The following command will get you the pid and program name as well.

netstat -nlept | grep "8080"

The result might look something like this...

Proto Recv-Q Send-Q Local Address Foreign Address State User Inode PID/Program name
tcp6 0 0 :::8080 :::* LISTEN 1000 994652 4024/java
Where 4024 is the pid and it's a java app.

IBM Cloud

2010-03-12T01:36:00.000-08:00

It looks like arbitraty ports are firewalled by IBM (other than port 80 and 22 and maybe some others), so when I wanted to connect to one of my machine in the IBM Cloud on port 18080 http for example, I have to setup a reverse proxy for it.

<Proxy http://mywebsite:18080 >
Order deny,allow
Deny from all
Allow from 123.123.123.123
</Proxy>

ProxyRequests Off
ProxyPass / http://localhost:18080/
ProxyPassReverse / http://localhost:18080/

Javascript stop event bubbling and stop browser default action

2010-03-07T20:19:00.000-08:00

// stop event bubbling
function stopBubble(e) {
if( e && e.stopPropagation ) {
e.stopPropagation();
} else {
//IE
window.event.cancleBubble = true;
}
}

// stop browser default action, i.e, clicking an html link will open up that link.
function stopDefault(e) {
if( e && e.preventDefault )
//Other than IE
e.preventDefault();
else
//IE
window.event.returnValue = false;
}

function loadLi() {
var li = document.getElementsByTagName("li");
//alert(li.length);
for ( var i = 0; i < li.length; i++ ) {
li[i].onmouseover = function() {
this.style.backgroundColor = 'blue';
};

li[i].onmouseout = function() {
this.style.backgroundColor = 'white';
};
}
}

function loadAnchor() {
var anchor = document.getElementsByTagName("a");
for ( var i = 0; i < anchor.length; i++ ) {

anchor[i].onmouseover = function(e) {
this.style.backgroundColor = 'red';
stopBubble(e);
};

anchor[i].onmouseout = function(e) {
this.style.backgroundColor = 'white';
stopBubble(e);
};

anchor[i].onclick = function(e) {
iframe.src = this.href;
return stopDefault(e);
}
}
}

Spring Framework + RMI + JBoss

2010-03-07T07:13:00.000-08:00

Use RMI port 1199 (other than the default port 1099, JBoss RMI) with org.springframework.remoting.rmi.RmiServiceExporter.

<bean id="escortLocationService" class="com.don.remoting.EscortLocationServiceImpl" >
</bean>

<bean id="rmi" class="org.springframework.remoting.rmi.RmiServiceExporter" >
<property name="service" ref="escortLocationService" />
<property name="serviceName" value="EscortLocationService" />
<property name="serviceInterface" value="com.don.remoting.EscortLocationService" />
<property name="registryPort" value="1199"/>
</bean>

<bean id="escortLocationServiceClient" class="org.springframework.remoting.rmi.RmiProxyFactoryBean">
<property name="serviceUrl" value="rmi://127.0.0.1:1199/EscortLocationService" />
<property name="serviceInterface" value="com.don.remoting.EscortLocationService" />
</bean>

<bean id="escortLocationClient" class="com.don.remoting.EscortLocationClient" >
<property name="escortLocationService" ref="escortLocationServiceClient" />
</bean>

Oracle multiple case select statement

2010-03-05T00:57:00.000-08:00

In a table, I have 3 columns (checkbox1, checkbox2, checkbox3) representing values about "Where does the knowledge come from?".
if checkbox1 == 1, that means the knowledge comes from "My_Course",
checkbox2 -> Internet,
checkbox3 -> Staff.

if the checkbox1,2,3 == 0, then it's empty string.

Basically I want to concatenate values from multiple columns into one value "Know_from_where":

select student_type,
(case checkbox1
when 1 then 'My_Course, '
when 0 then '' end ) ||
(case checkbox2
when 1 then 'Internet, '
when 0 then ''
end ) ||
(case checkbox3
when 1 then 'Staff, '
when 0 then '' end ) Know_From_Where
from infolit

springsource tool suite oracle jdbc driver + maven2 depend

2010-03-03T18:19:00.000-08:00


<repository>

  <id>repo1 maven org</id>

  <name>repo1 maven org</name>

  <url>http://repo1.maven.org/maven2</url>

</repository>



<dependency>

      <groupid>ojdbc</groupid>

          <artifactid>ojdbc</artifactid>

          <version>14</version>

      </dependency>

Then you have to download ojdbc14.jar from oracle website (or wherever) and do:
mvn install:install-file -DgroupId=ojdbc -DartifactId=ojdbc -Dversion=14 -Dpackaging=jar -Dfile=/path/to/ojdbc14.jar

Xml re-generated using http://www.simplebits.com/cgi-bin/simplecode.pl?mode=process

setting up hive + hadoop 0.20.0

2009-06-12T22:25:00.000-07:00

Some errors:
I got FAILED: Unknown exception : Wrong FS: hdfs://10.1.1.x:9000/tmp/hive-hadoop/1201106067, expected: hdfs://slave:9000,
the solution: modify hadoop/conf/slaves to have the ip address 10.1.1.x (previously it was localhost

Curtin v1.0

2009-06-12T07:29:00.000-07:00

- Facilitate an online forum for each class, where materials are shared, students can discuss problems, give reviews, see photos..and the forum can be accessed from facebook? so starting small by doing what?

Most of my stuffs are in Diigo

2009-05-30T10:58:00.000-07:00

Most of the stuffs (technical) that I encountered are now bookmarked in http://www.diigo.com/dashboard/dondonakal

Web 2.1 ??

2009-05-30T10:42:00.001-07:00

Watched some good videos about google wave (from google io 2009), and also a video about the history of how the web evolved until now..
Just been thinking if it is possible to create a distributed version control over all the contents (at least the public ones) of the internet?
If the companies out there just somehow stores every version of their websites, so we (as internet users) do not need to worry about stale links anymore as the company stores it along with the new pages..

if the company goes down, then maybe it can submit the contents (public ones) to a public server maybe ??

problems: copyright..

Some improvements of web2.0?

2009-05-18T07:52:00.000-07:00

Some improvements of web2.0?

It would be nice if we can somehow add sticky notes to video??And also if there is a website that can process other websites, simplify their layouts so the end users are not trapped within a complex UI...i.e. www.curtin.edu.au I am at lost when navigating the website..a quick look of it will scare me of not finding what i want.

Mahout Hadoop

2009-05-15T21:28:00.000-07:00

Java regex to strip all non-alphanumeric chars
word = word.replaceAll("\\W", "");

TortoiseHG explorer menu doesnt work in XP64

2009-05-09T08:28:00.001-07:00

use 32bits explorer instead: (and then you can see the context menu)
'%windir%\syswow64\explorer.exe /separate

TortoiseHG explorer menu doesnt work in XP64

2009-05-09T08:28:00.000-07:00

use 32bits explorer instead: (and then you can see the context menu)
'%windir%\syswow64\explorer.exe /separate

IPhone mobile terminalhttp://code.google.com/p/mobileterminal/wiki/TipsAndTricks

2009-05-07T20:11:00.000-07:00

This article is obtained from http://code.google.com/p/mobileterminal/wiki/TipsAndTricks

Updated Aug 16, 2008 by catfacts3192
Labels: Featured
TipsAndTricks
Tips and Tricks for working with Mobile Terminal.
Introduction

This page is a collection of tips and tricks that people have found useful. Please feel free to leave your own in the comments, but put feature requests in the Issues section.
Tips
Hide the Keyboard

Tap twice quickly on the screen to hide the keyboard. Repeat to bring it back.
Control Characters

You can send a control-C by pressing the "bullet" key (First press ".?123", then "#+=", then the circle on the middle right), then press the C key. This can be useful when you want to escape out of a long running program such as ping. Control-C can also be accessed with a short Up-Right and Control is a short Down-Right swipe, after which the cursor will turn highlight red, from here press any character q, x, c, A to complete or the delete button to exit Control mode.

Escape is control-[ or a short Up-Left swip, which may come in handy with vi. Tab is control-I or a short Down-Left swip (yay tab completion).
Swipe Controls

Swipe Type Direction Action
Short Up-Right Control-C
Short Down-Right Control-
Short Up-Left Esc
Short Down-Left Tab
Short up/down/left/right arrow keys (respectively)
Long Up None (functions as up-arrow)
Long Down Enter
Long Left None
Long Right None
Two Finger Up Config
Two Finger Down Hide Keyboard
Two Finger Left Page-Up/Next
Two Finger Right Page-Down/PREV

None of the Two Finger Swipes seem to work right in 2.0 firmware
Multiple Terminals

Terminal comes with four terminal windows. Tap on the battery icon to go right, tap directally on the time to go left, and tap on the carrier name (AT&T or iPod) to crash Terminal (or do a really quick killall Terminal depending on how you look at it).
Things to do with your terminal

While this is in no way a full how-to for UNIX systems, these are some of the commands that you may find useful for your Terminal.
Copy

Usage:

1. cp file /
2. cp -r folder /
3. cp folder /
4. cp -r /folder .
5. cp /file ..

1. Copies file from the current directory to / the root directory

Command cp
Common Flags -r
# Copies the folder "folder" and its subdirectories and files to the root
# Copies the folder "folder" to the root, without its subdirectories
# copies /folder to current directory ( . stands for current directory )
# copies /file to the directory above the current ( .. stands for the directory above this )
Delete

Usage:

1. rm file
2. rm -fr folder
3. rm -r non-empty-folder
4. rm -r empty-folder

1. removes file completely (there is no trash, files deleted with rm are GONE)

Command rm
Common Flags -f -r
# removes folder and its contents recursivly
# this will fail, if a folder has contents you must use -f
# this is fine, it will remove empty-folder
Free Space

Usage:

1. df
2. df -h

1. This will output ...

Command df
Common Flags -h

Filesystem 1K-blocks Used Available Use% Mounted on
/dev/disk0s1 2048000 465184 1562336 23% /
devfs 18 18 0 100% /dev
/dev/disk0s2 13811364 9972572 3838792 73% /private/var

# This will output ... (-h is for Human-Readable)

Filesystem Size Used Avail Use% Mounted on
/dev/disk0s1 2.0G 455M 1.5G 23% /
devfs 18K 18K 0 100% /dev
/dev/disk0s2 14G 9.6G 3.7G 73% /private/var

Make Folder

Usage:

1. mkdir my-dir
2. mkdir my dir
3. mkdir my\ dir - or - mkdir "my dir"
4. mkdir /mydir
5. mkdir ~/myowndir

1. makes the directory my-dir

Command mkdir
Common Flags none
# makes the directories my and dir
# makes the directory "my dir" with a space
# makes the directory mydir below the root
# makes the directory myowndir inside your home folder

(root home folder is /private/var/root, mobile is /private/var/mobile)
Move About

Usage:

1. cd
2. cd ~
3. cd /
4. cd ..
5. cd adir
6. cd /mydir

1. goes to your home directory

Command cd
Common Flags none
# same as cd
# goes to the root
# goes up one directory
# goes to adir (if it exists)
# goes to /mydir
Direct Output

Usage:

1. ping yahoo.com >output.txt
2. df -h >freespace
3. echo "hello world" >hello_world.txt
4. ls -R / >/dev/null

1. puts the output of the ping command into a txt file

Command * >*.*
# put the output of "df -h" into freespace
# puts "hello world" into hello_world.txt
# runs the command "ls -R /" (careful thats a lot of output) but doesn't do anything with the output
Background Processes

Usage:

1. killall SpringBoard &
2. killall SpringBoard >/dev/null &

1. runs the command in the background

Command * &
# runs the command in the background and hides the output
Common unix binaries

Get the latest iphone-binkit from http://iphone.natetrue.com which contains lots of useful unix binaries. Also there ssh, apache, python, ruby. Join #iphone-shell on irc.osx86.hu for more discussion.

For some tips on setting up and using sshd and an ssh client see:

http://www.thebends.org/~allen/code/iphone-apps/binary/openssh-4.6p1/README

Binary packages: http://www.thebends.org/~allen/code/iphone-apps/binary/openssh-4.6p1-iphone-binary.tar.gz

Mobile Browser + Access Keys

2009-05-07T19:43:00.000-07:00

Access Keys is just a shortcut for some commands that you can execute by pressing a combination of keys on the keyboard.

Depending on your browser, you should

* Mozilla Firefox 1.5: hold Alt, press access key
* Mozilla Firefox 2, 3 on Windows and Linux: hold Alt-Shift, press access key
o Mozilla Firefox on Mac OS X: hold Ctrl, press access key
* Internet Explorer 6: hold Alt, press access key
* Internet Explorer 7: hold Alt-Shift, press access key
* Opera (all platforms): press Shift-Esc, then press access key (Shift-Esc will display the list of choices)
* Google Chrome: hold Alt, press access key
* Safari: hold Ctrl-Alt, press access key

See access keys for more information on this concept.
This is helpful to navigate the site for people with disabilities.

XAMPP allows user

2009-05-07T01:12:00.000-07:00

in apache/conf/extra/httpd-xampp.conf
where the directory is : xampp/security/htdocs
- Allow from ip address

Enabling b2evolution file:// uri

2009-05-06T23:56:00.000-07:00

1. add 'file' into the $allowed_uri_scheme array
2. This only works with IE, not FF atm.

Mercurial HG + Tortoise HG + Putty + PuttyLink

2009-05-05T19:50:00.000-07:00

Problem cloning HG repo when it is copied from Windows to linux and they have different version:
1. Have a look at .hg\requires file and maybe delete the line that has fncache
2. Try cloning it again hg clone ssh://user@host//path

Javac stuffs + WinSCP

2009-04-30T23:19:00.000-07:00

javac -classpath ..\..\..\mysql-connector-java-5.0.5-bin.jar myfile.java

cmd /c fc "!" "!^!" | more && pause

B2Evolution:

The latest B2Evolution 3.1.0 beta:
- easy to manage the widgets in Blog Settings, can add/remove/reposition/edit the widget.
Edit the widget -> change the text etc
and you can also edit the index.main.php to have what you want.

Doco for skins 2.0 => http://manual.b2evolution.net/Skins_2.0

- i just created a new custom skin, basically copy and paste from custom skin

usermod -G group userid
groups
hg clone ssh://userid@server//path/to/app dirToSave

Putty Tips
> Every time I accidentally press Ctrl+s in Putty when connected to any=20
> Linux box via ssh, my session stops responding. How do I restore it?
Try ctrl-q. If I remember correctly, this is leftover from the old days
when a dumb terminal would send a ctrl-s character if it was receiving
data faster than it could display it, and then send a ctrl-q when it
could handle it again.

b2evolution upgrade to 2.4.5 + mysql bak

2009-04-30T20:20:00.000-07:00

Backup your database:
mysqldump -umyname -p b2evolution > dumpfile.sql

Backup your b2evolution folder, copy and paste should be ok.

Then: from /b2evolution/doc/upgradefrom_b2evo.html

Upgrading from a previous version of b2evolution

Before you begin, please note that some network features of b2evolution require you to agree our simple Terms of service.

1. Backup all your b2evolution files. Take special care of the files you may have modified, including /conf, /skins, /plugins, your /media directory and possibly stubfiles, hacks or custom templates...
2. You should also backup your database if you can. This functionality should be provided by your host.
3. If you are upgrading from a version prior to 2.0, we highly recommend you clean up outdated files. To achieve this, delete your b2evolution folders except /media. Folders to delete include /admin, /conf, /cron, /htsrv, /inc, /install, /plugins, /skins, /skins_adm, /xmlsrv. Depending on your version, you may not have all of these folders on your server. Also, again, make sure you have a backup before deleting.
4. Upload all new b2evolution files from the /blogs folder to your site. We cannot stress this enough: ALL FILES! And that means you cannot reuse your /conf files, default skin templates or default plugins as they are.

Since your custom skins and custom plugins should be using different names, they will not be overwritten. Same for your media files.

The one file you must absolutely restore from your backup (see step 1) though is /blogs/conf/_basic_config.php. You will need to either restore or recreate that file in order to proceed with upgrade.
5. Run the installation/upgrade script on your server. It is located in http://yoursite.com/yourblogsfolder/install/ . Then, simply follow the on screen instructions.

The installer/upgrader will allow you to run a database upgrade from any b2evolution version to the new one.
6. Check to make sure the new installation works.
7. Check the online manual for specific upgrade instructions to your new version of b2evolution.
8. On production servers, it is recommended that you delete the /install subfolder.
9. If you had hacks or other customizations to the core files, your can bring those back now. We recommend you get yourself a diff/merge tool like WinMerge. This will allow you to easily compare your old (backuped) files with the new files (even whole directories at once) and report changes accordingly.

The next step is to upgrade the skins..

Solaris SunOs

2009-04-29T20:13:00.000-07:00

Few important directories
- /etc/sudoers
- /etc/local/samba/lib/smb.conf

Find text in files:
find /directoryToFind -type f -exec grep Thankyou {} \;
grep -lir "Support Request and Feedback Form" *

ORCA is LIVE

2009-04-29T09:47:00.000-07:00

ORCA is finally live!!
http://www.orcacard.com/ERG-Seattle/p1_001.do
After years of waiting, finally the Seattle community can buy smartcards to be used in the public transport system from www.orcacard.com
You can buy cards, register them, add products into the cards, configure autoloads and so on.
This is also a huge accomplishment for ERG, the software provider.

orcacard is one of the two public websites, where the other one is for the institutions like Boeing and Microsoft.

Another two websites are private, they are for the agencies and call-center.

b2evolution

2009-04-29T08:02:00.000-07:00

I am trying to fix problem on b2evolution 1.9.3 where the admin user cannot review a new post.

scenario:
1. Write a new post,
2. Then click review.

Instead of showing the review, it will return to the blog, as if I click "Exit to blog" link.

There are about 6 blogs in the same domain and only one has this problem.
This happens every time I try to login as admin where the path to index php not does have the blog id as parameter, i.e.
it works if I login like this www.mysite.com/blogs/admin.php,

but it does NOT work if I do this (clicking the login button) www.mysite.com/blogs/employee/index.php?blogID=3

Still trying to fix this problem

Internet explorer does not display *.ico file

2009-04-27T22:00:00.000-07:00

internet explorer does not display *.ico file when it is not in the correct icon format (png, jpg, gif, etc, read http://www.gtalbot.org/BrowserBugsSection/MSIE7Bugs/ and http://blogs.msdn.com/jeffdav/archive/2007/03/01/why-doesn-t-the-favicon-for-my-site-appear-in-ie7.aspx ).

It has to be in the proper ico file, so you can use free icon editor such as IconFx http://icofx.ro/ to edit your icon file and save it as proper *.ico (16x16).

Using IETester to simulate IE5.5, 6, 7, 8

2009-04-24T01:57:00.000-07:00

I used IETester to simulate IE5.5, 6, 7, 8 java script engine, to prove that an issue originated from the usage of IE8.
IETester is quite easy to use, altough I don't know where to setup the compatibilty option (Tools > Compatibility View Settings in IE8)..
http://www.my-debugbar.com/wiki/IETester/HomePage

Firefox save webpage as maff or mht

2009-04-21T04:19:00.000-07:00

With 2 firefox add-ons, we can save a webpage as a single compressed file MozillaCompressedFile(https://addons.mozilla.org/en-US/firefox/addon/212) or MHT (https://addons.mozilla.org/en-US/firefox/addons/policy/0/8051/48485)

ubuntu linux server/desktop + nfs

2009-04-20T07:14:00.000-07:00

Trying to configure nfs to work between linux ubuntu desktop and linux ubuntu server turned out to be quite hard..

nfs server side:
1. install nfs-common
sudo aptitude -P install nfs-kernel-server nfs-common portmap

2. add some directories to be exported


sudo vi /etc/exports
/tempshare ip-add-client
where ip-add-client is the host that is allowed to access the nfs

3. add ip-add-client entries into hosts.allow

portmap: ip-add-client
mountd: ip-add-client

4. sudo exportfs -a

5. if it doesnt work later, restart the server

nfs client side:
1. install nfs-common


sudo aptitude -P install nfs-kernel-server nfs-common portmap

2. sudo mount.nfs ip-add-server:/shared_dir mount_dir

New software

2009-04-13T02:16:00.000-07:00

I am surprised to find out how easy it is to browse the web using Opera browser. You can easily navigate through the links using Shift-Up/Right/Down/Left.

And if you minimize the browser, it trims its memory usage way down (typical of .Net WinForm application). I am not aware if this behaviour is available in Firefox or Google Chrome.

Now I can surf the internet without touching my mice at all!!

Also I am disappointed that Altiris SVS does not run under 64 bits OS..how painful it is..

SQLServer_2005 + VisualStudio_2008

2009-04-01T00:24:00.000-07:00

*.mdf file can be used as a database replacement (you do have to install SQLServer to access the mdf file).

Just be aware that the log file *LDF must be deleted every time a new *mdf file is deployed. Otherwise the connection cannot be established.

opensuse10+apache

2009-03-31T11:09:00.000-07:00

gensslcert

apache 2.0

error: "There is either no index document or the directory is read-protected"

solution: The default-server.conf might be missing

Options None

AllowOverride None

Order allow,deny

Allow from all

</directory>

Grails + Acegi + IntelliJ

2009-03-29T17:59:00.000-07:00

- Create new Grails application project.

- Create a new domain class using 'grails create-domain-class domain' and make sure the name does not have 'order' in it. For some reason, the IntelliJ generated domain is not recognized as a valid domain class by grails.

- Added some fields to the domain class

- Generate the Controllerclass using IntelliJ (grails create-controller script is not good enough)

- Modified the 'def index = ...' into 'def scaffold = ...'

- run-app

- grails install-plugin acegi

- grails create-auth-domains User Role Requestmap

- grails generate-manager

- grails generate-registration

- grails run-app

- Create userroles : ROLE_ADMIN and ROLE_USER

- Create user: admin with ROLE_ADMIN and user with ROLE_USER

- Create mapping: i.e. /Inventory/** for ROLE_ADMIN

- grails run-app

To enable HTTPS:

Look here http://www.stainlesscode.com/site/comments/acegi_spring_security_https_and_grails/

basically:

- grails install-templates, ( the following code is generated from http://www.simplebits.com )

 <filter>  
  <filter-name>Acegi Channel Processing Filter</filter-name>  
  <filter-class>org.springframework.security.util.FilterToBeanProxy</filter-class>  
  <init-param>  
    <param-name>targetClass</param-name>  
    <param-value>org.springframework.security.securechannel.ChannelProcessingFilter</param-value>  
  </init-param>  
</filter>  
  
<filter-mapping>  
  <filter-name>Acegi Channel Processing Filter</filter-name>  
  <url-pattern>/*</url-pattern>  
</filter-mapping>

- Navigate to the src/templates/war and add the filter to the web.xml template there:- This following code should be put into yout grails-app/conf/spring/resource.groovy file (the entire file is reproduced here):

 import org.springframework.security.securechannel.ChannelProcessingFilter  
import org.springframework.security.securechannel.ChannelDecisionManagerImpl  
import org.springframework.security.securechannel.SecureChannelProcessor  
import org.springframework.security.securechannel.InsecureChannelProcessor  


// Place your Spring DSL code here
beans = {
   secureChannelProcessor(SecureChannelProcessor)  
    insecureChannelProcessor(InsecureChannelProcessor)  
  
    channelDecisionManager(ChannelDecisionManagerImpl) {  
        channelProcessors = [secureChannelProcessor, insecureChannelProcessor]  
    }  
  
    channelProcessingFilter(ChannelProcessingFilter) {  
        channelDecisionManager=channelDecisionManager  
        filterInvocationDefinitionSource='''  
              CONVERT_URL_TO_LOWERCASE_BEFORE_COMPARISON  
              PATTERN_TYPE_APACHE_ANT  
              /**=REQUIRES_SECURE_CHANNEL  
              '''  
    }  
}

- grails run-app --https

Links:

http://luxsci.com/blog/256-bit-aes-encryption-for-ssl-and-tls-maximal-security.html