Thread: MySQL Quit while java application is running

I have a java app that takes data from a .csv file and put it on my MySQL database. The application has been freezing at random times during the running of the application. At first I though my code might be stuck in the while loop I had but then I though this wouldn't account for the randomness, consisting the same set of data is used each time.

I'm now pretty sure it's the connection to MySQL. I ran wireshark and see my client PC, running the java code sends a MySQL '59 Request Quit' to the mysql server.

Anyone have any experience of this problem?

I've run this a few times now and getting different outcomes, here's the code that crashes (occasionally)

String cmd = "cmd /c type C:\\Data\\" + x + "\\*.csv";
          String line;
 
          try {
            Process p = Runtime.getRuntime().exec(cmd);
            BufferedReader input = new BufferedReader(new InputStreamReader(p.getInputStream()));
            System.out.println("Processing " + x + " .csv data");
 
            while ((line = input.readLine()) != null) {
                // capture output in cdata array
                if (!"".equals(line)){
                cdata.add(line);
                }
                System.out.println("'"+line+"'");
                if("\n".equals(line) || "".equals(line)) break;
            }
            input.close();
            System.out.println("Complete Processing of " + x + " .csv data");

runs the type command in dos and captures each line of the output to an ArrayList. It's rather a big output put there seems to be plently of memory in my PC ford the job, looking at the task manager.

Any ideas on why this would seemingly stop running? when a crah occurs the 'System.out.println("Complete Processing of " + x + " .csv data")' code doesn't get run, but I can't imagine it's still in the loop because it should at least print a new line like '' at each iteration i.e. System.out.println("'"+line+"'");

Put your code in a file by itself as the body of the main() method and *don't* try-catch exceptions - your main() method should be:

public static void main(String[] args) throws Exception

You may well be running out of memory, but let's get a stack trace first.

Originally Posted by Sean4u

Put your code in a file by itself as the body of the main() method and *don't* try-catch exceptions - your main() method should be:

public static void main(String[] args) throws Exception

You may well be running out of memory, but let's get a stack trace first.

Hey that's cool we're neighbors, also in Oxford. I made a new class (below). Runs with no exceptions

public class TestClass {
    public static void main(String[] args) throws Exception{
 
        ArrayList cdata = new ArrayList();
 
        String x = "AAA";
 
          String cmd = "cmd /c type C:\\Data\\" + x + "\\*.csv";
          String line;
 
 
            Process p = Runtime.getRuntime().exec(cmd);
            BufferedReader input = new BufferedReader(new InputStreamReader(p.getInputStream()));
            System.out.println("Processing " + x + " .csv data");
 
            while ((line = input.readLine()) != null) {
                // capture output in cdata array
                if (!"".equals(line)){
                cdata.add(line);
                }
                System.out.println("'"+line+"'");
                if("\n".equals(line) || "".equals(line)) break;
            }
            input.close();
            System.out.println("end of code");
 
    }
 
 
}

Ah, just tried it on the second directory in the group and it freezes,

third directory runs okay

Just having a better look at where it's failing. within given directory there is multiple csv file, and i'm using a wildcard to type them all, it seem to randomly fail while going from one file to the next. Here's a sample output

WDP.BBB,02-Feb-2012,38.44,39.17,38.23,38.85,15871
WEB.BBB,02-Feb-2012,42.1,42.3,42.1,42.3,286
WEHB.BBB,02-Feb-2012,69.49,69.49,69,69.2,325
ZENT.BBB,02-Feb-2012,0.31,0.31,0.31,0.31,350
ZTS.BBB,02-Feb-2012,15.76,15.95,15.69,15.71,1909

C:\Data\BBB\BBB_20120203.csv


ABI.BBB,03-Feb-2012,47.7,48.865,47.425,48.86,1613073
ABIS.BBB,03-Feb-2012,0.002,0.002,0.002,0.002,312400


So it would fail at "ZTS.BBB,02-Feb-2012,15.76,15.95,15.69,15.71,1909", maybe this is the problem, i'll look at type command options to give a cleaner output before I try anything in my java code

Originally Posted by aueddonline

before I try anything in my java code

Your java code is a bit unusual. For a job like this I would usually use File.listFiles(FileFilter) and use the BufferedReader on each File in turn - I don't understand why you use a Process to do that. Does your code currently run to completion, or is it still pausing? Do you really need to use that ArrayList, or could you do something useful a line-at-a-time in your main loop?