Thread: Program to find the number of occurrences of words in the text file

What is the definition of a root word? You will need to get that definition before designing and writing any code.

I meant to say that for example tallest and taller are derived or enhanced from the word "tall" so now the frequency of tall must be 3

The formatting of the code is all messed up. Please edit the post and fix its formatting.

I am sorry in a hurry i made the post like that now i have formatted it

Thats why i am confused how can i achieve it i couldnt find any logic for this but i need to do that in my code

But my code is going to find the frequency of words for an random file which the user selects so its not possible to predetermine the root words list and use it for reference :-(

Can i use substring formation?or is there any other good way for it

I am defining based on my code requirements if my code reads an text file a.txt it contains 6 words say big,bigger,biggest and long,longest then the root words are big and long so my code needs to count the frequency of big as 3 and long as 2. It needs to strip down the words bigger,biggest,longest . I am sorry if i am bad in my english

Actually i have not coded it i am asking how can i do that and the root word can be in any part of the text like it can start with or endwith or it may contain it.

Hi,I am working on an small assignment to read the text file(s) and count the frequency of words occurring in those files and print the top n words (which user will specify) and print the word and frequency of that word and one constraint i need to satisfy is if the file have words like long,longer,longest then the count of long has to be 3 not 1.so far i have made the code present in the pastie but its not working as required kindly help me to make it working properly please!!
[Java] Counter.java - Pastebin.com

Yes Norm but i have forgot about this post i am sorry for posting the same problem again but i have updated the code now i will remove my new post and continue it here

--- Update ---

I have updated my code but still its not working (i think an try catch error) but my another question is my staff said i must use indexof() method for finding the count of big,bigger,biggest and i want my output as below:
word:count
example...
hi:3
hello:2
here is my code kindly help me to correct my code please

import java.io.*;
import java.util.*;
class Counter
{
 public static void main(String[] args) throws NullPointerException
  {
  System.out.println("Enter the number of words to find its frequency:");
  Scanner scan = new Scanner(System.in);
  int k=scan.nextInt();//Number of top words to be found is stored here
  Scanner scan1 = new Scanner(System.in);
  System.out.println("Enter the file path to analyse the words:");
  String path=scan1.nextLine();// Directory path will be stored here
  File folder = new File(path);
  File[] listOfFiles = folder.listFiles();//To get the list of file-names present in the path 
  BufferedReader br = null;
  String words[]=null;
  String line="";
  String files;
  String word;
  int count=0;
 // List<String> list = new ArrayList<String>();
    for(File f:listOfFiles) {
        if (f.isFile()) {
   		files = f.getName();
                if (files.endsWith(".txt") || files.endsWith(".TXT")) {
                         try{
			 br=new BufferedReader(new FileReader(f));
			       try{
                                  while((line=br.readLine())!=null){ 
                                        line = line.toLowerCase(); // convert to lower case 
                                         words = line.split("\\s+");
                                                                }
                                       java.util.Arrays.sort(words);
 
 
                                   for(int i=0;i<words.length;i++) {
                                                 word = words[i];
                                   for(int j=0;j<words.length;j++) {
                                      if(words[j+1].equals(word)){
                                                    count++;
                                                  }
 
                                                          }
                                              }
                                      System.out.println(count);
 
 
 
 
                                     }
                                      catch(IOException e){
                                           System.out.println("I am sorry:"+e);
                                                           }
                                                                           }
                           catch(FileNotFoundException e){
                             System.out.println("Here i have got"+e.getMessage());
                                                          }
 
                                     }
                       }
                  }
          }
    }

Originally Posted by Norm

Is this a related problem: http://www.javaprogrammingforums.com...text-file.html

yes i am sorry i have forgot about that post i will continue from there

Originally Posted by Norm

Please explain what the problem is. Post the program's output and add some comments saying what is wrong.


The code's formatting needs to be fixed. The positions of the ending } are not properly aligned making the code very hard to read and understand.

import java.io.*;
import java.util.*;
 
class Counter {
 
    public static void main(String[] args) throws NullPointerException {
        System.out.println("Enter the number of words to find its frequency:");
        Scanner scan = new Scanner(System.in);
        int k = scan.nextInt();//Number of top words to be found is stored here
        Scanner scan1 = new Scanner(System.in);
        System.out.println("Enter the file path to analyse the words:");
        String path = scan1.nextLine();// Directory path will be stored here
        File folder = new File(path);
        File[] listOfFiles = folder.listFiles();//To get the list of file-names present in the path 
        BufferedReader br = null;
        String words[] = null;
        String line = "";
        String files;
        String word;
        int count = 0;
        // List<String> list = new ArrayList<String>();
        for (File f : listOfFiles) {
            if (f.isFile()) {
                files = f.getName();
                if (files.endsWith(".txt") || files.endsWith(".TXT")) {
                    try {
                        br = new BufferedReader(new FileReader(f));
                        try {
                            while ((line = br.readLine()) != null) {
                                line = line.toLowerCase(); // convert to lower case 
                                words = line.split("\\s+");
                            }
                            java.util.Arrays.sort(words);
 
                            for (int i = 0; i < words.length; i++) {
                                word = words[i];
                                for (int j = 0; j < words.length; j++) {
                                    if (words[j + 1].equals(word)) {
                                        count++;
                                    }
 
                                }
                            }
                            System.out.println(count);
 
                        } catch (IOException e) {
                            System.out.println("I am sorry:" + e);
                        }
                    } catch (FileNotFoundException e) {
                        System.out.println("Here i have got" + e.getMessage());
                    }
 
                }
            }
        }
    }
}

Sorry if still i am having an poor formatting skill and here is the output which i have got

Enter the number of words to find its frequency:
3
Enter the file path to analyse the words:
/home/dinesh
0

Actually the path /home/dinesh is having an text file with contents but now its not displaying the frequency of words in that file .the output which is expected is follows:

hi:3
hello:2
norm:1

P.S:The file present in the path have these words "hi hello hi hello hi norm" but still i am getting "0" as output. kindly help me to make my code work correctly guide me if i am wrong please

Don't create a new Scanner object each time you need to get input. The object scan can be used both times.

I see that this line will most likely cause an error each time it is run:

if ( words[j + 1].equals( word ) )

You're not seeing that?

Originally Posted by Norm

Try debugging the code by adding some println statements that print out the values of all the variables as they are assigned values so that you can see what the computer sees when the code executes.
For example print out:
1) the value of line after a record is read into it.
2) the value of the words array after the split. Use the Arrays class's toString() method as follows:
System.out.println("an ID "+ java.util.Arrays.toString(theArrayName));

here is the output after adding "System.out.println("1"+ java.util.Arrays.toString(words));"

Enter the number of words to find its frequency:
3
Enter the file path to analyse the words:
/home/dinesh/Desktop
1 [hi]
1 [hello]
1 [hi]
1 [hello]
1 [hi]
1 [norm]
Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: 1
	at Counter.main(Counter.java:40)